2024-05-03T21:48:51.718 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-03T21:48:51.718 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi --verbose --archive /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536 --owner scheduled_rishabh@teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536/orig.config.yaml 2024-05-03T21:48:51.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-03T21:48:52.051 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536 branch: wip-rishabh-testing-20240501.193033 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} email: null first_in_suite: false job_id: '7687536' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240501.193033 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240501.193033 sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1698 sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea sleep_before_teardown: 0 subset: 434/512 suite: fs suite_branch: wip-rishabh-testing-20240501.193033 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_9a047fe7599a549042d06a3fb5b6813a203eabea/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJVZVWJWhPKT5FJ2y9+nTxztmiI+VY87xMiT37IJ/One7JfUIy4tk2WH0XHm700HeBPJ27f/e7+BH2scXU+o2G4= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKsuMRtov7c+wd2NIEJzHkczBg2YP7ven5TbVVNlCOh8bDm/fVNhpSQGmX1SOks22wgLaOsbcnOa7AN3WYQ4rP8= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbO5e+gWJZC/pfbwKS/ELO6A+KOQXTy5YtwjI/pYWVWOMaqhV9cav4d7Azb3S7+RT9RXvxOrUNxmqPZi/UdXqE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-03_13:56:19 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-03T21:48:52.051 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_9a047fe7599a549042d06a3fb5b6813a203eabea/qa; will attempt to use it 2024-05-03T21:48:52.051 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_9a047fe7599a549042d06a3fb5b6813a203eabea/qa/tasks 2024-05-03T21:48:52.052 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-03T21:48:52.053 INFO:teuthology.task.internal:Checking packages... 2024-05-03T21:48:52.077 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9a047fe7599a549042d06a3fb5b6813a203eabea' 2024-05-03T21:48:52.077 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-03T21:48:52.077 INFO:teuthology.packaging:ref: None 2024-05-03T21:48:52.077 INFO:teuthology.packaging:tag: None 2024-05-03T21:48:52.077 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240501.193033 2024-05-03T21:48:52.077 INFO:teuthology.packaging:sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T21:48:52.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240501.193033 2024-05-03T21:48:52.300 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3450.g9a047fe7 2024-05-03T21:48:52.302 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-03T21:48:52.309 INFO:teuthology.task.internal:no buildpackages task found 2024-05-03T21:48:52.309 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-03T21:48:52.320 INFO:teuthology.task.internal:Saving configuration 2024-05-03T21:48:52.340 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-03T21:48:52.346 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T21:48:52.372 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 21:44:01.441984', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJVZVWJWhPKT5FJ2y9+nTxztmiI+VY87xMiT37IJ/One7JfUIy4tk2WH0XHm700HeBPJ27f/e7+BH2scXU+o2G4='} 2024-05-03T21:48:52.393 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 21:44:01.438806', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKsuMRtov7c+wd2NIEJzHkczBg2YP7ven5TbVVNlCOh8bDm/fVNhpSQGmX1SOks22wgLaOsbcnOa7AN3WYQ4rP8='} 2024-05-03T21:48:52.413 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 21:44:01.440496', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbO5e+gWJZC/pfbwKS/ELO6A+KOQXTy5YtwjI/pYWVWOMaqhV9cav4d7Azb3S7+RT9RXvxOrUNxmqPZi/UdXqE='} 2024-05-03T21:48:52.414 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-03T21:48:52.419 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-03T21:48:52.419 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-03T21:48:52.420 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-03T21:48:52.420 INFO:teuthology.run_tasks:Running task console_log... 2024-05-03T21:48:52.526 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7045c5f160>, signals=[15]) 2024-05-03T21:48:52.527 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-03T21:48:52.533 INFO:teuthology.task.internal:Opening connections... 2024-05-03T21:48:52.533 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-05-03T21:48:52.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:48:52.614 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-05-03T21:48:52.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:48:52.688 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-05-03T21:48:52.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:48:52.762 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-03T21:48:52.769 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-05-03T21:48:52.787 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-05-03T21:48:52.787 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-05-03T21:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-05-03T21:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-05-03T21:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-05-03T21:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-05-03T21:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-05-03T21:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-05-03T21:48:52.844 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-03T21:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-05-03T21:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-05-03T21:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-03T21:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-05-03T21:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-03T21:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-03T21:48:52.845 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-03T21:48:52.846 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-05-03T21:48:52.873 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-05-03T21:48:52.890 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-05-03T21:48:52.891 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-05-03T21:48:52.948 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-05-03T21:48:52.948 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2024-05-03T21:48:52.948 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-05-03T21:48:52.948 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-05-03T21:48:52.948 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2024-05-03T21:48:52.948 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2024-05-03T21:48:52.948 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-03T21:48:52.948 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-05-03T21:48:52.948 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2024-05-03T21:48:52.948 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-03T21:48:52.949 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-05-03T21:48:52.949 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-03T21:48:52.949 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-03T21:48:52.949 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-03T21:48:52.949 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-05-03T21:48:52.972 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-05-03T21:48:52.990 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-05-03T21:48:52.990 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-05-03T21:48:53.046 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-03T21:48:53.047 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-03T21:48:53.048 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-03T21:48:53.048 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-05-03T21:48:53.072 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-03T21:48:53.083 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-03T21:48:53.090 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-03T21:48:53.090 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-05-03T21:48:53.092 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-05-03T21:48:53.094 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-05-03T21:48:53.111 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-03T21:48:53.116 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-03T21:48:53.117 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-05-03T21:48:53.149 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-05-03T21:48:53.151 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-05-03T21:48:53.179 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-03T21:48:53.267 INFO:teuthology.run_tasks:Running task kernel... 2024-05-03T21:48:53.283 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-05-03T21:48:53.283 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-05-03T21:48:53.284 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-03T21:48:53.285 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-03T21:48:53.285 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-03T21:48:53.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T21:48:53.302 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:48:53.302 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-03T21:48:53.302 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-05-03T21:48:53.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T21:48:53.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T21:48:53.304 DEBUG:teuthology.task.kernel:sha1 for mon.c is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:48:53.304 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-03T21:48:53.304 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-05-03T21:48:53.304 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:48:53.304 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-03T21:48:53.304 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-05-03T21:48:53.359 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-437.el9.x86_64 2024-05-03T21:48:53.359 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:48:53.359 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-03T21:48:53.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:48:53.364 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-437.el9.x86_64 2024-05-03T21:48:53.364 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-437.el9.x86_64 2024-05-03T21:48:53.364 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:48:53.364 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-03T21:48:53.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:48:53.365 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:48:53.365 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-03T21:48:53.365 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:48:53.503 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum upgrade -y linux-firmware 2024-05-03T21:48:53.573 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum upgrade -y linux-firmware 2024-05-03T21:48:53.581 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum upgrade -y linux-firmware 2024-05-03T21:48:55.689 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-05-03T21:48:55.768 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-05-03T21:48:55.867 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-05-03T21:48:57.390 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 30 MB/s | 19 MB 00:00 2024-05-03T21:48:57.553 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-05-03T21:48:57.685 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-03T21:49:01.507 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-05-03T21:49:02.282 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.2 MB 00:01 2024-05-03T21:49:02.622 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.2 MB 00:01 2024-05-03T21:49:03.126 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-05-03T21:49:04.102 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-03T21:49:04.236 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 16 kB 00:00 2024-05-03T21:49:05.154 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-05-03T21:49:06.412 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-05-03T21:49:10.212 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-05-03T21:49:11.428 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-05-03T21:49:12.208 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-05-03T21:49:12.210 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-05-03T21:49:12.210 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-05-03T21:49:12.339 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-05-03T21:49:12.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:49:12.487 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-03T21:49:12.487 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-03T21:49:12.490 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi116.front.sepia.ceph.com to complete... 2024-05-03T21:49:13.408 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-05-03T21:49:13.409 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-05-03T21:49:13.409 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-05-03T21:49:13.537 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-05-03T21:49:13.537 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:49:13.752 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-03T21:49:13.752 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-03T21:49:13.755 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi082.front.sepia.ceph.com to complete... 2024-05-03T21:49:17.403 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 1.5 MB/s | 21 MB 00:14 2024-05-03T21:49:22.474 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-05-03T21:49:24.447 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-05-03T21:49:24.448 INFO:teuthology.orchestra.run.smithi130.stdout:Nothing to do. 2024-05-03T21:49:24.448 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-05-03T21:49:24.561 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.c... 2024-05-03T21:49:24.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T21:49:24.708 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-03T21:49:24.708 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-03T21:49:24.710 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi130.front.sepia.ceph.com to complete... 2024-05-03T21:49:28.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03 21:49:28 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-03T21:49:28.749 INFO:teuthology.orchestra.run.smithi116.stderr:FINISHED --2024-05-03 21:49:28-- 2024-05-03T21:49:28.749 INFO:teuthology.orchestra.run.smithi116.stderr:Total wall clock time: 16s 2024-05-03T21:49:28.749 INFO:teuthology.orchestra.run.smithi116.stderr:Downloaded: 1 files, 341M in 16s (21.3 MB/s) 2024-05-03T21:49:28.752 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-05-03T21:49:28.753 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-03T21:49:31.030 INFO:teuthology.orchestra.run.smithi116.stdout:Verifying... ######################################## 2024-05-03T21:49:31.241 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing... ######################################## 2024-05-03T21:49:31.334 INFO:teuthology.orchestra.run.smithi116.stdout:Updating / installing... 2024-05-03T21:49:39.219 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-03T21:49:42.493 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03 21:49:42 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-03T21:49:42.494 INFO:teuthology.orchestra.run.smithi130.stderr:FINISHED --2024-05-03 21:49:42-- 2024-05-03T21:49:42.494 INFO:teuthology.orchestra.run.smithi130.stderr:Total wall clock time: 18s 2024-05-03T21:49:42.494 INFO:teuthology.orchestra.run.smithi130.stderr:Downloaded: 1 files, 341M in 17s (19.9 MB/s) 2024-05-03T21:49:42.496 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.c... 2024-05-03T21:49:42.497 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-03T21:49:44.615 INFO:teuthology.orchestra.run.smithi130.stdout:Verifying... ######################################## 2024-05-03T21:49:44.854 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing... ######################################## 2024-05-03T21:49:44.974 INFO:teuthology.orchestra.run.smithi130.stdout:Updating / installing... 2024-05-03T21:49:48.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03 21:49:48 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-03T21:49:48.862 INFO:teuthology.orchestra.run.smithi082.stderr:FINISHED --2024-05-03 21:49:48-- 2024-05-03T21:49:48.862 INFO:teuthology.orchestra.run.smithi082.stderr:Total wall clock time: 35s 2024-05-03T21:49:48.862 INFO:teuthology.orchestra.run.smithi082.stderr:Downloaded: 1 files, 341M in 35s (9.87 MB/s) 2024-05-03T21:49:48.865 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-05-03T21:49:48.865 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-03T21:49:50.932 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying... ######################################## 2024-05-03T21:49:51.166 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing... ######################################## 2024-05-03T21:49:51.264 INFO:teuthology.orchestra.run.smithi082.stdout:Updating / installing... 2024-05-03T21:49:52.939 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-03T21:49:59.197 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-03T21:50:17.907 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-03T21:50:17.908 DEBUG:teuthology.orchestra.run.smithi116:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-03T21:50:17.983 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-03T21:50:17.984 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-03T21:50:17.985 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-03T21:50:17.986 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-03T21:50:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-03T21:50:17.988 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-03T21:50:17.989 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-03T21:50:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-03T21:50:17.991 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-03T21:50:17.992 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-03T21:50:17.993 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-03T21:50:17.994 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-03T21:50:17.995 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-03T21:50:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-03T21:50:17.997 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-03T21:50:17.998 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-03T21:50:17.999 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-03T21:50:18.000 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-03T21:50:18.001 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-03T21:50:18.002 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-03T21:50:18.003 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-03T21:50:18.004 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-03T21:50:18.005 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-03T21:50:18.006 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-03T21:50:18.006 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-03T21:50:18.006 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-03T21:50:18.006 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-03T21:50:18.006 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-03T21:50:18.006 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-03T21:50:18.006 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-03T21:50:18.006 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-03T21:50:18.006 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-03T21:50:18.006 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-03T21:50:18.006 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-03T21:50:18.007 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-03T21:50:18.008 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-03T21:50:18.009 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-03T21:50:18.009 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-03T21:50:18.009 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-03T21:50:18.009 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-03T21:50:18.009 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-03T21:50:18.009 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-03T21:50:18.009 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-03T21:50:18.009 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-03T21:50:18.009 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-03T21:50:18.009 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-03T21:50:18.009 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-03T21:50:18.010 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-03T21:50:18.010 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-03T21:50:18.010 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-03T21:50:18.010 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-03T21:50:18.010 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-03T21:50:18.010 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-03T21:50:18.010 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-03T21:50:18.010 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-03T21:50:18.010 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-03T21:50:18.010 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-03T21:50:18.010 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-03T21:50:18.011 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-03T21:50:18.012 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-03T21:50:18.012 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-03T21:50:18.012 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-03T21:50:18.012 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-03T21:50:18.012 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-03T21:50:18.012 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-03T21:50:18.012 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-03T21:50:18.013 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-03T21:50:18.013 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-03T21:50:18.013 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-03T21:50:18.013 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-03T21:50:18.013 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-03T21:50:18.013 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-03T21:50:18.013 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-03T21:50:18.013 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-03T21:50:18.013 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-03T21:50:18.013 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-03T21:50:18.013 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-03T21:50:18.014 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-03T21:50:18.015 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-03T21:50:18.016 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-03T21:50:18.017 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-03T21:50:18.018 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-03T21:50:18.019 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-03T21:50:18.020 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-03T21:50:18.021 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-03T21:50:18.022 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-03T21:50:18.023 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-03T21:50:18.024 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-03T21:50:18.025 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-03T21:50:18.026 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-03T21:50:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-03T21:50:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-03T21:50:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-03T21:50:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-03T21:50:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-03T21:50:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-03T21:50:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-03T21:50:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-03T21:50:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-03T21:50:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-03T21:50:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-03T21:50:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-03T21:50:18.029 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-03T21:50:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-03T21:50:18.031 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-03T21:50:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-03T21:50:18.033 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-03T21:50:18.034 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-03T21:50:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-03T21:50:18.036 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-03T21:50:18.037 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-03T21:50:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-03T21:50:18.039 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-03T21:50:18.039 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-03T21:50:18.039 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-03T21:50:18.039 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-03T21:50:18.039 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-03T21:50:18.039 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-03T21:50:18.039 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-03T21:50:18.040 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-03T21:50:18.041 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-03T21:50:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-03T21:50:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-03T21:50:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-03T21:50:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-03T21:50:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-03T21:50:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-03T21:50:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-03T21:50:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-03T21:50:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-03T21:50:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-03T21:50:18.042 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-03T21:50:18.043 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-03T21:50:18.043 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-03T21:50:18.043 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-03T21:50:18.043 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-03T21:50:18.043 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-03T21:50:18.044 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-03T21:50:18.045 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-03T21:50:18.045 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-03T21:50:18.045 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-03T21:50:18.045 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-03T21:50:18.045 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-03T21:50:18.045 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-03T21:50:18.046 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-03T21:50:18.046 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-03T21:50:18.046 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-03T21:50:18.046 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-03T21:50:18.046 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-03T21:50:18.046 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-03T21:50:18.047 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-03T21:50:18.047 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-03T21:50:18.047 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-03T21:50:18.047 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-03T21:50:18.047 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-03T21:50:18.048 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-03T21:50:18.048 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-03T21:50:18.048 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-03T21:50:18.048 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-03T21:50:18.048 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-03T21:50:18.048 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-03T21:50:18.048 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-03T21:50:18.048 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-03T21:50:18.049 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-03T21:50:18.049 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-03T21:50:18.049 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-03T21:50:18.049 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-03T21:50:18.049 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-03T21:50:18.049 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-03T21:50:18.049 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-03T21:50:18.049 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-03T21:50:18.049 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-03T21:50:18.049 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-03T21:50:18.049 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-03T21:50:18.050 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-03T21:50:18.050 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-03T21:50:18.050 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-03T21:50:18.050 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-03T21:50:18.050 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-03T21:50:18.050 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-03T21:50:18.050 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-03T21:50:18.051 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-03T21:50:18.052 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-03T21:50:18.053 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-03T21:50:18.054 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-03T21:50:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-03T21:50:18.056 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-03T21:50:18.057 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-03T21:50:18.058 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-03T21:50:18.059 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-03T21:50:18.060 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-03T21:50:18.061 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-03T21:50:18.062 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-03T21:50:18.063 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-03T21:50:18.063 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-03T21:50:18.063 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-03T21:50:18.063 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-03T21:50:18.063 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-03T21:50:18.063 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-03T21:50:18.063 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-03T21:50:18.063 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-03T21:50:18.064 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-03T21:50:18.064 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-03T21:50:18.064 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-03T21:50:18.064 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-03T21:50:18.064 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-03T21:50:18.064 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-03T21:50:18.064 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-03T21:50:18.065 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-03T21:50:18.065 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-03T21:50:18.065 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-03T21:50:18.065 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-03T21:50:18.065 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-03T21:50:18.065 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-03T21:50:18.065 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-03T21:50:18.066 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-03T21:50:18.066 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-03T21:50:18.066 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-03T21:50:18.066 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-03T21:50:18.066 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-03T21:50:18.066 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-03T21:50:18.067 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-03T21:50:18.067 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-03T21:50:18.067 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-03T21:50:18.067 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-03T21:50:18.067 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-03T21:50:18.067 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-03T21:50:18.067 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-03T21:50:18.068 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-03T21:50:18.068 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-03T21:50:18.068 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-03T21:50:18.068 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-03T21:50:18.068 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-03T21:50:18.068 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-03T21:50:18.068 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-03T21:50:18.068 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-03T21:50:18.069 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-03T21:50:18.069 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-03T21:50:18.069 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-03T21:50:18.069 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-03T21:50:18.069 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-03T21:50:18.069 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-03T21:50:18.069 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-03T21:50:18.069 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-03T21:50:18.069 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-03T21:50:18.070 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-03T21:50:18.070 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-03T21:50:18.070 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-03T21:50:18.070 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-03T21:50:18.070 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-03T21:50:18.070 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-03T21:50:18.071 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-03T21:50:18.071 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-03T21:50:18.071 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-03T21:50:18.071 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-03T21:50:18.071 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-03T21:50:18.071 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-03T21:50:18.072 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-03T21:50:18.072 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-03T21:50:18.072 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-03T21:50:18.072 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-03T21:50:18.072 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-03T21:50:18.072 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-03T21:50:18.073 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-03T21:50:18.073 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-03T21:50:18.073 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-03T21:50:18.073 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-03T21:50:18.073 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-03T21:50:18.073 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-03T21:50:18.073 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-03T21:50:18.074 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-03T21:50:18.075 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-03T21:50:18.076 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-03T21:50:18.077 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-03T21:50:18.078 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-03T21:50:18.078 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-03T21:50:18.078 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-03T21:50:18.078 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-03T21:50:18.078 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-03T21:50:18.078 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-03T21:50:18.078 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-03T21:50:18.078 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-03T21:50:18.079 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-03T21:50:18.080 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-03T21:50:18.080 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-03T21:50:18.080 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-03T21:50:18.080 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-03T21:50:18.080 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-03T21:50:18.080 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-03T21:50:18.081 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-03T21:50:18.081 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-03T21:50:18.081 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-03T21:50:18.081 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-03T21:50:18.081 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-03T21:50:18.081 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-03T21:50:18.082 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-03T21:50:18.082 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-03T21:50:18.082 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-03T21:50:18.082 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-03T21:50:18.082 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-03T21:50:18.082 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-03T21:50:18.083 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-03T21:50:18.083 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-03T21:50:18.083 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-03T21:50:18.083 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-03T21:50:18.083 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-03T21:50:18.083 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-03T21:50:18.083 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-03T21:50:18.083 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-03T21:50:18.083 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-03T21:50:18.083 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-03T21:50:18.084 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-03T21:50:18.084 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-03T21:50:18.084 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-03T21:50:18.084 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-03T21:50:18.084 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-03T21:50:18.084 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-03T21:50:18.084 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-03T21:50:18.085 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-03T21:50:18.086 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-03T21:50:18.087 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-03T21:50:18.088 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-03T21:50:18.089 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-03T21:50:18.090 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-03T21:50:18.091 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-03T21:50:18.092 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-03T21:50:18.093 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-03T21:50:18.094 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-03T21:50:18.095 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-03T21:50:18.096 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-03T21:50:18.097 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-03T21:50:18.098 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-03T21:50:18.099 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-03T21:50:18.100 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-03T21:50:18.101 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-03T21:50:18.102 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-03T21:50:18.102 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-03T21:50:18.102 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-03T21:50:18.102 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-03T21:50:18.102 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-03T21:50:18.102 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-03T21:50:18.102 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-03T21:50:18.102 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-03T21:50:18.102 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-03T21:50:18.103 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-03T21:50:18.103 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-03T21:50:18.103 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-03T21:50:18.103 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-03T21:50:18.103 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-03T21:50:18.103 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-03T21:50:18.103 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-03T21:50:18.103 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-03T21:50:18.104 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-03T21:50:18.104 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-03T21:50:18.104 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-03T21:50:18.104 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-03T21:50:18.104 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-03T21:50:18.104 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-03T21:50:18.104 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-03T21:50:18.104 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-03T21:50:18.105 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-03T21:50:18.105 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-03T21:50:18.105 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-03T21:50:18.105 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-03T21:50:18.105 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-03T21:50:18.105 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-03T21:50:18.105 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-03T21:50:18.105 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-03T21:50:18.105 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-03T21:50:18.106 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-03T21:50:18.106 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-03T21:50:18.106 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-03T21:50:18.106 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-03T21:50:18.106 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-03T21:50:18.106 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-03T21:50:18.106 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-03T21:50:18.106 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-03T21:50:18.107 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-03T21:50:18.107 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-03T21:50:18.107 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-03T21:50:18.107 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-03T21:50:18.107 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-03T21:50:18.107 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-03T21:50:18.107 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-03T21:50:18.107 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-03T21:50:18.108 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-03T21:50:18.108 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-03T21:50:18.108 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-03T21:50:18.108 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-03T21:50:18.108 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-03T21:50:18.108 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-03T21:50:18.108 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-03T21:50:18.108 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-03T21:50:18.108 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-03T21:50:18.109 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-03T21:50:18.109 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-03T21:50:18.109 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-03T21:50:18.109 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-03T21:50:18.109 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-03T21:50:18.109 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-03T21:50:18.109 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-03T21:50:18.109 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-03T21:50:18.110 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-03T21:50:18.110 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-03T21:50:18.110 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-03T21:50:18.110 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-03T21:50:18.110 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-03T21:50:18.110 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-03T21:50:18.110 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-03T21:50:18.110 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-03T21:50:18.111 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-03T21:50:18.111 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-03T21:50:18.111 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-03T21:50:18.111 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-03T21:50:18.111 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-03T21:50:18.111 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-03T21:50:18.111 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-03T21:50:18.111 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-03T21:50:18.111 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-03T21:50:18.111 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-03T21:50:18.111 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-03T21:50:18.112 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-03T21:50:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-03T21:50:18.114 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-03T21:50:18.115 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-03T21:50:18.116 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-03T21:50:18.116 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-03T21:50:18.116 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-03T21:50:18.116 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-03T21:50:18.116 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-03T21:50:18.116 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-03T21:50:18.116 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-03T21:50:18.116 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-03T21:50:18.116 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-03T21:50:18.117 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-03T21:50:18.117 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-03T21:50:18.117 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-03T21:50:18.117 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-03T21:50:18.117 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-03T21:50:18.117 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-03T21:50:18.117 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-03T21:50:18.117 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-03T21:50:18.117 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-03T21:50:18.117 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-03T21:50:18.117 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-03T21:50:18.118 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-03T21:50:18.118 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-03T21:50:18.118 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-03T21:50:18.118 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-03T21:50:18.118 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-03T21:50:18.118 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-03T21:50:18.118 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-03T21:50:18.118 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-03T21:50:18.118 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-03T21:50:18.119 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-03T21:50:18.120 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-03T21:50:18.120 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-03T21:50:18.120 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-03T21:50:18.120 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-03T21:50:18.120 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-03T21:50:18.120 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-03T21:50:18.120 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-03T21:50:18.120 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-03T21:50:18.121 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-03T21:50:18.121 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-03T21:50:18.121 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-03T21:50:18.121 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-03T21:50:18.121 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-03T21:50:18.121 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-03T21:50:18.121 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-03T21:50:18.122 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-03T21:50:18.122 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-03T21:50:18.122 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-03T21:50:18.122 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-03T21:50:18.122 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-03T21:50:18.122 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-03T21:50:18.123 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-03T21:50:18.124 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-03T21:50:18.124 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-03T21:50:18.124 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-03T21:50:18.124 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-03T21:50:18.124 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-03T21:50:18.124 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-03T21:50:18.124 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-03T21:50:18.125 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-03T21:50:18.126 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-03T21:50:18.127 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-03T21:50:18.128 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-03T21:50:18.128 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-03T21:50:18.128 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-03T21:50:18.128 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-03T21:50:18.128 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-03T21:50:18.128 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-03T21:50:18.128 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-03T21:50:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-03T21:50:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-03T21:50:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-03T21:50:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-03T21:50:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-03T21:50:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-03T21:50:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-03T21:50:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-03T21:50:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-03T21:50:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-03T21:50:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-03T21:50:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-03T21:50:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-03T21:50:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-03T21:50:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-03T21:50:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-03T21:50:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-03T21:50:18.131 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-03T21:50:18.131 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-03T21:50:18.131 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-03T21:50:18.131 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-03T21:50:18.131 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-03T21:50:18.131 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-03T21:50:18.131 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-03T21:50:18.131 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-03T21:50:18.131 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-03T21:50:18.132 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-03T21:50:18.132 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-03T21:50:18.132 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-03T21:50:18.132 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-03T21:50:18.132 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-03T21:50:18.132 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-03T21:50:18.132 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-03T21:50:18.132 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-03T21:50:18.133 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-03T21:50:18.133 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-03T21:50:18.133 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-03T21:50:18.133 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-03T21:50:18.133 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-03T21:50:18.133 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-03T21:50:18.133 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-03T21:50:18.133 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-03T21:50:18.133 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-03T21:50:18.134 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-03T21:50:18.134 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-03T21:50:18.134 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-03T21:50:18.134 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-03T21:50:18.134 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-03T21:50:18.134 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-03T21:50:18.134 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-03T21:50:18.134 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-03T21:50:18.135 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-03T21:50:18.135 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-03T21:50:18.135 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-03T21:50:18.135 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-03T21:50:18.135 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-03T21:50:18.135 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-03T21:50:18.135 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-03T21:50:18.135 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-03T21:50:18.136 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-03T21:50:18.136 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-03T21:50:18.136 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-03T21:50:18.136 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-03T21:50:18.136 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-03T21:50:18.136 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-03T21:50:18.136 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-03T21:50:18.136 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-03T21:50:18.137 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-03T21:50:18.137 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-03T21:50:18.137 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-03T21:50:18.137 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-03T21:50:18.137 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-03T21:50:18.137 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-03T21:50:18.137 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-03T21:50:18.137 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-03T21:50:18.137 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-03T21:50:18.138 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-03T21:50:18.138 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-03T21:50:18.138 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-03T21:50:18.138 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-03T21:50:18.138 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-03T21:50:18.138 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-03T21:50:18.138 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-03T21:50:18.139 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-03T21:50:18.139 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-03T21:50:18.139 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-03T21:50:18.139 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-03T21:50:18.139 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-03T21:50:18.139 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-03T21:50:18.139 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-03T21:50:18.139 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-03T21:50:18.139 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-03T21:50:18.140 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-03T21:50:18.140 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-03T21:50:18.140 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-03T21:50:18.140 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-03T21:50:18.140 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-03T21:50:18.140 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-03T21:50:18.140 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-03T21:50:18.140 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-03T21:50:18.141 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-03T21:50:18.141 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-03T21:50:18.141 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-03T21:50:18.141 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-03T21:50:18.141 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-03T21:50:18.141 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-03T21:50:18.141 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-03T21:50:18.141 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-03T21:50:18.141 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-03T21:50:18.142 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-03T21:50:18.142 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-03T21:50:18.142 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-03T21:50:18.142 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-03T21:50:18.142 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-03T21:50:18.142 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-03T21:50:18.142 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-03T21:50:18.142 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-03T21:50:18.143 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-03T21:50:18.144 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-03T21:50:18.145 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-03T21:50:18.146 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-03T21:50:18.146 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-03T21:50:18.146 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-03T21:50:18.146 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-03T21:50:18.146 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-03T21:50:18.147 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-03T21:50:18.147 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-03T21:50:18.147 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-03T21:50:18.147 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-03T21:50:18.147 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-03T21:50:18.147 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-03T21:50:18.147 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-03T21:50:18.147 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-03T21:50:18.148 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-03T21:50:18.148 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-03T21:50:18.148 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-03T21:50:18.148 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-03T21:50:18.148 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-03T21:50:18.149 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-03T21:50:18.150 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-03T21:50:18.151 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-03T21:50:18.152 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-03T21:50:18.152 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-03T21:50:18.152 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-03T21:50:18.152 INFO:teuthology.orchestra.run.smithi116.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T21:50:18.156 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:18.156 DEBUG:teuthology.orchestra.run.smithi116:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout:postinstall scriptlet (using /bin/sh): 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout:fi 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout:for file in vmlinuz System.map config; do 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout: fi 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout:done 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-03T21:50:18.179 INFO:teuthology.orchestra.run.smithi116.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T21:50:18.180 INFO:teuthology.orchestra.run.smithi116.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T21:50:18.180 INFO:teuthology.orchestra.run.smithi116.stdout:fi 2024-05-03T21:50:18.180 INFO:teuthology.orchestra.run.smithi116.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-03T21:50:18.180 INFO:teuthology.orchestra.run.smithi116.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:18.180 INFO:teuthology.orchestra.run.smithi116.stdout:fi 2024-05-03T21:50:18.180 INFO:teuthology.orchestra.run.smithi116.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-03T21:50:18.180 INFO:teuthology.orchestra.run.smithi116.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T21:50:18.180 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:18.180 INFO:teuthology.orchestra.run.smithi116.stdout:fi 2024-05-03T21:50:18.181 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2024-05-03T21:50:18.254 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2024-05-03T21:50:18.254 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2024-05-03T21:50:18.254 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.06 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 68.el9 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Group : Unspecified 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 8264254 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : builder@centos.org 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2024-05-03T21:50:18.255 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2024-05-03T21:50:18.256 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:50:18.256 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-03T21:50:18.256 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-03T21:50:18.256 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-03T21:50:18.256 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2024-05-03T21:50:18.256 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:50:18.256 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2024-05-03T21:50:18.257 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-03T21:50:18.257 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:18.257 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-03T21:50:18.849 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-05-03T21:50:20.285 INFO:teuthology.orchestra.run.smithi116.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-03T21:50:20.317 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-05-03T21:50:20.319 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-05-03T21:50:20.335 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.uIIr6uBSo0 2024-05-03T21:50:20.335 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uIIr6uBSo0 2024-05-03T21:50:20.401 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.uIIr6uBSo0 2024-05-03T21:50:20.540 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.uIIr6uBSo0 is 6KB 2024-05-03T21:50:20.588 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.uIIr6uBSo0 2024-05-03T21:50:20.602 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2024-05-03T21:50:20.664 INFO:teuthology.orchestra.run.smithi116.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-03T21:50:20.664 INFO:teuthology.orchestra.run.smithi116.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-03T21:50:20.664 INFO:teuthology.orchestra.run.smithi116.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-03T21:50:20.664 INFO:teuthology.orchestra.run.smithi116.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-03T21:50:20.665 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:20.815 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-05-03T21:50:31.990 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-03T21:50:31.991 DEBUG:teuthology.orchestra.run.smithi130:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-03T21:50:32.077 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:32.077 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:32.077 INFO:teuthology.orchestra.run.smithi130.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:32.077 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-03T21:50:32.077 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-03T21:50:32.077 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-03T21:50:32.077 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-03T21:50:32.078 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-03T21:50:32.079 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-03T21:50:32.080 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-03T21:50:32.081 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-03T21:50:32.082 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-03T21:50:32.083 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-03T21:50:32.084 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-03T21:50:32.085 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-03T21:50:32.086 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-03T21:50:32.087 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-03T21:50:32.088 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-03T21:50:32.089 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-03T21:50:32.090 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-03T21:50:32.091 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-03T21:50:32.092 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-03T21:50:32.093 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-03T21:50:32.094 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-03T21:50:32.095 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-03T21:50:32.096 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-03T21:50:32.097 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-03T21:50:32.098 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-03T21:50:32.099 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-03T21:50:32.100 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-03T21:50:32.101 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-03T21:50:32.102 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-03T21:50:32.103 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-03T21:50:32.104 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-03T21:50:32.105 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-03T21:50:32.106 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-03T21:50:32.107 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-03T21:50:32.108 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-03T21:50:32.109 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-03T21:50:32.110 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-03T21:50:32.111 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-03T21:50:32.112 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-03T21:50:32.113 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-03T21:50:32.114 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-03T21:50:32.115 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-03T21:50:32.116 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-03T21:50:32.117 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-03T21:50:32.118 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-03T21:50:32.119 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-03T21:50:32.120 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-03T21:50:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-03T21:50:32.122 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-03T21:50:32.123 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-03T21:50:32.124 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-03T21:50:32.125 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-03T21:50:32.126 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-03T21:50:32.127 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-03T21:50:32.128 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-03T21:50:32.129 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-03T21:50:32.130 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-03T21:50:32.131 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-03T21:50:32.132 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-03T21:50:32.133 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-03T21:50:32.134 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-03T21:50:32.135 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-03T21:50:32.136 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-03T21:50:32.137 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-03T21:50:32.138 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-03T21:50:32.139 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-03T21:50:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-03T21:50:32.141 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-03T21:50:32.142 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-03T21:50:32.143 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-03T21:50:32.144 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-03T21:50:32.145 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-03T21:50:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-03T21:50:32.147 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-03T21:50:32.148 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-03T21:50:32.149 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-03T21:50:32.150 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-03T21:50:32.151 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-03T21:50:32.152 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-03T21:50:32.153 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-03T21:50:32.154 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-03T21:50:32.155 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-03T21:50:32.156 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-03T21:50:32.157 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-03T21:50:32.158 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-03T21:50:32.159 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-03T21:50:32.160 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-03T21:50:32.161 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-03T21:50:32.162 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-03T21:50:32.163 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-03T21:50:32.164 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-03T21:50:32.165 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-03T21:50:32.166 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-03T21:50:32.167 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-03T21:50:32.168 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-03T21:50:32.169 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-03T21:50:32.170 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-03T21:50:32.171 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-03T21:50:32.172 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-03T21:50:32.173 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-03T21:50:32.174 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-03T21:50:32.175 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-03T21:50:32.176 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-03T21:50:32.177 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-03T21:50:32.178 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-03T21:50:32.179 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-03T21:50:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-03T21:50:32.181 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-03T21:50:32.182 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-03T21:50:32.183 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-03T21:50:32.184 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-03T21:50:32.185 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-03T21:50:32.186 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-03T21:50:32.187 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-03T21:50:32.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-03T21:50:32.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-03T21:50:32.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-03T21:50:32.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-03T21:50:32.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-03T21:50:32.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-03T21:50:32.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-03T21:50:32.190 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-03T21:50:32.191 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-03T21:50:32.192 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-03T21:50:32.193 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-03T21:50:32.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-03T21:50:32.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-03T21:50:32.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-03T21:50:32.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-03T21:50:32.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-03T21:50:32.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-03T21:50:32.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-03T21:50:32.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-03T21:50:32.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-03T21:50:32.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-03T21:50:32.194 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-03T21:50:32.195 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-03T21:50:32.196 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-03T21:50:32.197 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-03T21:50:32.198 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-03T21:50:32.199 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-03T21:50:32.200 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-03T21:50:32.201 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-03T21:50:32.202 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-03T21:50:32.203 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-03T21:50:32.204 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-03T21:50:32.205 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-03T21:50:32.206 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-03T21:50:32.207 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-03T21:50:32.208 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-03T21:50:32.209 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-03T21:50:32.210 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-03T21:50:32.211 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-03T21:50:32.212 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-03T21:50:32.213 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-03T21:50:32.214 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-03T21:50:32.215 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-03T21:50:32.216 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-03T21:50:32.217 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-03T21:50:32.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-03T21:50:32.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-03T21:50:32.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-03T21:50:32.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-03T21:50:32.218 INFO:teuthology.orchestra.run.smithi130.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T21:50:32.221 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:32.222 DEBUG:teuthology.orchestra.run.smithi130:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-03T21:50:32.244 INFO:teuthology.orchestra.run.smithi130.stdout:postinstall scriptlet (using /bin/sh): 2024-05-03T21:50:32.244 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T21:50:32.244 INFO:teuthology.orchestra.run.smithi130.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T21:50:32.244 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2024-05-03T21:50:32.244 INFO:teuthology.orchestra.run.smithi130.stdout:for file in vmlinuz System.map config; do 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: fi 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout:done 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-03T21:50:32.245 INFO:teuthology.orchestra.run.smithi130.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T21:50:32.246 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:32.246 INFO:teuthology.orchestra.run.smithi130.stdout:fi 2024-05-03T21:50:32.246 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -qi grub2-tools 2024-05-03T21:50:32.317 INFO:teuthology.orchestra.run.smithi130.stdout:Name : grub2-tools 2024-05-03T21:50:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:Epoch : 1 2024-05-03T21:50:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:Version : 2.06 2024-05-03T21:50:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:Release : 68.el9 2024-05-03T21:50:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: x86_64 2024-05-03T21:50:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-03T21:50:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:Group : Unspecified 2024-05-03T21:50:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:Size : 8264254 2024-05-03T21:50:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:License : GPLv3+ 2024-05-03T21:50:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-03T21:50:32.318 INFO:teuthology.orchestra.run.smithi130.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:Packager : builder@centos.org 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:Vendor : CentOS 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:Summary : Support tools for GRUB. 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:Description : 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:hardware devices. 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:50:32.319 INFO:teuthology.orchestra.run.smithi130.stdout:This subpackage provides tools for support of all platforms. 2024-05-03T21:50:32.320 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-03T21:50:32.320 INFO:teuthology.task.kernel:Updating grub on smithi130 to boot 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:32.320 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-03T21:50:32.865 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2024-05-03T21:50:34.236 INFO:teuthology.orchestra.run.smithi130.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-03T21:50:34.251 INFO:teuthology.orchestra.run.smithi130.stderr:done 2024-05-03T21:50:34.253 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-05-03T21:50:34.268 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.bXmQ0gY1Z6 2024-05-03T21:50:34.269 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bXmQ0gY1Z6 2024-05-03T21:50:34.335 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.bXmQ0gY1Z6 2024-05-03T21:50:34.467 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.bXmQ0gY1Z6 is 6KB 2024-05-03T21:50:34.516 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.bXmQ0gY1Z6 2024-05-03T21:50:34.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo /bin/ls /boot/loader/entries || true 2024-05-03T21:50:34.595 INFO:teuthology.orchestra.run.smithi130.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-03T21:50:34.595 INFO:teuthology.orchestra.run.smithi130.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-03T21:50:34.595 INFO:teuthology.orchestra.run.smithi130.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-03T21:50:34.595 INFO:teuthology.orchestra.run.smithi130.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-03T21:50:34.596 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:34.749 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2024-05-03T21:50:36.669 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-03T21:50:36.669 DEBUG:teuthology.orchestra.run.smithi082:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-03T21:50:36.758 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:36.758 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:36.758 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:36.758 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-03T21:50:36.758 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-03T21:50:36.758 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-03T21:50:36.758 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-03T21:50:36.758 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-03T21:50:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-03T21:50:36.760 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-03T21:50:36.761 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-03T21:50:36.762 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-03T21:50:36.763 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-03T21:50:36.764 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-03T21:50:36.765 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-03T21:50:36.766 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-03T21:50:36.767 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-03T21:50:36.768 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-03T21:50:36.769 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-03T21:50:36.770 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-03T21:50:36.771 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-03T21:50:36.772 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-03T21:50:36.773 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-03T21:50:36.774 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-03T21:50:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-03T21:50:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-03T21:50:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-03T21:50:36.778 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-03T21:50:36.779 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-03T21:50:36.780 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-03T21:50:36.781 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-03T21:50:36.782 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-03T21:50:36.783 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-03T21:50:36.784 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-03T21:50:36.785 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-03T21:50:36.786 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-03T21:50:36.787 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-03T21:50:36.788 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-03T21:50:36.789 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-03T21:50:36.790 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-03T21:50:36.791 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-03T21:50:36.792 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-03T21:50:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-03T21:50:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-03T21:50:36.795 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-03T21:50:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-03T21:50:36.797 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-03T21:50:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-03T21:50:36.799 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-03T21:50:36.800 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-03T21:50:36.801 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-03T21:50:36.802 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-03T21:50:36.803 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-03T21:50:36.804 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-03T21:50:36.804 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-03T21:50:36.804 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-03T21:50:36.804 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-03T21:50:36.804 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-03T21:50:36.804 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-03T21:50:36.804 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-03T21:50:36.804 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-03T21:50:36.804 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-03T21:50:36.804 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-03T21:50:36.804 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-03T21:50:36.805 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-03T21:50:36.806 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-03T21:50:36.807 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-03T21:50:36.808 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-03T21:50:36.809 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-03T21:50:36.810 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-03T21:50:36.811 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-03T21:50:36.812 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-03T21:50:36.813 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-03T21:50:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-03T21:50:36.815 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-03T21:50:36.816 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-03T21:50:36.817 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-03T21:50:36.818 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-03T21:50:36.819 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-03T21:50:36.820 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-03T21:50:36.821 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-03T21:50:36.822 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-03T21:50:36.823 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-03T21:50:36.824 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-03T21:50:36.825 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-03T21:50:36.826 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-03T21:50:36.827 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-03T21:50:36.828 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-03T21:50:36.829 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-03T21:50:36.830 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-03T21:50:36.831 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-03T21:50:36.832 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-03T21:50:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-03T21:50:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-03T21:50:36.835 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-03T21:50:36.836 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-03T21:50:36.837 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-03T21:50:36.838 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-03T21:50:36.839 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-03T21:50:36.840 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-03T21:50:36.841 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-03T21:50:36.842 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-03T21:50:36.843 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-03T21:50:36.844 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-03T21:50:36.845 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-03T21:50:36.846 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-03T21:50:36.847 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-03T21:50:36.848 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-03T21:50:36.849 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-03T21:50:36.850 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-03T21:50:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-03T21:50:36.852 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-03T21:50:36.853 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-03T21:50:36.854 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-03T21:50:36.855 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-03T21:50:36.856 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-03T21:50:36.857 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-03T21:50:36.858 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-03T21:50:36.859 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-03T21:50:36.860 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-03T21:50:36.861 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-03T21:50:36.862 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-03T21:50:36.863 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-03T21:50:36.864 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-03T21:50:36.865 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-03T21:50:36.866 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-03T21:50:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-03T21:50:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-03T21:50:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-03T21:50:36.870 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-03T21:50:36.871 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-03T21:50:36.872 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-03T21:50:36.873 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-03T21:50:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-03T21:50:36.875 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-03T21:50:36.876 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-03T21:50:36.877 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-03T21:50:36.878 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-03T21:50:36.879 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-03T21:50:36.880 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-03T21:50:36.881 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-03T21:50:36.882 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-03T21:50:36.883 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-03T21:50:36.884 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-03T21:50:36.885 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-03T21:50:36.886 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-03T21:50:36.887 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-03T21:50:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-03T21:50:36.889 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-03T21:50:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-03T21:50:36.891 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-03T21:50:36.892 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-03T21:50:36.893 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-03T21:50:36.894 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-03T21:50:36.895 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-03T21:50:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-03T21:50:36.897 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-03T21:50:36.897 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-03T21:50:36.897 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T21:50:36.900 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:36.901 DEBUG:teuthology.orchestra.run.smithi082:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-03T21:50:36.926 INFO:teuthology.orchestra.run.smithi082.stdout:postinstall scriptlet (using /bin/sh): 2024-05-03T21:50:36.926 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T21:50:36.926 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T21:50:36.926 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-03T21:50:36.926 INFO:teuthology.orchestra.run.smithi082.stdout:for file in vmlinuz System.map config; do 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout: fi 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout:done 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-03T21:50:36.927 INFO:teuthology.orchestra.run.smithi082.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-03T21:50:36.928 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T21:50:36.928 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:36.928 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-03T21:50:36.929 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-05-03T21:50:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-05-03T21:50:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-05-03T21:50:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-05-03T21:50:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 68.el9 2024-05-03T21:50:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-05-03T21:50:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-03T21:50:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-05-03T21:50:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8264254 2024-05-03T21:50:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-05-03T21:50:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-03T21:50:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:50:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-05-03T21:50:37.008 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-03T21:50:37.009 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:37.009 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-03T21:50:37.604 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-05-03T21:50:38.991 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-03T21:50:39.024 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-05-03T21:50:39.026 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-05-03T21:50:39.056 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.iegeMPNn2Q 2024-05-03T21:50:39.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iegeMPNn2Q 2024-05-03T21:50:39.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.iegeMPNn2Q 2024-05-03T21:50:39.255 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.iegeMPNn2Q is 6KB 2024-05-03T21:50:39.304 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.iegeMPNn2Q 2024-05-03T21:50:39.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-05-03T21:50:39.379 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-03T21:50:39.380 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-03T21:50:39.380 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-03T21:50:39.380 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-03T21:50:39.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-03T21:50:39.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-05-03T21:50:50.827 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-03T21:50:50.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-05-03T21:50:50.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:51:04.766 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-05-03T21:51:04.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-03T21:51:04.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:51:09.542 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-03T21:51:09.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-03T21:51:09.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:51:50.872 DEBUG:teuthology.orchestra.remote:timed out 2024-05-03T21:51:59.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-05-03T21:51:59.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:52:03.423 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-05-03T21:52:04.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-05-03T21:52:04.124 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-05-03T21:52:04.124 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-05-03T21:52:04.175 INFO:teuthology.orchestra.run.smithi116.stdout:6.9.0-rc3-g806ec36b2112 2024-05-03T21:52:04.175 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-03T21:52:04.175 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-03T21:52:04.175 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-03T21:52:04.769 DEBUG:teuthology.orchestra.remote:timed out 2024-05-03T21:52:05.176 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-03T21:52:05.176 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-03T21:52:05.299 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-05-03T21:52:05.340 DEBUG:teuthology.parallel:result is None 2024-05-03T21:52:09.545 DEBUG:teuthology.orchestra.remote:timed out 2024-05-03T21:52:13.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-03T21:52:13.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:52:18.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-03T21:52:18.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:52:21.423 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-05-03T21:52:22.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-03T21:52:22.035 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.9.0-rc3-g806ec36b2112"... 2024-05-03T21:52:22.036 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-05-03T21:52:22.079 INFO:teuthology.orchestra.run.smithi130.stdout:6.9.0-rc3-g806ec36b2112 2024-05-03T21:52:22.080 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-03T21:52:22.080 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-03T21:52:22.080 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-03T21:52:23.081 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-05-03T21:52:23.082 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-03T21:52:23.198 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2024-05-03T21:52:23.250 DEBUG:teuthology.parallel:result is None 2024-05-03T21:52:26.326 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-05-03T21:52:26.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-03T21:52:26.979 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-05-03T21:52:26.979 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-05-03T21:52:27.017 INFO:teuthology.orchestra.run.smithi082.stdout:6.9.0-rc3-g806ec36b2112 2024-05-03T21:52:27.018 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-03T21:52:27.018 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-03T21:52:27.018 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-03T21:52:28.019 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-03T21:52:28.020 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-03T21:52:28.140 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2024-05-03T21:52:28.197 DEBUG:teuthology.parallel:result is None 2024-05-03T21:52:28.197 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-03T21:52:28.208 INFO:teuthology.task.internal:Creating test directory... 2024-05-03T21:52:28.208 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-03T21:52:28.215 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-03T21:52:28.224 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-03T21:52:28.274 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-03T21:52:28.285 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-03T21:52:28.300 INFO:teuthology.task.internal:Creating archive directory... 2024-05-03T21:52:28.300 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-03T21:52:28.306 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-03T21:52:28.313 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-03T21:52:28.426 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-03T21:52:28.437 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-03T21:52:28.437 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-03T21:52:28.442 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-03T21:52:28.449 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-03T21:52:28.534 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T21:52:28.535 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T21:52:28.536 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T21:52:28.560 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T21:52:28.565 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T21:52:28.566 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T21:52:28.571 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-03T21:52:28.579 INFO:teuthology.task.internal:Configuring sudo... 2024-05-03T21:52:28.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-03T21:52:28.584 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-03T21:52:28.590 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-03T21:52:28.667 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-03T21:52:28.677 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-03T21:52:28.677 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-03T21:52:28.682 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-03T21:52:28.689 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-03T21:52:28.733 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T21:52:28.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T21:52:28.949 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T21:52:29.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T21:52:29.105 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T21:52:29.106 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-03T21:52:29.171 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T21:52:29.259 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T21:52:29.350 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T21:52:29.434 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T21:52:29.520 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-05-03T21:52:29.520 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-03T21:52:29.600 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T21:52:29.667 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T21:52:29.748 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T21:52:29.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T21:52:29.887 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-03T21:52:29.887 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-03T21:52:29.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-05-03T21:52:29.951 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-05-03T21:52:29.958 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-05-03T21:52:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T21:52:30.069 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T21:52:30.073 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T21:52:30.613 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-03T21:52:30.622 INFO:teuthology.task.internal:Starting timer... 2024-05-03T21:52:30.622 INFO:teuthology.run_tasks:Running task pcp... 2024-05-03T21:52:30.652 INFO:teuthology.run_tasks:Running task selinux... 2024-05-03T21:52:30.666 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-03T21:52:30.666 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-05-03T21:52:30.816 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-05-03T21:52:30.819 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-05-03T21:52:30.970 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-05-03T21:52:30.974 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2024-05-03T21:52:31.080 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2024-05-03T21:52:31.084 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-03T21:52:31.084 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-05-03T21:52:31.134 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-05-03T21:52:31.134 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-05-03T21:52:31.194 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-05-03T21:52:31.194 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2024-05-03T21:52:31.254 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2024-05-03T21:52:31.254 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi116.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi130.front.sepia.ceph.com': 'permissive'} 2024-05-03T21:52:31.255 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T21:52:31.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T21:52:31.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T21:52:31.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T21:52:31.399 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T21:52:31.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T21:52:31.481 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-03T21:52:31.481 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-05-03T21:52:31.549 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-05-03T21:52:31.614 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2024-05-03T21:52:31.693 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-03T21:52:31.705 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-03T21:52:31.711 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-03T21:52:31.868 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-03T21:52:31.888 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-03T21:52:31.889 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi116.front.sepia.ceph.com,smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-03T21:58:03.939 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2024-05-03T21:58:03.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-03T21:58:03.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:58:04.051 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-05-03T21:58:04.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-03T21:58:04.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-05-03T21:58:04.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:58:04.310 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-05-03T21:58:04.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-05-03T21:58:04.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-03T21:58:04.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T21:58:04.582 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-05-03T21:58:04.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-05-03T21:58:04.729 INFO:teuthology.run_tasks:Running task clock... 2024-05-03T21:58:04.740 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-03T21:58:04.740 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-03T21:58:04.741 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T21:58:04.748 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-03T21:58:04.748 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T21:58:04.756 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-03T21:58:04.756 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T21:58:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-03T21:58:04.845 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-03T21:58:04.849 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-03T21:58:04.880 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-03T21:58:04.886 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-03T21:58:04.890 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-03T21:58:04.949 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-05-03T21:58:04.954 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-05-03T21:58:04.959 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2024-05-03T21:58:04.980 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-05-03T21:58:04.982 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-05-03T21:58:04.990 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2024-05-03T21:58:05.022 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-03T21:58:05.022 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-03T21:58:05.030 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-03T21:58:05.064 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-03T21:58:05.065 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-03T21:58:05.070 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-03T21:58:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-05-03T21:58:05.197 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-05-03T21:58:05.200 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T21:58:05.200 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-05-03T21:58:05.200 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.200 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.200 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.201 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.203 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-05-03T21:58:05.206 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T21:58:05.206 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-05-03T21:58:05.206 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.207 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.207 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.207 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.211 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T21:58:05.211 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-05-03T21:58:05.212 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.212 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.212 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.212 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T21:58:05.213 INFO:teuthology.run_tasks:Running task install... 2024-05-03T21:58:05.223 DEBUG:teuthology.task.install:project ceph 2024-05-03T21:58:05.223 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea'}} 2024-05-03T21:58:05.223 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea'} 2024-05-03T21:58:05.223 INFO:teuthology.task.install:Using flavor: default 2024-05-03T21:58:05.229 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-03T21:58:05.229 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-03T21:58:05.230 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'tag': None, 'wait_for_package': False} 2024-05-03T21:58:05.230 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T21:58:05.232 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'tag': None, 'wait_for_package': False} 2024-05-03T21:58:05.232 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T21:58:05.233 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'tag': None, 'wait_for_package': False} 2024-05-03T21:58:05.233 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T21:58:05.395 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/ 2024-05-03T21:58:05.395 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3450.g9a047fe7 2024-05-03T21:58:05.456 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/ 2024-05-03T21:58:05.456 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3450.g9a047fe7 2024-05-03T21:58:05.460 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/ 2024-05-03T21:58:05.460 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3450.g9a047fe7 2024-05-03T21:58:05.509 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-03T21:58:05.509 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-03T21:58:05.509 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-03T21:58:05.600 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-03T21:58:05.600 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9a047fe7599a549042d06a3fb5b6813a203eabea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-03T21:58:05.629 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-03T21:58:05.629 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-05-03T21:58:05.629 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-03T21:58:05.721 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-03T21:58:05.721 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9a047fe7599a549042d06a3fb5b6813a203eabea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-03T21:58:05.728 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-03T21:58:05.841 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-03T21:58:05.847 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-03T21:58:05.912 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2024-05-03T21:58:05.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2024-05-03T21:58:05.960 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-03T21:58:06.038 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-05-03T21:58:06.041 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-05-03T21:58:06.235 INFO:teuthology.orchestra.run.smithi130.stdout:50 files removed 2024-05-03T21:58:06.273 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-03T21:58:06.365 INFO:teuthology.orchestra.run.smithi116.stdout:50 files removed 2024-05-03T21:58:06.404 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-03T21:58:06.660 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-03T21:58:06.661 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T21:58:06.661 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-03T21:58:06.750 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-03T21:58:06.751 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9a047fe7599a549042d06a3fb5b6813a203eabea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-03T21:58:06.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-03T21:58:06.986 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-03T21:58:07.062 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-05-03T21:58:07.066 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-05-03T21:58:07.092 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 220 kB/s | 84 kB 00:00 2024-05-03T21:58:07.371 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 156 kB/s | 84 kB 00:00 2024-05-03T21:58:07.397 INFO:teuthology.orchestra.run.smithi082.stdout:50 files removed 2024-05-03T21:58:07.436 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-03T21:58:07.576 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-05-03T21:58:07.930 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 26 kB/s | 12 kB 00:00 2024-05-03T21:58:08.102 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-05-03T21:58:08.271 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 208 kB/s | 84 kB 00:00 2024-05-03T21:58:08.431 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-05-03T21:58:09.022 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 18 kB/s | 12 kB 00:00 2024-05-03T21:58:09.548 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-05-03T21:58:10.137 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.0 MB 00:01 2024-05-03T21:58:10.325 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.0 MB 00:02 2024-05-03T21:58:10.837 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.0 MB 00:01 2024-05-03T21:58:12.363 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-05-03T21:58:12.780 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-05-03T21:58:13.651 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 19 MB 00:02 2024-05-03T21:58:16.839 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.2 MB 00:00 2024-05-03T21:58:17.131 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.2 MB 00:00 2024-05-03T21:58:17.961 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-05-03T21:58:18.465 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 16 kB 00:00 2024-05-03T21:58:18.690 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 16 kB 00:00 2024-05-03T21:58:19.863 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-05-03T21:58:20.258 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-03T21:58:20.388 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-05-03T21:58:21.930 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-03T21:58:26.158 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-05-03T21:58:26.350 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-03T21:58:27.813 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-03T21:58:28.558 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T21:58:28.560 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T21:58:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-03T21:58:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-03T21:58:28.582 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-03T21:58:28.584 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-03T21:58:28.586 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-03T21:58:28.589 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-03T21:58:28.590 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-03T21:58:28.660 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-05-03T21:58:28.685 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-05-03T21:58:28.685 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-05-03T21:58:28.685 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-05-03T21:58:28.685 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-05-03T21:58:28.685 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 6.6 k 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 891 k 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 145 k 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 1.5 M 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 142 k 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 3.5 M 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 7.4 M 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 49 k 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 11 M 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 49 M 2024-05-03T21:58:28.686 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 273 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 763 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 225 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 27 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 18 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 32 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 747 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 127 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-03T21:58:28.687 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-03T21:58:28.688 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-03T21:58:28.688 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-03T21:58:28.688 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-03T21:58:28.688 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-03T21:58:28.688 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 161 k 2024-05-03T21:58:28.688 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 320 k 2024-05-03T21:58:28.688 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 298 k 2024-05-03T21:58:28.688 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 100 k 2024-05-03T21:58:28.688 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 85 k 2024-05-03T21:58:28.688 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T21:58:28.688 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 170 k 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.4 M 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 21 M 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 34 k 2024-05-03T21:58:28.689 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 2.4 M 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 274 k 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 4.7 M 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 17 M 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 16 k 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 25 k 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-03T21:58:28.690 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 163 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 500 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-03T21:58:28.691 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-03T21:58:28.692 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 45 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 135 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-03T21:58:28.693 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-03T21:58:28.694 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-03T21:58:28.695 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-03T21:58:28.696 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-03T21:58:28.697 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:58:28.698 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-05-03T21:58:28.698 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-05-03T21:58:28.698 INFO:teuthology.orchestra.run.smithi082.stdout:Install 148 Packages 2024-05-03T21:58:28.698 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 4 Packages 2024-05-03T21:58:28.698 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:58:28.698 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 222 M 2024-05-03T21:58:28.698 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-05-03T21:58:28.711 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T21:58:28.712 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T21:58:28.731 INFO:teuthology.orchestra.run.smithi116.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-03T21:58:28.732 INFO:teuthology.orchestra.run.smithi116.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-03T21:58:28.733 INFO:teuthology.orchestra.run.smithi116.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-03T21:58:28.734 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-03T21:58:28.737 INFO:teuthology.orchestra.run.smithi116.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-03T21:58:28.740 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-03T21:58:28.741 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-03T21:58:28.812 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-05-03T21:58:28.832 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-05-03T21:58:28.832 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-05-03T21:58:28.832 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-05-03T21:58:28.832 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-05-03T21:58:28.832 INFO:teuthology.orchestra.run.smithi116.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-03T21:58:28.832 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 6.6 k 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 891 k 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 145 k 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 1.5 M 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 142 k 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 3.5 M 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 7.4 M 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 49 k 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 11 M 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 49 M 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 273 k 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 763 k 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 225 k 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-shell x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 27 k 2024-05-03T21:58:28.833 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 18 k 2024-05-03T21:58:28.834 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-03T21:58:28.834 INFO:teuthology.orchestra.run.smithi116.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-03T21:58:28.834 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-03T21:58:28.834 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 32 k 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 747 k 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 127 k 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 161 k 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 320 k 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 298 k 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 100 k 2024-05-03T21:58:28.835 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 85 k 2024-05-03T21:58:28.836 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T21:58:28.836 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 170 k 2024-05-03T21:58:28.836 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-03T21:58:28.836 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-05-03T21:58:28.836 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.4 M 2024-05-03T21:58:28.836 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T21:58:28.836 INFO:teuthology.orchestra.run.smithi116.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-03T21:58:28.836 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-03T21:58:28.836 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-05-03T21:58:28.838 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-03T21:58:28.838 INFO:teuthology.orchestra.run.smithi116.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-03T21:58:28.838 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-03T21:58:28.838 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 21 M 2024-05-03T21:58:28.838 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 34 k 2024-05-03T21:58:28.838 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 2.4 M 2024-05-03T21:58:28.838 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 274 k 2024-05-03T21:58:28.838 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 4.7 M 2024-05-03T21:58:28.838 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 17 M 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 16 k 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 25 k 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 163 k 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-03T21:58:28.839 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 500 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-03T21:58:28.840 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 45 k 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 135 k 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-03T21:58:28.841 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-03T21:58:28.842 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-03T21:58:28.843 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-03T21:58:28.844 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-03T21:58:28.845 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout:Install 148 Packages 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 4 Packages 2024-05-03T21:58:28.846 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:58:28.847 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 222 M 2024-05-03T21:58:28.847 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-05-03T21:58:29.468 INFO:teuthology.orchestra.run.smithi116.stdout:(1/152): ceph-19.0.0-3450.g9a047fe7.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-05-03T21:58:29.752 INFO:teuthology.orchestra.run.smithi116.stdout:(2/152): ceph-fuse-19.0.0-3450.g9a047fe7.el9.x8 3.1 MB/s | 891 kB 00:00 2024-05-03T21:58:29.835 INFO:teuthology.orchestra.run.smithi116.stdout:(3/152): ceph-immutable-object-cache-19.0.0-345 1.7 MB/s | 145 kB 00:00 2024-05-03T21:58:29.951 INFO:teuthology.orchestra.run.smithi082.stdout:(1/152): ceph-19.0.0-3450.g9a047fe7.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-05-03T21:58:29.969 INFO:teuthology.orchestra.run.smithi116.stdout:(4/152): ceph-base-19.0.0-3450.g9a047fe7.el9.x8 7.0 MB/s | 5.4 MB 00:00 2024-05-03T21:58:30.153 INFO:teuthology.orchestra.run.smithi116.stdout:(5/152): ceph-mgr-19.0.0-3450.g9a047fe7.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-05-03T21:58:30.188 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T21:58:30.190 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T21:58:30.209 INFO:teuthology.orchestra.run.smithi130.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-03T21:58:30.210 INFO:teuthology.orchestra.run.smithi130.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-03T21:58:30.212 INFO:teuthology.orchestra.run.smithi130.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-03T21:58:30.213 INFO:teuthology.orchestra.run.smithi130.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-03T21:58:30.215 INFO:teuthology.orchestra.run.smithi130.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-03T21:58:30.219 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-03T21:58:30.220 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-03T21:58:30.289 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 6.6 k 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 891 k 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 145 k 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 1.5 M 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 142 k 2024-05-03T21:58:30.313 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 3.5 M 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 7.4 M 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 49 k 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 11 M 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 49 M 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 273 k 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 763 k 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 225 k 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 27 k 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 18 k 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 32 k 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 747 k 2024-05-03T21:58:30.314 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 127 k 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 161 k 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 320 k 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 298 k 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 100 k 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 85 k 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 170 k 2024-05-03T21:58:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.4 M 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 21 M 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 34 k 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 2.4 M 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 274 k 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 4.7 M 2024-05-03T21:58:30.316 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 17 M 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 16 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 25 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 163 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-03T21:58:30.317 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 500 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-03T21:58:30.318 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 45 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 135 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-03T21:58:30.319 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-03T21:58:30.320 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-03T21:58:30.321 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-03T21:58:30.322 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout:Installing weak dependencies: 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-05-03T21:58:30.323 INFO:teuthology.orchestra.run.smithi130.stdout:Install 148 Packages 2024-05-03T21:58:30.324 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 4 Packages 2024-05-03T21:58:30.324 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:58:30.324 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 222 M 2024-05-03T21:58:30.324 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-05-03T21:58:30.411 INFO:teuthology.orchestra.run.smithi116.stdout:(6/152): ceph-mds-19.0.0-3450.g9a047fe7.el9.x86 4.1 MB/s | 2.4 MB 00:00 2024-05-03T21:58:30.667 INFO:teuthology.orchestra.run.smithi082.stdout:(2/152): ceph-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.2 MB/s | 891 kB 00:00 2024-05-03T21:58:30.678 INFO:teuthology.orchestra.run.smithi116.stdout:(7/152): ceph-mon-19.0.0-3450.g9a047fe7.el9.x86 9.0 MB/s | 4.7 MB 00:00 2024-05-03T21:58:30.793 INFO:teuthology.orchestra.run.smithi082.stdout:(3/152): ceph-immutable-object-cache-19.0.0-345 1.1 MB/s | 145 kB 00:00 2024-05-03T21:58:31.457 INFO:teuthology.orchestra.run.smithi130.stdout:(1/152): ceph-19.0.0-3450.g9a047fe7.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-03T21:58:31.534 INFO:teuthology.orchestra.run.smithi082.stdout:(4/152): ceph-mds-19.0.0-3450.g9a047fe7.el9.x86 3.2 MB/s | 2.4 MB 00:00 2024-05-03T21:58:31.562 INFO:teuthology.orchestra.run.smithi116.stdout:(8/152): ceph-common-19.0.0-3450.g9a047fe7.el9. 9.0 MB/s | 21 MB 00:02 2024-05-03T21:58:31.645 INFO:teuthology.orchestra.run.smithi116.stdout:(9/152): ceph-selinux-19.0.0-3450.g9a047fe7.el9 305 kB/s | 25 kB 00:00 2024-05-03T21:58:31.699 INFO:teuthology.orchestra.run.smithi130.stdout:(2/152): ceph-fuse-19.0.0-3450.g9a047fe7.el9.x8 3.6 MB/s | 891 kB 00:00 2024-05-03T21:58:31.807 INFO:teuthology.orchestra.run.smithi130.stdout:(3/152): ceph-immutable-object-cache-19.0.0-345 1.3 MB/s | 145 kB 00:00 2024-05-03T21:58:31.935 INFO:teuthology.orchestra.run.smithi082.stdout:(5/152): ceph-mgr-19.0.0-3450.g9a047fe7.el9.x86 3.8 MB/s | 1.5 MB 00:00 2024-05-03T21:58:32.354 INFO:teuthology.orchestra.run.smithi116.stdout:(10/152): ceph-radosgw-19.0.0-3450.g9a047fe7.el 6.3 MB/s | 11 MB 00:01 2024-05-03T21:58:32.462 INFO:teuthology.orchestra.run.smithi116.stdout:(11/152): cephfs-mirror-19.0.0-3450.g9a047fe7.e 2.0 MB/s | 225 kB 00:00 2024-05-03T21:58:32.563 INFO:teuthology.orchestra.run.smithi116.stdout:(12/152): cephfs-shell-19.0.0-3450.g9a047fe7.el 273 kB/s | 27 kB 00:00 2024-05-03T21:58:32.582 INFO:teuthology.orchestra.run.smithi130.stdout:(4/152): ceph-mds-19.0.0-3450.g9a047fe7.el9.x86 3.1 MB/s | 2.4 MB 00:00 2024-05-03T21:58:32.647 INFO:teuthology.orchestra.run.smithi116.stdout:(13/152): libcephfs-devel-19.0.0-3450.g9a047fe7 385 kB/s | 32 kB 00:00 2024-05-03T21:58:32.897 INFO:teuthology.orchestra.run.smithi116.stdout:(14/152): libcephfs2-19.0.0-3450.g9a047fe7.el9. 2.9 MB/s | 747 kB 00:00 2024-05-03T21:58:32.980 INFO:teuthology.orchestra.run.smithi116.stdout:(15/152): libcephsqlite-19.0.0-3450.g9a047fe7.e 1.9 MB/s | 163 kB 00:00 2024-05-03T21:58:33.008 INFO:teuthology.orchestra.run.smithi130.stdout:(5/152): ceph-mgr-19.0.0-3450.g9a047fe7.el9.x86 3.6 MB/s | 1.5 MB 00:00 2024-05-03T21:58:33.038 INFO:teuthology.orchestra.run.smithi116.stdout:(16/152): librados-devel-19.0.0-3450.g9a047fe7. 2.2 MB/s | 127 kB 00:00 2024-05-03T21:58:33.076 INFO:teuthology.orchestra.run.smithi082.stdout:(6/152): ceph-mon-19.0.0-3450.g9a047fe7.el9.x86 4.1 MB/s | 4.7 MB 00:01 2024-05-03T21:58:33.197 INFO:teuthology.orchestra.run.smithi116.stdout:(17/152): libradosstriper1-19.0.0-3450.g9a047fe 3.1 MB/s | 500 kB 00:00 2024-05-03T21:58:33.941 INFO:teuthology.orchestra.run.smithi130.stdout:(6/152): ceph-base-19.0.0-3450.g9a047fe7.el9.x8 1.9 MB/s | 5.4 MB 00:02 2024-05-03T21:58:34.742 INFO:teuthology.orchestra.run.smithi130.stdout:(7/152): ceph-mon-19.0.0-3450.g9a047fe7.el9.x86 2.7 MB/s | 4.7 MB 00:01 2024-05-03T21:58:34.773 INFO:teuthology.orchestra.run.smithi116.stdout:(18/152): ceph-osd-19.0.0-3450.g9a047fe7.el9.x8 3.9 MB/s | 17 MB 00:04 2024-05-03T21:58:34.864 INFO:teuthology.orchestra.run.smithi116.stdout:(19/152): python3-ceph-argparse-19.0.0-3450.g9a 501 kB/s | 45 kB 00:00 2024-05-03T21:58:35.040 INFO:teuthology.orchestra.run.smithi116.stdout:(20/152): python3-ceph-common-19.0.0-3450.g9a04 780 kB/s | 135 kB 00:00 2024-05-03T21:58:35.148 INFO:teuthology.orchestra.run.smithi116.stdout:(21/152): python3-cephfs-19.0.0-3450.g9a047fe7. 1.5 MB/s | 161 kB 00:00 2024-05-03T21:58:35.615 INFO:teuthology.orchestra.run.smithi116.stdout:(22/152): librgw2-19.0.0-3450.g9a047fe7.el9.x86 2.2 MB/s | 5.4 MB 00:02 2024-05-03T21:58:35.649 INFO:teuthology.orchestra.run.smithi116.stdout:(23/152): python3-rados-19.0.0-3450.g9a047fe7.e 641 kB/s | 320 kB 00:00 2024-05-03T21:58:35.732 INFO:teuthology.orchestra.run.smithi116.stdout:(24/152): python3-rgw-19.0.0-3450.g9a047fe7.el9 1.2 MB/s | 100 kB 00:00 2024-05-03T21:58:35.766 INFO:teuthology.orchestra.run.smithi116.stdout:(25/152): python3-rbd-19.0.0-3450.g9a047fe7.el9 1.9 MB/s | 298 kB 00:00 2024-05-03T21:58:35.800 INFO:teuthology.orchestra.run.smithi116.stdout:(26/152): rbd-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.3 MB/s | 85 kB 00:00 2024-05-03T21:58:35.875 INFO:teuthology.orchestra.run.smithi116.stdout:(27/152): rbd-nbd-19.0.0-3450.g9a047fe7.el9.x86 2.3 MB/s | 170 kB 00:00 2024-05-03T21:58:35.942 INFO:teuthology.orchestra.run.smithi116.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3450.g 522 kB/s | 34 kB 00:00 2024-05-03T21:58:35.960 INFO:teuthology.orchestra.run.smithi082.stdout:(7/152): ceph-osd-19.0.0-3450.g9a047fe7.el9.x86 5.8 MB/s | 17 MB 00:02 2024-05-03T21:58:36.017 INFO:teuthology.orchestra.run.smithi116.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3450.g9a047fe 1.9 MB/s | 142 kB 00:00 2024-05-03T21:58:36.733 INFO:teuthology.orchestra.run.smithi130.stdout:(8/152): ceph-common-19.0.0-3450.g9a047fe7.el9. 3.8 MB/s | 21 MB 00:05 2024-05-03T21:58:36.901 INFO:teuthology.orchestra.run.smithi116.stdout:(30/152): rbd-mirror-19.0.0-3450.g9a047fe7.el9. 2.7 MB/s | 3.1 MB 00:01 2024-05-03T21:58:37.024 INFO:teuthology.orchestra.run.smithi082.stdout:(8/152): ceph-base-19.0.0-3450.g9a047fe7.el9.x8 748 kB/s | 5.4 MB 00:07 2024-05-03T21:58:37.092 INFO:teuthology.orchestra.run.smithi130.stdout:(9/152): ceph-selinux-19.0.0-3450.g9a047fe7.el9 70 kB/s | 25 kB 00:00 2024-05-03T21:58:37.126 INFO:teuthology.orchestra.run.smithi082.stdout:(9/152): ceph-selinux-19.0.0-3450.g9a047fe7.el9 248 kB/s | 25 kB 00:00 2024-05-03T21:58:37.159 INFO:teuthology.orchestra.run.smithi116.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3450.g9a047 3.1 MB/s | 3.5 MB 00:01 2024-05-03T21:58:37.335 INFO:teuthology.orchestra.run.smithi116.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3450.g9a 1.5 MB/s | 274 kB 00:00 2024-05-03T21:58:37.410 INFO:teuthology.orchestra.run.smithi116.stdout:(33/152): ceph-mgr-rook-19.0.0-3450.g9a047fe7.e 667 kB/s | 49 kB 00:00 2024-05-03T21:58:37.485 INFO:teuthology.orchestra.run.smithi116.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3450.g9 222 kB/s | 16 kB 00:00 2024-05-03T21:58:37.636 INFO:teuthology.orchestra.run.smithi116.stdout:(35/152): ceph-volume-19.0.0-3450.g9a047fe7.el9 1.8 MB/s | 273 kB 00:00 2024-05-03T21:58:37.760 INFO:teuthology.orchestra.run.smithi082.stdout:(10/152): ceph-radosgw-19.0.0-3450.g9a047fe7.el 5.9 MB/s | 11 MB 00:01 2024-05-03T21:58:37.844 INFO:teuthology.orchestra.run.smithi082.stdout:(11/152): cephfs-mirror-19.0.0-3450.g9a047fe7.e 2.7 MB/s | 225 kB 00:00 2024-05-03T21:58:37.861 INFO:teuthology.orchestra.run.smithi116.stdout:(36/152): cephadm-19.0.0-3450.g9a047fe7.el9.noa 3.3 MB/s | 763 kB 00:00 2024-05-03T21:58:37.867 INFO:teuthology.orchestra.run.smithi130.stdout:(10/152): ceph-radosgw-19.0.0-3450.g9a047fe7.el 3.4 MB/s | 11 MB 00:03 2024-05-03T21:58:37.885 INFO:teuthology.orchestra.run.smithi082.stdout:(12/152): cephfs-shell-19.0.0-3450.g9a047fe7.el 663 kB/s | 27 kB 00:00 2024-05-03T21:58:37.911 INFO:teuthology.orchestra.run.smithi116.stdout:(37/152): cephfs-top-19.0.0-3450.g9a047fe7.el9. 370 kB/s | 18 kB 00:00 2024-05-03T21:58:37.967 INFO:teuthology.orchestra.run.smithi130.stdout:(11/152): cephfs-mirror-19.0.0-3450.g9a047fe7.e 2.2 MB/s | 225 kB 00:00 2024-05-03T21:58:37.977 INFO:teuthology.orchestra.run.smithi082.stdout:(13/152): libcephfs-devel-19.0.0-3450.g9a047fe7 348 kB/s | 32 kB 00:00 2024-05-03T21:58:38.034 INFO:teuthology.orchestra.run.smithi130.stdout:(12/152): cephfs-shell-19.0.0-3450.g9a047fe7.el 410 kB/s | 27 kB 00:00 2024-05-03T21:58:38.118 INFO:teuthology.orchestra.run.smithi130.stdout:(13/152): libcephfs-devel-19.0.0-3450.g9a047fe7 385 kB/s | 32 kB 00:00 2024-05-03T21:58:38.127 INFO:teuthology.orchestra.run.smithi082.stdout:(14/152): libcephfs2-19.0.0-3450.g9a047fe7.el9. 4.9 MB/s | 747 kB 00:00 2024-05-03T21:58:38.211 INFO:teuthology.orchestra.run.smithi082.stdout:(15/152): libcephsqlite-19.0.0-3450.g9a047fe7.e 1.9 MB/s | 163 kB 00:00 2024-05-03T21:58:38.295 INFO:teuthology.orchestra.run.smithi082.stdout:(16/152): librados-devel-19.0.0-3450.g9a047fe7. 1.5 MB/s | 127 kB 00:00 2024-05-03T21:58:38.337 INFO:teuthology.orchestra.run.smithi116.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 189 kB/s | 80 kB 00:00 2024-05-03T21:58:38.343 INFO:teuthology.orchestra.run.smithi130.stdout:(14/152): libcephfs2-19.0.0-3450.g9a047fe7.el9. 3.3 MB/s | 747 kB 00:00 2024-05-03T21:58:38.427 INFO:teuthology.orchestra.run.smithi130.stdout:(15/152): libcephsqlite-19.0.0-3450.g9a047fe7.e 1.9 MB/s | 163 kB 00:00 2024-05-03T21:58:38.429 INFO:teuthology.orchestra.run.smithi082.stdout:(17/152): libradosstriper1-19.0.0-3450.g9a047fe 3.7 MB/s | 500 kB 00:00 2024-05-03T21:58:38.494 INFO:teuthology.orchestra.run.smithi130.stdout:(16/152): librados-devel-19.0.0-3450.g9a047fe7. 1.9 MB/s | 127 kB 00:00 2024-05-03T21:58:38.719 INFO:teuthology.orchestra.run.smithi130.stdout:(17/152): libradosstriper1-19.0.0-3450.g9a047fe 2.2 MB/s | 500 kB 00:00 2024-05-03T21:58:38.870 INFO:teuthology.orchestra.run.smithi116.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 803 kB 00:00 2024-05-03T21:58:38.995 INFO:teuthology.orchestra.run.smithi116.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-05-03T21:58:39.188 INFO:teuthology.orchestra.run.smithi116.stdout:(41/152): ceph-mgr-diskprediction-local-19.0.0- 3.2 MB/s | 7.4 MB 00:02 2024-05-03T21:58:39.238 INFO:teuthology.orchestra.run.smithi116.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-05-03T21:58:39.329 INFO:teuthology.orchestra.run.smithi082.stdout:(18/152): librgw2-19.0.0-3450.g9a047fe7.el9.x86 6.0 MB/s | 5.4 MB 00:00 2024-05-03T21:58:39.354 INFO:teuthology.orchestra.run.smithi116.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 922 kB/s | 106 kB 00:00 2024-05-03T21:58:39.396 INFO:teuthology.orchestra.run.smithi082.stdout:(19/152): python3-ceph-argparse-19.0.0-3450.g9a 688 kB/s | 45 kB 00:00 2024-05-03T21:58:39.463 INFO:teuthology.orchestra.run.smithi116.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-05-03T21:58:39.471 INFO:teuthology.orchestra.run.smithi082.stdout:(20/152): python3-ceph-common-19.0.0-3450.g9a04 1.8 MB/s | 135 kB 00:00 2024-05-03T21:58:39.538 INFO:teuthology.orchestra.run.smithi082.stdout:(21/152): python3-cephfs-19.0.0-3450.g9a047fe7. 2.4 MB/s | 161 kB 00:00 2024-05-03T21:58:39.605 INFO:teuthology.orchestra.run.smithi082.stdout:(22/152): python3-rados-19.0.0-3450.g9a047fe7.e 4.8 MB/s | 320 kB 00:00 2024-05-03T21:58:39.672 INFO:teuthology.orchestra.run.smithi082.stdout:(23/152): python3-rbd-19.0.0-3450.g9a047fe7.el9 4.4 MB/s | 298 kB 00:00 2024-05-03T21:58:39.722 INFO:teuthology.orchestra.run.smithi082.stdout:(24/152): python3-rgw-19.0.0-3450.g9a047fe7.el9 2.0 MB/s | 100 kB 00:00 2024-05-03T21:58:39.764 INFO:teuthology.orchestra.run.smithi082.stdout:(25/152): rbd-fuse-19.0.0-3450.g9a047fe7.el9.x8 2.0 MB/s | 85 kB 00:00 2024-05-03T21:58:39.903 INFO:teuthology.orchestra.run.smithi130.stdout:(18/152): ceph-osd-19.0.0-3450.g9a047fe7.el9.x8 2.8 MB/s | 17 MB 00:05 2024-05-03T21:58:39.964 INFO:teuthology.orchestra.run.smithi116.stdout:(45/152): ceph-test-19.0.0-3450.g9a047fe7.el9.x 5.9 MB/s | 49 MB 00:08 2024-05-03T21:58:39.997 INFO:teuthology.orchestra.run.smithi116.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 234 kB/s | 125 kB 00:00 2024-05-03T21:58:40.020 INFO:teuthology.orchestra.run.smithi130.stdout:(19/152): librgw2-19.0.0-3450.g9a047fe7.el9.x86 4.1 MB/s | 5.4 MB 00:01 2024-05-03T21:58:40.040 INFO:teuthology.orchestra.run.smithi082.stdout:(26/152): rbd-mirror-19.0.0-3450.g9a047fe7.el9. 11 MB/s | 3.1 MB 00:00 2024-05-03T21:58:40.061 INFO:teuthology.orchestra.run.smithi130.stdout:(20/152): python3-ceph-argparse-19.0.0-3450.g9a 286 kB/s | 45 kB 00:00 2024-05-03T21:58:40.087 INFO:teuthology.orchestra.run.smithi130.stdout:(21/152): python3-ceph-common-19.0.0-3450.g9a04 2.0 MB/s | 135 kB 00:00 2024-05-03T21:58:40.090 INFO:teuthology.orchestra.run.smithi082.stdout:(27/152): rbd-nbd-19.0.0-3450.g9a047fe7.el9.x86 3.4 MB/s | 170 kB 00:00 2024-05-03T21:58:40.157 INFO:teuthology.orchestra.run.smithi082.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3450.g 517 kB/s | 34 kB 00:00 2024-05-03T21:58:40.170 INFO:teuthology.orchestra.run.smithi130.stdout:(22/152): python3-rados-19.0.0-3450.g9a047fe7.e 3.8 MB/s | 320 kB 00:00 2024-05-03T21:58:40.204 INFO:teuthology.orchestra.run.smithi130.stdout:(23/152): python3-cephfs-19.0.0-3450.g9a047fe7. 1.1 MB/s | 161 kB 00:00 2024-05-03T21:58:40.207 INFO:teuthology.orchestra.run.smithi082.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3450.g9a047fe 2.8 MB/s | 142 kB 00:00 2024-05-03T21:58:40.247 INFO:teuthology.orchestra.run.smithi116.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-05-03T21:58:40.254 INFO:teuthology.orchestra.run.smithi130.stdout:(24/152): python3-rbd-19.0.0-3450.g9a047fe7.el9 3.5 MB/s | 298 kB 00:00 2024-05-03T21:58:40.288 INFO:teuthology.orchestra.run.smithi130.stdout:(25/152): python3-rgw-19.0.0-3450.g9a047fe7.el9 1.2 MB/s | 100 kB 00:00 2024-05-03T21:58:40.322 INFO:teuthology.orchestra.run.smithi130.stdout:(26/152): rbd-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.3 MB/s | 85 kB 00:00 2024-05-03T21:58:40.348 INFO:teuthology.orchestra.run.smithi116.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 9.3 MB/s | 943 kB 00:00 2024-05-03T21:58:40.389 INFO:teuthology.orchestra.run.smithi130.stdout:(27/152): rbd-nbd-19.0.0-3450.g9a047fe7.el9.x86 2.5 MB/s | 170 kB 00:00 2024-05-03T21:58:40.389 INFO:teuthology.orchestra.run.smithi116.stdout:(49/152): python3-cryptography-36.0.1-4.el9.x86 1.0 MB/s | 1.2 MB 00:01 2024-05-03T21:58:40.456 INFO:teuthology.orchestra.run.smithi130.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3450.g 519 kB/s | 34 kB 00:00 2024-05-03T21:58:40.456 INFO:teuthology.orchestra.run.smithi116.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 991 kB/s | 107 kB 00:00 2024-05-03T21:58:40.482 INFO:teuthology.orchestra.run.smithi116.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 236 kB/s | 21 kB 00:00 2024-05-03T21:58:40.507 INFO:teuthology.orchestra.run.smithi116.stdout:(52/152): python3-urllib3-1.26.5-5.el9.noarch.r 396 kB/s | 215 kB 00:00 2024-05-03T21:58:40.523 INFO:teuthology.orchestra.run.smithi130.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3450.g9a047fe 2.1 MB/s | 142 kB 00:00 2024-05-03T21:58:40.691 INFO:teuthology.orchestra.run.smithi116.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 1.3 MB/s | 313 kB 00:00 2024-05-03T21:58:40.708 INFO:teuthology.orchestra.run.smithi082.stdout:(30/152): ceph-common-19.0.0-3450.g9a047fe7.el9 1.9 MB/s | 21 MB 00:11 2024-05-03T21:58:40.716 INFO:teuthology.orchestra.run.smithi116.stdout:(54/152): flexiblas-3.0.4-8.el9.x86_64.rpm 140 kB/s | 33 kB 00:00 2024-05-03T21:58:40.749 INFO:teuthology.orchestra.run.smithi116.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 316 kB/s | 18 kB 00:00 2024-05-03T21:58:40.775 INFO:teuthology.orchestra.run.smithi116.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 192 kB/s | 11 kB 00:00 2024-05-03T21:58:40.800 INFO:teuthology.orchestra.run.smithi116.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 160 kB 00:00 2024-05-03T21:58:40.816 INFO:teuthology.orchestra.run.smithi082.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3450.g9a047 5.8 MB/s | 3.5 MB 00:00 2024-05-03T21:58:40.825 INFO:teuthology.orchestra.run.smithi116.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 916 kB/s | 45 kB 00:00 2024-05-03T21:58:40.916 INFO:teuthology.orchestra.run.smithi082.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3450.g9a 2.7 MB/s | 274 kB 00:00 2024-05-03T21:58:40.917 INFO:teuthology.orchestra.run.smithi116.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.3 MB/s | 3.0 MB 00:00 2024-05-03T21:58:40.951 INFO:teuthology.orchestra.run.smithi116.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-05-03T21:58:40.983 INFO:teuthology.orchestra.run.smithi082.stdout:(33/152): ceph-mgr-rook-19.0.0-3450.g9a047fe7.e 748 kB/s | 49 kB 00:00 2024-05-03T21:58:40.990 INFO:teuthology.orchestra.run.smithi130.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3450.g9a047 7.6 MB/s | 3.5 MB 00:00 2024-05-03T21:58:41.018 INFO:teuthology.orchestra.run.smithi116.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 3.0 MB/s | 582 kB 00:00 2024-05-03T21:58:41.034 INFO:teuthology.orchestra.run.smithi082.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3450.g9 334 kB/s | 16 kB 00:00 2024-05-03T21:58:41.043 INFO:teuthology.orchestra.run.smithi116.stdout:(62/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 204 kB/s | 25 kB 00:00 2024-05-03T21:58:41.068 INFO:teuthology.orchestra.run.smithi116.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 407 kB/s | 47 kB 00:00 2024-05-03T21:58:41.073 INFO:teuthology.orchestra.run.smithi130.stdout:(31/152): rbd-mirror-19.0.0-3450.g9a047fe7.el9. 3.9 MB/s | 3.1 MB 00:00 2024-05-03T21:58:41.109 INFO:teuthology.orchestra.run.smithi082.stdout:(35/152): ceph-volume-19.0.0-3450.g9a047fe7.el9 3.6 MB/s | 273 kB 00:00 2024-05-03T21:58:41.110 INFO:teuthology.orchestra.run.smithi116.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-03T21:58:41.153 INFO:teuthology.orchestra.run.smithi116.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 423 kB/s | 35 kB 00:00 2024-05-03T21:58:41.182 INFO:teuthology.orchestra.run.smithi130.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3450.g9a 2.5 MB/s | 274 kB 00:00 2024-05-03T21:58:41.186 INFO:teuthology.orchestra.run.smithi116.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-05-03T21:58:41.226 INFO:teuthology.orchestra.run.smithi082.stdout:(36/152): cephadm-19.0.0-3450.g9a047fe7.el9.noa 6.4 MB/s | 763 kB 00:00 2024-05-03T21:58:41.257 INFO:teuthology.orchestra.run.smithi130.stdout:(33/152): ceph-mgr-rook-19.0.0-3450.g9a047fe7.e 666 kB/s | 49 kB 00:00 2024-05-03T21:58:41.276 INFO:teuthology.orchestra.run.smithi082.stdout:(37/152): cephfs-top-19.0.0-3450.g9a047fe7.el9. 371 kB/s | 18 kB 00:00 2024-05-03T21:58:41.328 INFO:teuthology.orchestra.run.smithi116.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-05-03T21:58:41.332 INFO:teuthology.orchestra.run.smithi130.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3450.g9 222 kB/s | 16 kB 00:00 2024-05-03T21:58:41.387 INFO:teuthology.orchestra.run.smithi116.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 8.0 MB/s | 1.6 MB 00:00 2024-05-03T21:58:41.418 INFO:teuthology.orchestra.run.smithi082.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 571 kB/s | 80 kB 00:00 2024-05-03T21:58:41.450 INFO:teuthology.orchestra.run.smithi130.stdout:(35/152): ceph-volume-19.0.0-3450.g9a047fe7.el9 2.3 MB/s | 273 kB 00:00 2024-05-03T21:58:41.479 INFO:teuthology.orchestra.run.smithi116.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 6.0 MB/s | 911 kB 00:00 2024-05-03T21:58:41.544 INFO:teuthology.orchestra.run.smithi082.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-05-03T21:58:41.571 INFO:teuthology.orchestra.run.smithi116.stdout:(70/152): openblas-openmp-0.3.21-2.el9.x86_64.r 10 MB/s | 4.7 MB 00:00 2024-05-03T21:58:41.594 INFO:teuthology.orchestra.run.smithi082.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2024-05-03T21:58:41.596 INFO:teuthology.orchestra.run.smithi116.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 640 kB/s | 133 kB 00:00 2024-05-03T21:58:41.663 INFO:teuthology.orchestra.run.smithi116.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-05-03T21:58:41.667 INFO:teuthology.orchestra.run.smithi130.stdout:(36/152): cephadm-19.0.0-3450.g9a047fe7.el9.noa 3.4 MB/s | 763 kB 00:00 2024-05-03T21:58:41.677 INFO:teuthology.orchestra.run.smithi082.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-05-03T21:58:41.688 INFO:teuthology.orchestra.run.smithi116.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 960 kB/s | 87 kB 00:00 2024-05-03T21:58:41.734 INFO:teuthology.orchestra.run.smithi130.stdout:(37/152): cephfs-top-19.0.0-3450.g9a047fe7.el9. 278 kB/s | 18 kB 00:00 2024-05-03T21:58:41.786 INFO:teuthology.orchestra.run.smithi082.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-05-03T21:58:41.830 INFO:teuthology.orchestra.run.smithi116.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-05-03T21:58:41.836 INFO:teuthology.orchestra.run.smithi082.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-03T21:58:41.859 INFO:teuthology.orchestra.run.smithi130.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 648 kB/s | 80 kB 00:00 2024-05-03T21:58:41.887 INFO:teuthology.orchestra.run.smithi082.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-05-03T21:58:41.888 INFO:teuthology.orchestra.run.smithi116.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-05-03T21:58:41.939 INFO:teuthology.orchestra.run.smithi116.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 520 kB/s | 26 kB 00:00 2024-05-03T21:58:41.945 INFO:teuthology.orchestra.run.smithi082.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-03T21:58:41.996 INFO:teuthology.orchestra.run.smithi082.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.3 MB/s | 215 kB 00:00 2024-05-03T21:58:42.010 INFO:teuthology.orchestra.run.smithi130.stdout:(39/152): ceph-mgr-diskprediction-local-19.0.0- 7.3 MB/s | 7.4 MB 00:01 2024-05-03T21:58:42.039 INFO:teuthology.orchestra.run.smithi116.stdout:(77/152): python3-devel-3.9.18-3.el9.x86_64.rpm 697 kB/s | 244 kB 00:00 2024-05-03T21:58:42.063 INFO:teuthology.orchestra.run.smithi082.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 10 MB/s | 689 kB 00:00 2024-05-03T21:58:42.065 INFO:teuthology.orchestra.run.smithi116.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-05-03T21:58:42.093 INFO:teuthology.orchestra.run.smithi130.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-05-03T21:58:42.123 INFO:teuthology.orchestra.run.smithi116.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-05-03T21:58:42.130 INFO:teuthology.orchestra.run.smithi082.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-05-03T21:58:42.149 INFO:teuthology.orchestra.run.smithi116.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 419 kB/s | 35 kB 00:00 2024-05-03T21:58:42.152 INFO:teuthology.orchestra.run.smithi130.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-05-03T21:58:42.180 INFO:teuthology.orchestra.run.smithi082.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 2.2 MB/s | 107 kB 00:00 2024-05-03T21:58:42.202 INFO:teuthology.orchestra.run.smithi130.stdout:(42/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-05-03T21:58:42.207 INFO:teuthology.orchestra.run.smithi116.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-05-03T21:58:42.230 INFO:teuthology.orchestra.run.smithi082.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 438 kB/s | 21 kB 00:00 2024-05-03T21:58:42.269 INFO:teuthology.orchestra.run.smithi130.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-05-03T21:58:42.289 INFO:teuthology.orchestra.run.smithi082.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-05-03T21:58:42.303 INFO:teuthology.orchestra.run.smithi130.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-05-03T21:58:42.336 INFO:teuthology.orchestra.run.smithi130.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-05-03T21:58:42.349 INFO:teuthology.orchestra.run.smithi116.stdout:(82/152): python3-babel-2.9.1-2.el9.noarch.rpm 8.7 MB/s | 6.0 MB 00:00 2024-05-03T21:58:42.373 INFO:teuthology.orchestra.run.smithi082.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 396 kB/s | 33 kB 00:00 2024-05-03T21:58:42.378 INFO:teuthology.orchestra.run.smithi130.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-05-03T21:58:42.383 INFO:teuthology.orchestra.run.smithi116.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-05-03T21:58:42.408 INFO:teuthology.orchestra.run.smithi116.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-03T21:58:42.412 INFO:teuthology.orchestra.run.smithi130.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-05-03T21:58:42.434 INFO:teuthology.orchestra.run.smithi116.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-05-03T21:58:42.550 INFO:teuthology.orchestra.run.smithi116.stdout:(86/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-05-03T21:58:42.566 INFO:teuthology.orchestra.run.smithi082.stdout:(53/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-05-03T21:58:42.584 INFO:teuthology.orchestra.run.smithi116.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-05-03T21:58:42.615 INFO:teuthology.orchestra.run.smithi082.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 377 kB/s | 18 kB 00:00 2024-05-03T21:58:42.617 INFO:teuthology.orchestra.run.smithi116.stdout:(88/152): python3-protobuf-3.14.0-13.el9.noarch 1.3 MB/s | 269 kB 00:00 2024-05-03T21:58:42.651 INFO:teuthology.orchestra.run.smithi116.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-05-03T21:58:42.674 INFO:teuthology.orchestra.run.smithi082.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 194 kB/s | 11 kB 00:00 2024-05-03T21:58:42.676 INFO:teuthology.orchestra.run.smithi116.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 556 kB/s | 51 kB 00:00 2024-05-03T21:58:42.701 INFO:teuthology.orchestra.run.smithi116.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 646 kB/s | 54 kB 00:00 2024-05-03T21:58:42.704 INFO:teuthology.orchestra.run.smithi130.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-05-03T21:58:42.724 INFO:teuthology.orchestra.run.smithi082.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 160 kB 00:00 2024-05-03T21:58:42.752 INFO:teuthology.orchestra.run.smithi116.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 858 kB/s | 42 kB 00:00 2024-05-03T21:58:42.771 INFO:teuthology.orchestra.run.smithi130.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-05-03T21:58:42.774 INFO:teuthology.orchestra.run.smithi082.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 922 kB/s | 45 kB 00:00 2024-05-03T21:58:42.777 INFO:teuthology.orchestra.run.smithi116.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 599 kB/s | 44 kB 00:00 2024-05-03T21:58:42.819 INFO:teuthology.orchestra.run.smithi116.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-05-03T21:58:42.821 INFO:teuthology.orchestra.run.smithi130.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-05-03T21:58:42.841 INFO:teuthology.orchestra.run.smithi082.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 9.9 MB/s | 662 kB 00:00 2024-05-03T21:58:42.845 INFO:teuthology.orchestra.run.smithi116.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 541 kB/s | 36 kB 00:00 2024-05-03T21:58:42.847 INFO:teuthology.orchestra.run.smithi130.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 287 kB/s | 21 kB 00:00 2024-05-03T21:58:42.870 INFO:teuthology.orchestra.run.smithi116.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 960 kB/s | 47 kB 00:00 2024-05-03T21:58:42.900 INFO:teuthology.orchestra.run.smithi082.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 582 kB 00:00 2024-05-03T21:58:42.905 INFO:teuthology.orchestra.run.smithi130.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 567 kB/s | 33 kB 00:00 2024-05-03T21:58:42.928 INFO:teuthology.orchestra.run.smithi116.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-05-03T21:58:42.939 INFO:teuthology.orchestra.run.smithi130.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-05-03T21:58:42.953 INFO:teuthology.orchestra.run.smithi116.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 698 kB/s | 58 kB 00:00 2024-05-03T21:58:42.975 INFO:teuthology.orchestra.run.smithi082.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 343 kB/s | 25 kB 00:00 2024-05-03T21:58:42.996 INFO:teuthology.orchestra.run.smithi116.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-05-03T21:58:42.998 INFO:teuthology.orchestra.run.smithi130.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 316 kB/s | 18 kB 00:00 2024-05-03T21:58:43.026 INFO:teuthology.orchestra.run.smithi082.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 968 kB/s | 47 kB 00:00 2024-05-03T21:58:43.056 INFO:teuthology.orchestra.run.smithi130.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 194 kB/s | 11 kB 00:00 2024-05-03T21:58:43.063 INFO:teuthology.orchestra.run.smithi116.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 584 kB/s | 64 kB 00:00 2024-05-03T21:58:43.096 INFO:teuthology.orchestra.run.smithi116.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2024-05-03T21:58:43.123 INFO:teuthology.orchestra.run.smithi130.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-05-03T21:58:43.159 INFO:teuthology.orchestra.run.smithi082.stdout:(62/152): ceph-mgr-diskprediction-local-19.0.0- 3.0 MB/s | 7.4 MB 00:02 2024-05-03T21:58:43.193 INFO:teuthology.orchestra.run.smithi082.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-05-03T21:58:43.199 INFO:teuthology.orchestra.run.smithi130.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 610 kB/s | 45 kB 00:00 2024-05-03T21:58:43.251 INFO:teuthology.orchestra.run.smithi082.stdout:(64/152): openblas-0.3.21-2.el9.x86_64.rpm 613 kB/s | 35 kB 00:00 2024-05-03T21:58:43.327 INFO:teuthology.orchestra.run.smithi082.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-05-03T21:58:43.382 INFO:teuthology.orchestra.run.smithi130.stdout:(58/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.3 MB/s | 3.0 MB 00:00 2024-05-03T21:58:43.413 INFO:teuthology.orchestra.run.smithi116.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-05-03T21:58:43.416 INFO:teuthology.orchestra.run.smithi130.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-05-03T21:58:43.447 INFO:teuthology.orchestra.run.smithi116.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 64 kB/s | 22 kB 00:00 2024-05-03T21:58:43.460 INFO:teuthology.orchestra.run.smithi082.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-05-03T21:58:43.474 INFO:teuthology.orchestra.run.smithi130.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 446 kB/s | 25 kB 00:00 2024-05-03T21:58:43.541 INFO:teuthology.orchestra.run.smithi130.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 721 kB/s | 47 kB 00:00 2024-05-03T21:58:43.546 INFO:teuthology.orchestra.run.smithi082.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-05-03T21:58:43.575 INFO:teuthology.orchestra.run.smithi130.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 3.6 MB/s | 582 kB 00:00 2024-05-03T21:58:43.608 INFO:teuthology.orchestra.run.smithi130.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-05-03T21:58:43.661 INFO:teuthology.orchestra.run.smithi082.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-05-03T21:58:43.667 INFO:teuthology.orchestra.run.smithi130.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-03T21:58:43.693 INFO:teuthology.orchestra.run.smithi130.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 425 kB/s | 35 kB 00:00 2024-05-03T21:58:43.711 INFO:teuthology.orchestra.run.smithi082.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 5.4 MB/s | 911 kB 00:00 2024-05-03T21:58:43.738 INFO:teuthology.orchestra.run.smithi116.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.3 MB/s | 863 kB 00:00 2024-05-03T21:58:43.745 INFO:teuthology.orchestra.run.smithi082.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-05-03T21:58:43.829 INFO:teuthology.orchestra.run.smithi082.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-05-03T21:58:43.879 INFO:teuthology.orchestra.run.smithi082.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-05-03T21:58:44.005 INFO:teuthology.orchestra.run.smithi082.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-05-03T21:58:44.063 INFO:teuthology.orchestra.run.smithi082.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 4.2 MB/s | 244 kB 00:00 2024-05-03T21:58:44.064 INFO:teuthology.orchestra.run.smithi116.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 60 kB/s | 19 kB 00:00 2024-05-03T21:58:44.122 INFO:teuthology.orchestra.run.smithi082.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-05-03T21:58:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-05-03T21:58:44.247 INFO:teuthology.orchestra.run.smithi116.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 386 kB/s | 309 kB 00:00 2024-05-03T21:58:44.272 INFO:teuthology.orchestra.run.smithi082.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 171 kB/s | 26 kB 00:00 2024-05-03T21:58:44.297 INFO:teuthology.orchestra.run.smithi082.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 325 kB/s | 19 kB 00:00 2024-05-03T21:58:44.331 INFO:teuthology.orchestra.run.smithi082.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-03T21:58:44.356 INFO:teuthology.orchestra.run.smithi082.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 603 kB/s | 35 kB 00:00 2024-05-03T21:58:44.373 INFO:teuthology.orchestra.run.smithi116.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 209 kB/s | 26 kB 00:00 2024-05-03T21:58:44.415 INFO:teuthology.orchestra.run.smithi082.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 250 kB 00:00 2024-05-03T21:58:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-05-03T21:58:44.515 INFO:teuthology.orchestra.run.smithi116.stdout:(108/152): abseil-cpp-20211102.0-3.el9.x86_64.r 500 kB/s | 548 kB 00:01 2024-05-03T21:58:44.515 INFO:teuthology.orchestra.run.smithi082.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-05-03T21:58:44.540 INFO:teuthology.orchestra.run.smithi116.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 292 kB/s | 49 kB 00:00 2024-05-03T21:58:44.593 INFO:teuthology.orchestra.run.smithi130.stdout:(66/152): ceph-test-19.0.0-3450.g9a047fe7.el9.x 6.6 MB/s | 49 MB 00:07 2024-05-03T21:58:44.624 INFO:teuthology.orchestra.run.smithi082.stdout:(84/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-05-03T21:58:44.640 INFO:teuthology.orchestra.run.smithi116.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 541 kB/s | 67 kB 00:00 2024-05-03T21:58:44.649 INFO:teuthology.orchestra.run.smithi082.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 318 kB/s | 42 kB 00:00 2024-05-03T21:58:44.683 INFO:teuthology.orchestra.run.smithi082.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 269 kB 00:00 2024-05-03T21:58:44.710 INFO:teuthology.orchestra.run.smithi130.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.4 MB/s | 4.4 MB 00:01 2024-05-03T21:58:44.717 INFO:teuthology.orchestra.run.smithi082.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.4 MB/s | 159 kB 00:00 2024-05-03T21:58:44.750 INFO:teuthology.orchestra.run.smithi082.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-03T21:58:44.757 INFO:teuthology.orchestra.run.smithi116.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 698 kB/s | 151 kB 00:00 2024-05-03T21:58:44.775 INFO:teuthology.orchestra.run.smithi082.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 885 kB/s | 51 kB 00:00 2024-05-03T21:58:44.801 INFO:teuthology.orchestra.run.smithi082.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-05-03T21:58:44.802 INFO:teuthology.orchestra.run.smithi130.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 4.2 MB/s | 4.7 MB 00:01 2024-05-03T21:58:44.869 INFO:teuthology.orchestra.run.smithi082.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-05-03T21:58:44.910 INFO:teuthology.orchestra.run.smithi130.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-05-03T21:58:44.926 INFO:teuthology.orchestra.run.smithi082.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 780 kB/s | 44 kB 00:00 2024-05-03T21:58:44.961 INFO:teuthology.orchestra.run.smithi130.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 3.6 MB/s | 911 kB 00:00 2024-05-03T21:58:44.977 INFO:teuthology.orchestra.run.smithi082.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.4 MB/s | 221 kB 00:00 2024-05-03T21:58:45.027 INFO:teuthology.orchestra.run.smithi082.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 730 kB/s | 36 kB 00:00 2024-05-03T21:58:45.077 INFO:teuthology.orchestra.run.smithi082.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 961 kB/s | 47 kB 00:00 2024-05-03T21:58:45.136 INFO:teuthology.orchestra.run.smithi082.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-05-03T21:58:45.178 INFO:teuthology.orchestra.run.smithi130.stdout:(71/152): postgresql-13.14-1.el9.x86_64.rpm 2.7 MB/s | 1.6 MB 00:00 2024-05-03T21:58:45.211 INFO:teuthology.orchestra.run.smithi082.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 778 kB/s | 58 kB 00:00 2024-05-03T21:58:45.244 INFO:teuthology.orchestra.run.smithi130.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 3.6 MB/s | 1.0 MB 00:00 2024-05-03T21:58:45.262 INFO:teuthology.orchestra.run.smithi082.stdout:(98/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-05-03T21:58:45.270 INFO:teuthology.orchestra.run.smithi130.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 960 kB/s | 87 kB 00:00 2024-05-03T21:58:45.304 INFO:teuthology.orchestra.run.smithi082.stdout:(99/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-05-03T21:58:45.346 INFO:teuthology.orchestra.run.smithi082.stdout:(100/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-05-03T21:58:45.362 INFO:teuthology.orchestra.run.smithi130.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-05-03T21:58:45.441 INFO:teuthology.orchestra.run.smithi116.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 803 kB/s | 548 kB 00:00 2024-05-03T21:58:45.489 INFO:teuthology.orchestra.run.smithi130.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-05-03T21:58:45.499 INFO:teuthology.orchestra.run.smithi116.stdout:(113/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 978 kB/s | 839 kB 00:00 2024-05-03T21:58:45.566 INFO:teuthology.orchestra.run.smithi116.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 349 kB/s | 43 kB 00:00 2024-05-03T21:58:45.588 INFO:teuthology.orchestra.run.smithi082.stdout:(101/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-05-03T21:58:45.604 INFO:teuthology.orchestra.run.smithi130.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 225 kB/s | 26 kB 00:00 2024-05-03T21:58:45.633 INFO:teuthology.orchestra.run.smithi116.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 242 kB/s | 32 kB 00:00 2024-05-03T21:58:45.654 INFO:teuthology.orchestra.run.smithi130.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 390 kB/s | 19 kB 00:00 2024-05-03T21:58:45.692 INFO:teuthology.orchestra.run.smithi116.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2024-05-03T21:58:45.771 INFO:teuthology.orchestra.run.smithi082.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 52 kB/s | 22 kB 00:00 2024-05-03T21:58:45.788 INFO:teuthology.orchestra.run.smithi130.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-05-03T21:58:45.863 INFO:teuthology.orchestra.run.smithi130.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 468 kB/s | 35 kB 00:00 2024-05-03T21:58:45.867 INFO:teuthology.orchestra.run.smithi116.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 737 kB/s | 172 kB 00:00 2024-05-03T21:58:45.989 INFO:teuthology.orchestra.run.smithi130.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 5.4 MB/s | 5.8 MB 00:01 2024-05-03T21:58:46.056 INFO:teuthology.orchestra.run.smithi130.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-05-03T21:58:46.117 INFO:teuthology.orchestra.run.smithi116.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 844 kB/s | 358 kB 00:00 2024-05-03T21:58:46.131 INFO:teuthology.orchestra.run.smithi130.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-05-03T21:58:46.184 INFO:teuthology.orchestra.run.smithi116.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 958 kB/s | 303 kB 00:00 2024-05-03T21:58:46.189 INFO:teuthology.orchestra.run.smithi130.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-03T21:58:46.234 INFO:teuthology.orchestra.run.smithi116.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 304 kB/s | 35 kB 00:00 2024-05-03T21:58:46.248 INFO:teuthology.orchestra.run.smithi130.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 734 kB/s | 42 kB 00:00 2024-05-03T21:58:46.297 INFO:teuthology.orchestra.run.smithi082.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-05-03T21:58:46.340 INFO:teuthology.orchestra.run.smithi130.stdout:(85/152): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-05-03T21:58:46.385 INFO:teuthology.orchestra.run.smithi116.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 1.0 MB/s | 206 kB 00:00 2024-05-03T21:58:46.457 INFO:teuthology.orchestra.run.smithi130.stdout:(86/152): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-05-03T21:58:46.491 INFO:teuthology.orchestra.run.smithi130.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-05-03T21:58:46.502 INFO:teuthology.orchestra.run.smithi116.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-05-03T21:58:46.519 INFO:teuthology.orchestra.run.smithi082.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-05-03T21:58:46.550 INFO:teuthology.orchestra.run.smithi130.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 884 kB/s | 51 kB 00:00 2024-05-03T21:58:46.572 INFO:teuthology.orchestra.run.smithi082.stdout:(105/152): protobuf-compiler-3.14.0-13.el9.x86_ 879 kB/s | 863 kB 00:00 2024-05-03T21:58:46.583 INFO:teuthology.orchestra.run.smithi130.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-05-03T21:58:46.597 INFO:teuthology.orchestra.run.smithi082.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 250 kB/s | 19 kB 00:00 2024-05-03T21:58:46.608 INFO:teuthology.orchestra.run.smithi130.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 927 kB/s | 54 kB 00:00 2024-05-03T21:58:46.676 INFO:teuthology.orchestra.run.smithi130.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 631 kB/s | 42 kB 00:00 2024-05-03T21:58:46.686 INFO:teuthology.orchestra.run.smithi116.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2024-05-03T21:58:46.784 INFO:teuthology.orchestra.run.smithi130.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 410 kB/s | 44 kB 00:00 2024-05-03T21:58:46.822 INFO:teuthology.orchestra.run.smithi116.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 133 kB/s | 18 kB 00:00 2024-05-03T21:58:46.851 INFO:teuthology.orchestra.run.smithi130.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-05-03T21:58:46.923 INFO:teuthology.orchestra.run.smithi082.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 80 kB/s | 26 kB 00:00 2024-05-03T21:58:46.935 INFO:teuthology.orchestra.run.smithi130.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 434 kB/s | 36 kB 00:00 2024-05-03T21:58:46.953 INFO:teuthology.orchestra.run.smithi116.stdout:(125/152): python3-jaraco-collections-3.0.0-8.e 175 kB/s | 23 kB 00:00 2024-05-03T21:58:47.027 INFO:teuthology.orchestra.run.smithi130.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 521 kB/s | 47 kB 00:00 2024-05-03T21:58:47.039 INFO:teuthology.orchestra.run.smithi082.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 419 kB/s | 49 kB 00:00 2024-05-03T21:58:47.112 INFO:teuthology.orchestra.run.smithi116.stdout:(126/152): python3-jaraco-functools-3.5.0-2.el9 123 kB/s | 19 kB 00:00 2024-05-03T21:58:47.165 INFO:teuthology.orchestra.run.smithi082.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 542 kB/s | 67 kB 00:00 2024-05-03T21:58:47.177 INFO:teuthology.orchestra.run.smithi130.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 2.0 MB/s | 305 kB 00:00 2024-05-03T21:58:47.262 INFO:teuthology.orchestra.run.smithi116.stdout:(127/152): python3-jaraco-text-3.2.0-6.el9.noar 132 kB/s | 20 kB 00:00 2024-05-03T21:58:47.284 INFO:teuthology.orchestra.run.smithi130.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 546 kB/s | 58 kB 00:00 2024-05-03T21:58:47.298 INFO:teuthology.orchestra.run.smithi082.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-05-03T21:58:47.411 INFO:teuthology.orchestra.run.smithi130.stdout:(98/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.3 MB/s | 5.1 MB 00:01 2024-05-03T21:58:47.438 INFO:teuthology.orchestra.run.smithi130.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 619 kB/s | 94 kB 00:00 2024-05-03T21:58:47.512 INFO:teuthology.orchestra.run.smithi130.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 640 kB/s | 64 kB 00:00 2024-05-03T21:58:47.537 INFO:teuthology.orchestra.run.smithi130.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2024-05-03T21:58:47.679 INFO:teuthology.orchestra.run.smithi130.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 134 kB/s | 22 kB 00:00 2024-05-03T21:58:47.720 INFO:teuthology.orchestra.run.smithi116.stdout:(128/152): python3-grpcio-1.46.7-10.el9.x86_64. 1.4 MB/s | 2.0 MB 00:01 2024-05-03T21:58:47.779 INFO:teuthology.orchestra.run.smithi130.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-05-03T21:58:47.866 INFO:teuthology.orchestra.run.smithi116.stdout:(129/152): libarrow-9.0.0-11.el9.x86_64.rpm 1.2 MB/s | 4.4 MB 00:03 2024-05-03T21:58:47.896 INFO:teuthology.orchestra.run.smithi116.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 264 kB/s | 46 kB 00:00 2024-05-03T21:58:47.996 INFO:teuthology.orchestra.run.smithi116.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 609 kB/s | 79 kB 00:00 2024-05-03T21:58:48.013 INFO:teuthology.orchestra.run.smithi116.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 496 kB/s | 58 kB 00:00 2024-05-03T21:58:48.097 INFO:teuthology.orchestra.run.smithi116.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 1.2 MB/s | 1.0 MB 00:00 2024-05-03T21:58:48.122 INFO:teuthology.orchestra.run.smithi116.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 152 kB/s | 16 kB 00:00 2024-05-03T21:58:48.215 INFO:teuthology.orchestra.run.smithi082.stdout:(111/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 916 kB/s | 839 kB 00:00 2024-05-03T21:58:48.230 INFO:teuthology.orchestra.run.smithi116.stdout:(135/152): python3-pyperclip-1.8.2-2.el9.noarch 262 kB/s | 28 kB 00:00 2024-05-03T21:58:48.288 INFO:teuthology.orchestra.run.smithi130.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 608 kB/s | 309 kB 00:00 2024-05-03T21:58:48.306 INFO:teuthology.orchestra.run.smithi116.stdout:(136/152): python3-pecan-1.4.2-3.el9.noarch.rpm 882 kB/s | 272 kB 00:00 2024-05-03T21:58:48.331 INFO:teuthology.orchestra.run.smithi116.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 386 kB/s | 90 kB 00:00 2024-05-03T21:58:48.356 INFO:teuthology.orchestra.run.smithi116.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 246 kB/s | 31 kB 00:00 2024-05-03T21:58:48.388 INFO:teuthology.orchestra.run.smithi130.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 774 kB/s | 548 kB 00:00 2024-05-03T21:58:48.414 INFO:teuthology.orchestra.run.smithi130.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 156 kB/s | 19 kB 00:00 2024-05-03T21:58:48.448 INFO:teuthology.orchestra.run.smithi116.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 508 kB/s | 59 kB 00:00 2024-05-03T21:58:48.457 INFO:teuthology.orchestra.run.smithi082.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 2.2 MB/s | 548 kB 00:00 2024-05-03T21:58:48.490 INFO:teuthology.orchestra.run.smithi116.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 269 kB/s | 36 kB 00:00 2024-05-03T21:58:48.532 INFO:teuthology.orchestra.run.smithi116.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 836 kB/s | 188 kB 00:00 2024-05-03T21:58:48.539 INFO:teuthology.orchestra.run.smithi130.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 209 kB/s | 26 kB 00:00 2024-05-03T21:58:48.549 INFO:teuthology.orchestra.run.smithi082.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 479 kB/s | 43 kB 00:00 2024-05-03T21:58:48.566 INFO:teuthology.orchestra.run.smithi116.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 437 kB/s | 51 kB 00:00 2024-05-03T21:58:48.616 INFO:teuthology.orchestra.run.smithi116.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-05-03T21:58:48.641 INFO:teuthology.orchestra.run.smithi082.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 355 kB/s | 32 kB 00:00 2024-05-03T21:58:48.650 INFO:teuthology.orchestra.run.smithi116.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 769 kB/s | 90 kB 00:00 2024-05-03T21:58:48.733 INFO:teuthology.orchestra.run.smithi116.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2024-05-03T21:58:48.789 INFO:teuthology.orchestra.run.smithi130.stdout:(108/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-05-03T21:58:48.800 INFO:teuthology.orchestra.run.smithi082.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 95 kB/s | 15 kB 00:00 2024-05-03T21:58:48.815 INFO:teuthology.orchestra.run.smithi130.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 177 kB/s | 49 kB 00:00 2024-05-03T21:58:48.859 INFO:teuthology.orchestra.run.smithi116.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 920 kB/s | 192 kB 00:00 2024-05-03T21:58:48.892 INFO:teuthology.orchestra.run.smithi082.stdout:(116/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-05-03T21:58:48.940 INFO:teuthology.orchestra.run.smithi130.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-05-03T21:58:49.059 INFO:teuthology.orchestra.run.smithi116.stdout:(147/152): python3-werkzeug-2.0.3-3.el9.1.noarc 868 kB/s | 427 kB 00:00 2024-05-03T21:58:49.075 INFO:teuthology.orchestra.run.smithi082.stdout:(117/152): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-05-03T21:58:49.140 INFO:teuthology.orchestra.run.smithi130.stdout:(111/152): libarrow-9.0.0-11.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-05-03T21:58:49.165 INFO:teuthology.orchestra.run.smithi130.stdout:(112/152): libunwind-1.6.2-1.el9.x86_64.rpm 180 kB/s | 67 kB 00:00 2024-05-03T21:58:49.207 INFO:teuthology.orchestra.run.smithi130.stdout:(113/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-05-03T21:58:49.226 INFO:teuthology.orchestra.run.smithi082.stdout:(118/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.0 MB/s | 303 kB 00:00 2024-05-03T21:58:49.291 INFO:teuthology.orchestra.run.smithi130.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 348 kB/s | 43 kB 00:00 2024-05-03T21:58:49.325 INFO:teuthology.orchestra.run.smithi130.stdout:(115/152): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-05-03T21:58:49.338 INFO:teuthology.orchestra.run.smithi082.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 318 kB/s | 35 kB 00:00 2024-05-03T21:58:49.350 INFO:teuthology.orchestra.run.smithi130.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 227 kB/s | 32 kB 00:00 2024-05-03T21:58:49.425 INFO:teuthology.orchestra.run.smithi130.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 113 kB/s | 15 kB 00:00 2024-05-03T21:58:49.443 INFO:teuthology.orchestra.run.smithi082.stdout:(120/152): python3-google-auth-2.29.0-1.el9.noa 1.9 MB/s | 206 kB 00:00 2024-05-03T21:58:49.476 INFO:teuthology.orchestra.run.smithi130.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-05-03T21:58:49.476 INFO:teuthology.orchestra.run.smithi116.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-05-03T21:58:49.534 INFO:teuthology.orchestra.run.smithi130.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-05-03T21:58:49.576 INFO:teuthology.orchestra.run.smithi130.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 354 kB/s | 35 kB 00:00 2024-05-03T21:58:49.686 INFO:teuthology.orchestra.run.smithi130.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 1.3 MB/s | 206 kB 00:00 2024-05-03T21:58:49.718 INFO:teuthology.orchestra.run.smithi130.stdout:(122/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.0 MB/s | 303 kB 00:00 2024-05-03T21:58:49.810 INFO:teuthology.orchestra.run.smithi130.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-05-03T21:58:49.844 INFO:teuthology.orchestra.run.smithi130.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2024-05-03T21:58:49.927 INFO:teuthology.orchestra.run.smithi130.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2024-05-03T21:58:50.002 INFO:teuthology.orchestra.run.smithi082.stdout:(121/152): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-05-03T21:58:50.003 INFO:teuthology.orchestra.run.smithi130.stdout:(126/152): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-05-03T21:58:50.028 INFO:teuthology.orchestra.run.smithi130.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 126 kB/s | 23 kB 00:00 2024-05-03T21:58:50.053 INFO:teuthology.orchestra.run.smithi130.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 156 kB/s | 19 kB 00:00 2024-05-03T21:58:50.085 INFO:teuthology.orchestra.run.smithi082.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-05-03T21:58:50.154 INFO:teuthology.orchestra.run.smithi130.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 158 kB/s | 20 kB 00:00 2024-05-03T21:58:50.179 INFO:teuthology.orchestra.run.smithi130.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 371 kB/s | 46 kB 00:00 2024-05-03T21:58:50.185 INFO:teuthology.orchestra.run.smithi082.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 108 kB/s | 11 kB 00:00 2024-05-03T21:58:50.276 INFO:teuthology.orchestra.run.smithi116.stdout:(149/152): librbd1-19.0.0-3450.g9a047fe7.el9.x8 2.6 MB/s | 3.1 MB 00:01 2024-05-03T21:58:50.279 INFO:teuthology.orchestra.run.smithi130.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 635 kB/s | 79 kB 00:00 2024-05-03T21:58:50.298 INFO:teuthology.orchestra.run.smithi082.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 164 kB/s | 18 kB 00:00 2024-05-03T21:58:50.304 INFO:teuthology.orchestra.run.smithi130.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 463 kB/s | 58 kB 00:00 2024-05-03T21:58:50.351 INFO:teuthology.orchestra.run.smithi116.stdout:(150/152): librados2-19.0.0-3450.g9a047fe7.el9. 2.3 MB/s | 3.4 MB 00:01 2024-05-03T21:58:50.371 INFO:teuthology.orchestra.run.smithi130.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 3.0 MB/s | 1.0 MB 00:00 2024-05-03T21:58:50.386 INFO:teuthology.orchestra.run.smithi082.stdout:(125/152): python3-jaraco-collections-3.0.0-8.e 255 kB/s | 23 kB 00:00 2024-05-03T21:58:50.422 INFO:teuthology.orchestra.run.smithi130.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-05-03T21:58:50.447 INFO:teuthology.orchestra.run.smithi130.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 116 kB/s | 16 kB 00:00 2024-05-03T21:58:50.470 INFO:teuthology.orchestra.run.smithi082.stdout:(126/152): python3-jaraco-functools-3.5.0-2.el9 236 kB/s | 19 kB 00:00 2024-05-03T21:58:50.481 INFO:teuthology.orchestra.run.smithi130.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 830 kB/s | 90 kB 00:00 2024-05-03T21:58:50.493 INFO:teuthology.orchestra.run.smithi116.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:01 2024-05-03T21:58:50.540 INFO:teuthology.orchestra.run.smithi130.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 242 kB/s | 28 kB 00:00 2024-05-03T21:58:50.562 INFO:teuthology.orchestra.run.smithi082.stdout:(127/152): python3-jaraco-text-3.2.0-6.el9.noar 216 kB/s | 20 kB 00:00 2024-05-03T21:58:50.581 INFO:teuthology.orchestra.run.smithi130.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 230 kB/s | 31 kB 00:00 2024-05-03T21:58:50.615 INFO:teuthology.orchestra.run.smithi130.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-05-03T21:58:50.657 INFO:teuthology.orchestra.run.smithi130.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 506 kB/s | 59 kB 00:00 2024-05-03T21:58:50.674 INFO:teuthology.orchestra.run.smithi130.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 390 kB/s | 36 kB 00:00 2024-05-03T21:58:50.749 INFO:teuthology.orchestra.run.smithi130.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 382 kB/s | 51 kB 00:00 2024-05-03T21:58:50.816 INFO:teuthology.orchestra.run.smithi130.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-05-03T21:58:50.883 INFO:teuthology.orchestra.run.smithi130.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 432 kB/s | 90 kB 00:00 2024-05-03T21:58:50.925 INFO:teuthology.orchestra.run.smithi130.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-05-03T21:58:50.950 INFO:teuthology.orchestra.run.smithi130.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 150 kB/s | 20 kB 00:00 2024-05-03T21:58:51.017 INFO:teuthology.orchestra.run.smithi130.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-05-03T21:58:51.326 INFO:teuthology.orchestra.run.smithi116.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-05-03T21:58:51.332 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-05-03T21:58:51.333 INFO:teuthology.orchestra.run.smithi116.stdout:Total 9.9 MB/s | 222 MB 00:22 2024-05-03T21:58:51.334 INFO:teuthology.orchestra.run.smithi130.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-05-03T21:58:51.362 INFO:teuthology.orchestra.run.smithi082.stdout:(128/152): ceph-test-19.0.0-3450.g9a047fe7.el9. 3.5 MB/s | 49 MB 00:14 2024-05-03T21:58:51.404 INFO:teuthology.orchestra.run.smithi082.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 1.2 MB/s | 1.0 MB 00:00 2024-05-03T21:58:51.418 INFO:teuthology.orchestra.run.smithi130.stdout:(149/152): librados2-19.0.0-3450.g9a047fe7.el9. 7.3 MB/s | 3.4 MB 00:00 2024-05-03T21:58:51.504 INFO:teuthology.orchestra.run.smithi082.stdout:(130/152): libarrow-9.0.0-11.el9.x86_64.rpm 917 kB/s | 4.4 MB 00:04 2024-05-03T21:58:51.529 INFO:teuthology.orchestra.run.smithi082.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 632 kB/s | 79 kB 00:00 2024-05-03T21:58:51.863 INFO:teuthology.orchestra.run.smithi082.stdout:(132/152): python3-pecan-1.4.2-3.el9.noarch.rpm 818 kB/s | 272 kB 00:00 2024-05-03T21:58:51.888 INFO:teuthology.orchestra.run.smithi082.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 150 kB/s | 58 kB 00:00 2024-05-03T21:58:51.939 INFO:teuthology.orchestra.run.smithi082.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 220 kB/s | 16 kB 00:00 2024-05-03T21:58:51.992 INFO:teuthology.orchestra.run.smithi082.stdout:(135/152): python3-logutils-0.3.5-21.el9.noarch 74 kB/s | 46 kB 00:00 2024-05-03T21:58:52.027 INFO:teuthology.orchestra.run.smithi130.stdout:(150/152): librbd1-19.0.0-3450.g9a047fe7.el9.x8 3.1 MB/s | 3.1 MB 00:01 2024-05-03T21:58:52.039 INFO:teuthology.orchestra.run.smithi082.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 600 kB/s | 90 kB 00:00 2024-05-03T21:58:52.081 INFO:teuthology.orchestra.run.smithi082.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 199 kB/s | 28 kB 00:00 2024-05-03T21:58:52.093 INFO:teuthology.orchestra.run.smithi130.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 3.5 MB/s | 2.4 MB 00:00 2024-05-03T21:58:52.131 INFO:teuthology.orchestra.run.smithi082.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 221 kB/s | 31 kB 00:00 2024-05-03T21:58:52.173 INFO:teuthology.orchestra.run.smithi082.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 648 kB/s | 59 kB 00:00 2024-05-03T21:58:52.224 INFO:teuthology.orchestra.run.smithi082.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 392 kB/s | 36 kB 00:00 2024-05-03T21:58:52.249 INFO:teuthology.orchestra.run.smithi082.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 904 kB/s | 188 kB 00:00 2024-05-03T21:58:52.260 INFO:teuthology.orchestra.run.smithi130.stdout:(152/152): openssl-3.2.1-1.el9.x86_64.rpm 1.5 MB/s | 1.3 MB 00:00 2024-05-03T21:58:52.266 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-05-03T21:58:52.267 INFO:teuthology.orchestra.run.smithi130.stdout:Total 10 MB/s | 222 MB 00:21 2024-05-03T21:58:52.274 INFO:teuthology.orchestra.run.smithi082.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 511 kB/s | 51 kB 00:00 2024-05-03T21:58:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 635 kB/s | 90 kB 00:00 2024-05-03T21:58:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-05-03T21:58:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:(145/152): python3-webob-1.8.7-6.el9.noarch.rpm 982 kB/s | 230 kB 00:00 2024-05-03T21:58:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 219 kB/s | 20 kB 00:00 2024-05-03T21:58:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-05-03T21:58:52.884 INFO:teuthology.orchestra.run.smithi082.stdout:(148/152): librados2-19.0.0-3450.g9a047fe7.el9. 8.5 MB/s | 3.4 MB 00:00 2024-05-03T21:58:53.043 INFO:teuthology.orchestra.run.smithi082.stdout:(149/152): librbd1-19.0.0-3450.g9a047fe7.el9.x8 6.1 MB/s | 3.1 MB 00:00 2024-05-03T21:58:53.135 INFO:teuthology.orchestra.run.smithi082.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 1.3 MB 00:00 2024-05-03T21:58:53.303 INFO:teuthology.orchestra.run.smithi082.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-05-03T21:58:53.894 INFO:teuthology.orchestra.run.smithi082.stdout:(152/152): thrift-0.15.0-2.el9.x86_64.rpm 1.1 MB/s | 1.6 MB 00:01 2024-05-03T21:58:53.900 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-05-03T21:58:53.900 INFO:teuthology.orchestra.run.smithi082.stdout:Total 8.8 MB/s | 222 MB 00:25 2024-05-03T21:58:54.177 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-05-03T21:58:54.409 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-05-03T21:58:54.409 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-05-03T21:58:55.135 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-05-03T21:58:55.365 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-05-03T21:58:55.365 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-05-03T21:58:56.854 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-05-03T21:58:57.087 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-05-03T21:58:57.087 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-05-03T21:58:57.096 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-05-03T21:58:57.097 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-05-03T21:58:57.987 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-05-03T21:58:57.987 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-05-03T21:58:59.576 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-05-03T21:58:59.576 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-05-03T21:59:03.359 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-05-03T21:59:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-05-03T21:59:03.570 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-05-03T21:59:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-05-03T21:59:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-05-03T21:59:03.761 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-05-03T21:59:03.881 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-05-03T21:59:04.255 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-05-03T21:59:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-05-03T21:59:04.376 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-05-03T21:59:04.409 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T21:59:04.560 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-05-03T21:59:04.579 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T21:59:04.609 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T21:59:04.661 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-05-03T21:59:04.710 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-05-03T21:59:04.734 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T21:59:04.744 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-05-03T21:59:04.766 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T21:59:04.867 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-05-03T21:59:05.078 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-05-03T21:59:05.159 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-05-03T21:59:05.189 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T21:59:05.327 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T21:59:05.335 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-05-03T21:59:05.356 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T21:59:05.434 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T21:59:05.453 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T21:59:05.482 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T21:59:05.551 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T21:59:05.610 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T21:59:05.643 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T21:59:05.774 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T21:59:05.811 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T21:59:05.840 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T21:59:05.899 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T21:59:06.086 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-05-03T21:59:06.117 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-05-03T21:59:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-05-03T21:59:06.215 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-05-03T21:59:06.219 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-05-03T21:59:06.240 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T21:59:06.243 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-05-03T21:59:06.258 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-05-03T21:59:06.306 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-05-03T21:59:06.336 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-05-03T21:59:06.395 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T21:59:06.399 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-05-03T21:59:06.424 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T21:59:06.447 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-05-03T21:59:06.453 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-05-03T21:59:06.510 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T21:59:06.514 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-05-03T21:59:06.535 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-05-03T21:59:06.550 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T21:59:06.558 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-05-03T21:59:06.585 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-05-03T21:59:06.598 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-05-03T21:59:06.614 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T21:59:06.703 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-05-03T21:59:06.711 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-05-03T21:59:06.776 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-05-03T21:59:06.808 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-05-03T21:59:06.860 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-05-03T21:59:06.905 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T21:59:06.959 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T21:59:06.960 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-05-03T21:59:06.995 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 31/156 2024-05-03T21:59:07.045 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 32/156 2024-05-03T21:59:07.093 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 33/156 2024-05-03T21:59:07.130 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-05-03T21:59:07.167 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-05-03T21:59:07.211 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-05-03T21:59:07.241 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T21:59:07.274 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-05-03T21:59:07.294 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-05-03T21:59:07.343 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-05-03T21:59:07.381 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-05-03T21:59:07.391 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-05-03T21:59:07.406 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T21:59:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T21:59:07.496 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-05-03T21:59:07.538 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-05-03T21:59:07.554 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-05-03T21:59:07.600 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-05-03T21:59:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T21:59:07.615 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-05-03T21:59:07.641 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-05-03T21:59:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T21:59:07.674 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-05-03T21:59:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-05-03T21:59:07.851 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-05-03T21:59:07.885 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-05-03T21:59:07.941 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-05-03T21:59:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-05-03T21:59:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-05-03T21:59:08.058 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-05-03T21:59:08.097 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 31/156 2024-05-03T21:59:08.151 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 32/156 2024-05-03T21:59:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T21:59:08.187 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 33/156 2024-05-03T21:59:08.297 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-05-03T21:59:08.306 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-05-03T21:59:08.365 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-05-03T21:59:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-05-03T21:59:08.449 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-05-03T21:59:08.464 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-05-03T21:59:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T21:59:08.495 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-05-03T21:59:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T21:59:08.536 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 43/156 2024-05-03T21:59:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T21:59:08.602 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-05-03T21:59:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T21:59:08.642 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-05-03T21:59:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T21:59:08.717 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-05-03T21:59:08.863 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-05-03T21:59:08.952 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-05-03T21:59:09.003 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T21:59:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-05-03T21:59:09.065 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T21:59:09.129 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-05-03T21:59:09.168 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-05-03T21:59:09.207 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-05-03T21:59:09.263 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-05-03T21:59:09.272 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-05-03T21:59:09.315 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-05-03T21:59:09.376 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-05-03T21:59:09.384 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-05-03T21:59:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-05-03T21:59:09.432 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-05-03T21:59:09.435 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-05-03T21:59:09.480 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-05-03T21:59:09.507 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-05-03T21:59:09.552 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-05-03T21:59:09.583 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-05-03T21:59:09.597 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-05-03T21:59:09.632 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-05-03T21:59:09.637 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 43/156 2024-05-03T21:59:09.659 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-05-03T21:59:09.688 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-05-03T21:59:09.699 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-05-03T21:59:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-05-03T21:59:09.729 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-05-03T21:59:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-05-03T21:59:09.782 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-05-03T21:59:09.814 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-05-03T21:59:09.911 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-05-03T21:59:09.931 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-05-03T21:59:09.967 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-05-03T21:59:09.978 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-05-03T21:59:10.014 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-05-03T21:59:10.020 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-05-03T21:59:10.049 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-05-03T21:59:10.054 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-05-03T21:59:10.057 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-05-03T21:59:10.081 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-05-03T21:59:10.118 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-05-03T21:59:10.133 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-05-03T21:59:10.222 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-05-03T21:59:10.226 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-05-03T21:59:10.257 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-05-03T21:59:10.261 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 31/156 2024-05-03T21:59:10.272 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-05-03T21:59:10.311 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-05-03T21:59:10.330 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 32/156 2024-05-03T21:59:10.368 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 33/156 2024-05-03T21:59:10.379 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-05-03T21:59:10.419 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-05-03T21:59:10.427 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-05-03T21:59:10.479 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-05-03T21:59:10.480 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-05-03T21:59:10.489 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-05-03T21:59:10.524 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-05-03T21:59:10.537 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-05-03T21:59:10.571 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-05-03T21:59:10.574 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-05-03T21:59:10.635 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-05-03T21:59:10.692 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-05-03T21:59:10.697 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-05-03T21:59:10.731 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-05-03T21:59:10.733 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-05-03T21:59:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-05-03T21:59:10.783 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-05-03T21:59:10.820 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-05-03T21:59:10.827 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-05-03T21:59:10.867 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-05-03T21:59:10.869 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-05-03T21:59:10.893 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-05-03T21:59:10.934 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-05-03T21:59:10.966 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-05-03T21:59:10.994 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-05-03T21:59:11.046 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-05-03T21:59:11.062 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-05-03T21:59:11.093 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-05-03T21:59:11.124 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-05-03T21:59:11.127 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-05-03T21:59:11.160 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-05-03T21:59:11.168 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-05-03T21:59:11.236 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-05-03T21:59:11.352 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-05-03T21:59:11.382 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-05-03T21:59:11.439 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-05-03T21:59:11.529 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-05-03T21:59:11.575 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-05-03T21:59:11.631 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-05-03T21:59:11.674 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-05-03T21:59:11.677 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-05-03T21:59:11.737 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-05-03T21:59:11.778 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-05-03T21:59:11.786 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-05-03T21:59:11.823 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-05-03T21:59:11.828 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-05-03T21:59:11.875 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-05-03T21:59:11.893 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-05-03T21:59:11.926 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-05-03T21:59:11.943 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 43/156 2024-05-03T21:59:11.999 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-05-03T21:59:12.019 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-05-03T21:59:12.048 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-05-03T21:59:12.188 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-05-03T21:59:12.228 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-05-03T21:59:12.255 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-05-03T21:59:12.298 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-05-03T21:59:12.300 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-05-03T21:59:12.367 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-05-03T21:59:12.372 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-05-03T21:59:12.396 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-05-03T21:59:12.447 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-05-03T21:59:12.462 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-05-03T21:59:12.480 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-05-03T21:59:12.525 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-05-03T21:59:12.534 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-05-03T21:59:12.582 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-05-03T21:59:12.594 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-05-03T21:59:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-05-03T21:59:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-05-03T21:59:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-05-03T21:59:12.699 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-05-03T21:59:12.762 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-05-03T21:59:12.774 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-05-03T21:59:12.825 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-05-03T21:59:12.839 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-05-03T21:59:13.031 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-05-03T21:59:13.077 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-05-03T21:59:13.088 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-05-03T21:59:13.112 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-05-03T21:59:13.124 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-05-03T21:59:13.197 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-05-03T21:59:13.220 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-05-03T21:59:13.326 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-05-03T21:59:13.383 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-05-03T21:59:13.451 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-05-03T21:59:13.500 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-05-03T21:59:13.533 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-05-03T21:59:13.541 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-05-03T21:59:13.609 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-05-03T21:59:13.644 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-05-03T21:59:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-05-03T21:59:13.753 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-05-03T21:59:13.829 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-05-03T21:59:13.926 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-05-03T21:59:13.930 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-05-03T21:59:13.970 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-05-03T21:59:13.987 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-05-03T21:59:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-05-03T21:59:14.052 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-05-03T21:59:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-05-03T21:59:14.166 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-05-03T21:59:14.192 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-05-03T21:59:14.197 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-05-03T21:59:14.228 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-05-03T21:59:14.242 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-05-03T21:59:14.277 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-05-03T21:59:14.331 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-05-03T21:59:14.350 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-05-03T21:59:14.380 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-05-03T21:59:14.473 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-05-03T21:59:14.537 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-05-03T21:59:14.690 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-05-03T21:59:14.785 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-05-03T21:59:14.826 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-05-03T21:59:14.897 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-05-03T21:59:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-05-03T21:59:15.114 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-05-03T21:59:15.166 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-05-03T21:59:15.325 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-05-03T21:59:15.745 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-05-03T21:59:15.843 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-05-03T21:59:15.873 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-05-03T21:59:15.908 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-05-03T21:59:16.027 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-05-03T21:59:16.088 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-05-03T21:59:16.121 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-05-03T21:59:16.243 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-05-03T21:59:16.295 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-05-03T21:59:16.323 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-05-03T21:59:16.339 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T21:59:16.423 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-05-03T21:59:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T21:59:16.465 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-05-03T21:59:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 100/156 2024-05-03T21:59:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-05-03T21:59:16.697 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-05-03T21:59:16.745 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-05-03T21:59:16.856 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-05-03T21:59:16.933 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-05-03T21:59:17.049 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-05-03T21:59:17.097 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-05-03T21:59:17.098 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-05-03T21:59:17.125 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T21:59:17.148 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-05-03T21:59:17.224 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T21:59:17.252 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 104/156 2024-05-03T21:59:17.546 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-05-03T21:59:17.596 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T21:59:17.711 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-05-03T21:59:17.718 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T21:59:17.752 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 100/156 2024-05-03T21:59:17.811 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-05-03T21:59:17.856 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-05-03T21:59:18.364 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-05-03T21:59:18.399 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T21:59:18.490 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T21:59:18.517 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 104/156 2024-05-03T21:59:19.446 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-05-03T21:59:19.543 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-05-03T21:59:19.591 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-05-03T21:59:19.637 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-05-03T21:59:19.930 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T21:59:19.973 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T21:59:20.039 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-05-03T21:59:20.080 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T21:59:20.200 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T21:59:20.228 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 100/156 2024-05-03T21:59:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-05-03T21:59:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T21:59:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T21:59:20.828 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-05-03T21:59:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T21:59:20.833 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-03T21:59:20.833 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-03T21:59:20.833 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:20.858 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T21:59:20.899 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T21:59:20.949 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T21:59:20.993 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 104/156 2024-05-03T21:59:21.219 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T21:59:21.263 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T21:59:21.910 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T21:59:21.967 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T21:59:22.138 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T21:59:22.138 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-03T21:59:22.139 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-03T21:59:22.139 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:22.193 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T21:59:23.719 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T21:59:23.764 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T21:59:24.419 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T21:59:24.476 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T21:59:24.638 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T21:59:24.638 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-03T21:59:24.638 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-03T21:59:24.638 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:24.685 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T21:59:33.569 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T21:59:33.569 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-05-03T21:59:33.569 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-05-03T21:59:33.569 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-05-03T21:59:33.569 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-05-03T21:59:33.569 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-05-03T21:59:33.569 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2024-05-03T21:59:33.569 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-05-03T21:59:33.570 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:33.842 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T21:59:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T21:59:33.890 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:33.890 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-03T21:59:33.890 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:35.386 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T21:59:35.386 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2024-05-03T21:59:35.386 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2024-05-03T21:59:35.386 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2024-05-03T21:59:35.386 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2024-05-03T21:59:35.386 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2024-05-03T21:59:35.387 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /root 2024-05-03T21:59:35.387 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2024-05-03T21:59:35.387 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:35.529 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T21:59:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T21:59:35.615 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:35.615 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-03T21:59:35.615 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T21:59:35.615 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T21:59:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:35.662 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T21:59:35.708 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T21:59:35.708 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:35.708 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-03T21:59:35.708 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T21:59:35.960 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T21:59:35.960 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:35.960 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-03T21:59:35.960 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T21:59:35.960 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T21:59:35.960 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:36.447 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T21:59:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T21:59:36.522 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:36.522 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-03T21:59:36.522 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T21:59:36.522 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T21:59:36.522 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:36.647 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-05-03T21:59:36.736 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-05-03T21:59:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-05-03T21:59:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-05-03T21:59:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-05-03T21:59:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-05-03T21:59:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T21:59:37.364 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T21:59:37.442 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T21:59:37.443 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:37.443 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-03T21:59:37.443 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T21:59:37.443 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T21:59:37.443 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T21:59:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-05-03T21:59:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-05-03T21:59:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-05-03T21:59:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T21:59:37.642 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-05-03T21:59:37.642 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-05-03T21:59:37.642 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-05-03T21:59:37.642 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-05-03T21:59:37.642 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-05-03T21:59:37.642 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-05-03T21:59:37.642 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-05-03T21:59:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:37.689 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T21:59:37.760 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T21:59:37.760 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:37.760 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-03T21:59:37.760 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T21:59:37.760 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T21:59:37.760 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:37.875 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T21:59:37.935 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T21:59:37.935 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:37.935 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-03T21:59:37.935 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:38.248 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T21:59:38.297 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T21:59:38.317 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T21:59:38.317 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:38.318 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-03T21:59:38.318 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T21:59:38.318 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T21:59:38.318 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:38.328 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T21:59:38.383 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 124/156 2024-05-03T21:59:38.449 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-05-03T21:59:38.491 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 125/156 2024-05-03T21:59:38.508 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-05-03T21:59:38.529 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T21:59:38.575 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-05-03T21:59:38.807 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-05-03T21:59:38.861 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-05-03T21:59:38.946 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-05-03T21:59:39.054 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T21:59:39.229 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T21:59:39.277 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-05-03T21:59:39.317 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-05-03T21:59:39.359 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-05-03T21:59:39.569 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T21:59:39.646 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T21:59:39.647 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:39.647 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-03T21:59:39.647 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T21:59:39.647 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T21:59:39.647 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:39.785 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T21:59:39.831 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T21:59:39.910 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T21:59:39.978 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T21:59:39.979 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:39.979 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-03T21:59:39.979 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T21:59:39.979 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T21:59:39.979 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:40.005 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T21:59:40.048 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T21:59:40.129 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 124/156 2024-05-03T21:59:40.241 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 125/156 2024-05-03T21:59:40.283 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T21:59:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T21:59:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T21:59:40.549 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:40.549 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-03T21:59:40.550 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T21:59:40.550 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T21:59:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:40.686 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-05-03T21:59:40.751 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-05-03T21:59:40.826 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-05-03T21:59:40.929 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T21:59:40.956 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T21:59:41.056 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-05-03T21:59:41.110 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T21:59:41.125 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-05-03T21:59:41.209 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-05-03T21:59:41.287 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 129/156 2024-05-03T21:59:41.316 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T21:59:41.318 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T21:59:41.385 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T21:59:41.385 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:41.385 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-03T21:59:41.385 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T21:59:41.385 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T21:59:41.386 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:41.442 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T21:59:41.479 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T21:59:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T21:59:41.591 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 132/156 2024-05-03T21:59:41.596 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T21:59:41.608 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-05-03T21:59:41.635 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T21:59:41.651 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-05-03T21:59:41.672 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 133/156 2024-05-03T21:59:41.690 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-05-03T21:59:42.381 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T21:59:42.418 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T21:59:42.472 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 124/156 2024-05-03T21:59:42.579 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 125/156 2024-05-03T21:59:42.619 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T21:59:42.678 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-05-03T21:59:42.712 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T21:59:42.735 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T21:59:42.776 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T21:59:42.778 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T21:59:42.778 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:42.778 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-03T21:59:42.778 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T21:59:42.778 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T21:59:42.779 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:42.829 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T21:59:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T21:59:42.897 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:42.897 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-03T21:59:42.897 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:42.933 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T21:59:42.963 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T21:59:43.036 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T21:59:43.036 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:43.037 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-03T21:59:43.037 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T21:59:43.037 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T21:59:43.037 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:43.117 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 129/156 2024-05-03T21:59:43.145 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T21:59:43.215 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T21:59:43.215 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:43.215 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-03T21:59:43.215 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T21:59:43.215 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T21:59:43.215 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:43.279 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T21:59:43.316 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T21:59:43.413 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 132/156 2024-05-03T21:59:43.438 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T21:59:43.481 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 133/156 2024-05-03T21:59:43.506 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T21:59:43.506 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:43.507 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-03T21:59:43.507 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T21:59:43.507 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T21:59:43.507 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T21:59:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T21:59:44.483 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-05-03T21:59:44.515 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T21:59:44.585 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T21:59:44.585 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:44.586 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-03T21:59:44.586 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T21:59:44.586 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T21:59:44.586 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:44.641 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T21:59:44.711 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T21:59:44.711 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:44.711 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-03T21:59:44.711 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:44.783 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T21:59:44.858 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T21:59:44.858 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:44.858 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-03T21:59:44.858 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T21:59:44.858 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T21:59:44.858 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:45.069 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T21:59:45.096 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T21:59:45.225 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T21:59:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T21:59:45.295 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T21:59:45.295 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:45.295 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-03T21:59:45.295 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T21:59:45.295 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T21:59:45.295 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:45.460 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 129/156 2024-05-03T21:59:45.498 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T21:59:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T21:59:45.596 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:45.596 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-03T21:59:45.596 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T21:59:45.596 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T21:59:45.596 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:45.658 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T21:59:45.697 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T21:59:45.832 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 132/156 2024-05-03T21:59:45.902 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 133/156 2024-05-03T21:59:46.965 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-05-03T21:59:47.021 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T21:59:47.117 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T21:59:47.118 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:47.118 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-03T21:59:47.118 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T21:59:47.118 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T21:59:47.118 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:47.185 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T21:59:47.282 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T21:59:47.282 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:47.282 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-03T21:59:47.282 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:47.369 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T21:59:47.476 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T21:59:47.476 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:47.477 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-03T21:59:47.477 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T21:59:47.477 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T21:59:47.477 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T21:59:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T21:59:47.979 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T21:59:47.979 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-03T21:59:47.979 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T21:59:47.979 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T21:59:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:48.566 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 139/156 2024-05-03T21:59:48.622 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 140/156 2024-05-03T21:59:48.714 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 141/156 2024-05-03T21:59:48.758 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-05-03T21:59:48.807 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-05-03T21:59:49.126 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 144/156 2024-05-03T21:59:49.202 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-05-03T21:59:49.229 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 146/156 2024-05-03T21:59:50.143 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T21:59:50.194 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T21:59:50.260 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T21:59:50.337 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 139/156 2024-05-03T21:59:50.394 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 140/156 2024-05-03T21:59:50.482 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 141/156 2024-05-03T21:59:50.521 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-05-03T21:59:50.569 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-05-03T21:59:50.905 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 144/156 2024-05-03T21:59:50.964 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-05-03T21:59:50.992 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 146/156 2024-05-03T21:59:51.625 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 148/156 2024-05-03T21:59:51.750 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-05-03T21:59:51.844 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-05-03T21:59:51.859 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T21:59:51.906 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T21:59:51.971 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T21:59:52.018 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-05-03T21:59:52.090 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-05-03T21:59:52.090 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T21:59:52.225 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T21:59:52.280 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T21:59:52.281 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T21:59:52.420 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T21:59:52.552 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T21:59:52.839 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T21:59:52.839 INFO:teuthology.orchestra.run.smithi116.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-03T21:59:52.839 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T21:59:53.030 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 139/156 2024-05-03T21:59:53.094 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 140/156 2024-05-03T21:59:53.183 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 141/156 2024-05-03T21:59:53.240 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-05-03T21:59:53.278 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 148/156 2024-05-03T21:59:53.289 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-05-03T21:59:53.380 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-05-03T21:59:53.462 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-05-03T21:59:53.621 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 144/156 2024-05-03T21:59:53.629 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-05-03T21:59:53.673 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-05-03T21:59:53.678 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-05-03T21:59:53.678 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T21:59:53.701 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 146/156 2024-05-03T21:59:53.804 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T21:59:53.843 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T21:59:53.843 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T21:59:53.984 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T21:59:54.123 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T21:59:54.401 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T21:59:54.401 INFO:teuthology.orchestra.run.smithi130.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-03T21:59:54.401 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T21:59:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T21:59:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T21:59:54.655 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T21:59:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 148/156 2024-05-03T21:59:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-05-03T21:59:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-05-03T21:59:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-05-03T21:59:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-05-03T21:59:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T21:59:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T21:59:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T21:59:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T21:59:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T21:59:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T21:59:57.214 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T21:59:57.214 INFO:teuthology.orchestra.run.smithi082.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-03T21:59:57.214 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T21:59:58.490 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 1/156 2024-05-03T21:59:58.490 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2/156 2024-05-03T21:59:58.490 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 3/156 2024-05-03T21:59:58.490 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 4/156 2024-05-03T21:59:58.490 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 5/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 6/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 7/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 11/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 12/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 14/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 15/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 16/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 17/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 18/156 2024-05-03T21:59:58.491 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 19/156 2024-05-03T21:59:58.492 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 20/156 2024-05-03T21:59:58.492 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 21/156 2024-05-03T21:59:58.492 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 22/156 2024-05-03T21:59:58.492 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 23/156 2024-05-03T21:59:58.492 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 24/156 2024-05-03T21:59:58.492 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 25/156 2024-05-03T21:59:58.492 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 26/156 2024-05-03T21:59:58.492 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 27/156 2024-05-03T21:59:58.492 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 28/156 2024-05-03T21:59:58.492 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 29/156 2024-05-03T21:59:58.504 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 30/156 2024-05-03T21:59:58.504 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 31/156 2024-05-03T21:59:58.504 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 32/156 2024-05-03T21:59:58.504 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 33/156 2024-05-03T21:59:58.504 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 34/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 35/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 36/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 37/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 38/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 39/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-05-03T21:59:58.505 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-05-03T21:59:58.506 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-05-03T21:59:58.507 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-05-03T21:59:58.508 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-05-03T21:59:58.509 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-05-03T21:59:58.510 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-05-03T21:59:58.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 149/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 151/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-05-03T21:59:58.512 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T21:59:58.513 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-05-03T22:00:00.128 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 1/156 2024-05-03T22:00:00.128 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2/156 2024-05-03T22:00:00.128 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 3/156 2024-05-03T22:00:00.128 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 4/156 2024-05-03T22:00:00.128 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 5/156 2024-05-03T22:00:00.128 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 6/156 2024-05-03T22:00:00.128 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 7/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 11/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 12/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 14/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 15/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 16/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 17/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 18/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 19/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 20/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 21/156 2024-05-03T22:00:00.129 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 22/156 2024-05-03T22:00:00.130 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 23/156 2024-05-03T22:00:00.130 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 24/156 2024-05-03T22:00:00.130 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 25/156 2024-05-03T22:00:00.130 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 26/156 2024-05-03T22:00:00.130 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 27/156 2024-05-03T22:00:00.142 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 28/156 2024-05-03T22:00:00.142 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 29/156 2024-05-03T22:00:00.142 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 30/156 2024-05-03T22:00:00.142 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 31/156 2024-05-03T22:00:00.142 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 32/156 2024-05-03T22:00:00.142 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 33/156 2024-05-03T22:00:00.142 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 34/156 2024-05-03T22:00:00.142 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 35/156 2024-05-03T22:00:00.142 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 36/156 2024-05-03T22:00:00.142 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 37/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 38/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 39/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-05-03T22:00:00.143 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-05-03T22:00:00.144 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-05-03T22:00:00.145 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-05-03T22:00:00.146 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-05-03T22:00:00.147 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-05-03T22:00:00.148 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-05-03T22:00:00.149 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 149/156 2024-05-03T22:00:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-05-03T22:00:00.151 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 151/156 2024-05-03T22:00:00.151 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-05-03T22:00:00.151 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-05-03T22:00:00.151 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T22:00:00.151 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-05-03T22:00:00.943 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:00:00.943 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T22:00:00.943 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: automake-1.16.2-8.el9.noarch 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: bison-3.7.4-5.el9.x86_64 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.945 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: flex-2.6.4-9.el9.x86_64 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-03T22:00:00.946 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.947 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.948 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-03T22:00:00.948 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.948 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-03T22:00:00.948 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-03T22:00:00.948 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-03T22:00:00.948 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-03T22:00:00.948 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-03T22:00:00.948 INFO:teuthology.orchestra.run.smithi116.stdout: lua-5.4.4-4.el9.x86_64 2024-05-03T22:00:00.948 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-03T22:00:00.948 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-03T22:00:00.948 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-13.14-1.el9.x86_64 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-03T22:00:00.949 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-03T22:00:00.950 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-03T22:00:00.951 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-03T22:00:00.952 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-03T22:00:00.953 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-3.el9.x86_64 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-03T22:00:00.954 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-03T22:00:00.955 INFO:teuthology.orchestra.run.smithi116.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-03T22:00:00.955 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-03T22:00:00.955 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-03T22:00:00.955 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-03T22:00:00.955 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-05-03T22:00:00.955 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-05-03T22:00:01.579 DEBUG:teuthology.parallel:result is None 2024-05-03T22:00:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:00:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T22:00:02.559 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2024-05-03T22:00:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-03T22:00:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-03T22:00:02.559 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2024-05-03T22:00:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-03T22:00:02.559 INFO:teuthology.orchestra.run.smithi130.stdout: automake-1.16.2-8.el9.noarch 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: bison-3.7.4-5.el9.x86_64 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:02.560 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:02.561 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: flex-2.6.4-9.el9.x86_64 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.562 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-03T22:00:02.563 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: lua-5.4.4-4.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-13.14-1.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-03T22:00:02.564 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-03T22:00:02.565 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-03T22:00:02.566 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply-3.11-14.el9.noarch 2024-05-03T22:00:02.567 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-03T22:00:02.568 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-03T22:00:02.569 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-03T22:00:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: re2-1:20211101-3.el9.x86_64 2024-05-03T22:00:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-03T22:00:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-03T22:00:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-03T22:00:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-03T22:00:02.570 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-03T22:00:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-03T22:00:02.571 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T22:00:02.571 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-05-03T22:00:03.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 1/156 2024-05-03T22:00:03.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2/156 2024-05-03T22:00:03.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 3/156 2024-05-03T22:00:03.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 4/156 2024-05-03T22:00:03.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 5/156 2024-05-03T22:00:03.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 6/156 2024-05-03T22:00:03.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 7/156 2024-05-03T22:00:03.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 11/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 12/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 14/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 15/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 16/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 17/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 18/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 19/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 20/156 2024-05-03T22:00:03.057 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 21/156 2024-05-03T22:00:03.058 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 22/156 2024-05-03T22:00:03.058 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 23/156 2024-05-03T22:00:03.058 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 24/156 2024-05-03T22:00:03.058 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 25/156 2024-05-03T22:00:03.071 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 26/156 2024-05-03T22:00:03.071 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 27/156 2024-05-03T22:00:03.071 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 28/156 2024-05-03T22:00:03.071 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 29/156 2024-05-03T22:00:03.071 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 30/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 31/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 32/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 33/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 34/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 35/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 36/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 37/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 38/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 39/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-05-03T22:00:03.072 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-05-03T22:00:03.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-05-03T22:00:03.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-05-03T22:00:03.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-05-03T22:00:03.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-05-03T22:00:03.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-05-03T22:00:03.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-05-03T22:00:03.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-05-03T22:00:03.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-05-03T22:00:03.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-05-03T22:00:03.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-05-03T22:00:03.073 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-05-03T22:00:03.074 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-05-03T22:00:03.075 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-05-03T22:00:03.075 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-05-03T22:00:03.075 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-05-03T22:00:03.075 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-05-03T22:00:03.075 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-05-03T22:00:03.075 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-05-03T22:00:03.075 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-05-03T22:00:03.075 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-05-03T22:00:03.076 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-05-03T22:00:03.076 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-05-03T22:00:03.076 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-05-03T22:00:03.076 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-05-03T22:00:03.076 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-05-03T22:00:03.076 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-05-03T22:00:03.076 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-05-03T22:00:03.076 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-05-03T22:00:03.076 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-05-03T22:00:03.077 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-05-03T22:00:03.078 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-05-03T22:00:03.079 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-05-03T22:00:03.080 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 149/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-05-03T22:00:03.081 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 151/156 2024-05-03T22:00:03.082 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-05-03T22:00:03.082 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-05-03T22:00:03.082 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T22:00:03.082 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-05-03T22:00:03.172 DEBUG:teuthology.parallel:result is None 2024-05-03T22:00:05.590 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:00:05.590 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:00:05.590 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-05-03T22:00:05.590 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.590 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.590 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-03T22:00:05.590 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-03T22:00:05.590 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-05-03T22:00:05.590 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-03T22:00:05.590 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:05.591 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-03T22:00:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-03T22:00:05.593 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-03T22:00:05.594 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.14-1.el9.x86_64 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-03T22:00:05.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-03T22:00:05.597 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.598 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-03T22:00:05.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-3.el9.x86_64 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-03T22:00:05.600 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-03T22:00:05.601 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-03T22:00:05.601 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:00:05.601 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-05-03T22:00:06.264 DEBUG:teuthology.parallel:result is None 2024-05-03T22:00:06.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:00:06.477 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-03T22:00:06.533 INFO:teuthology.orchestra.run.smithi082.stdout:19.0.0-3450.g9a047fe7.el9 2024-05-03T22:00:06.533 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3450.g9a047fe7.el9 2024-05-03T22:00:06.533 INFO:teuthology.task.install:The correct ceph version 19.0.0-3450.g9a047fe7 is installed. 2024-05-03T22:00:06.535 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:00:06.747 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-03T22:00:06.807 INFO:teuthology.orchestra.run.smithi116.stdout:19.0.0-3450.g9a047fe7.el9 2024-05-03T22:00:06.807 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3450.g9a047fe7.el9 2024-05-03T22:00:06.808 INFO:teuthology.task.install:The correct ceph version 19.0.0-3450.g9a047fe7 is installed. 2024-05-03T22:00:06.809 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:00:07.029 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-03T22:00:07.083 INFO:teuthology.orchestra.run.smithi130.stdout:19.0.0-3450.g9a047fe7.el9 2024-05-03T22:00:07.083 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3450.g9a047fe7.el9 2024-05-03T22:00:07.084 INFO:teuthology.task.install:The correct ceph version 19.0.0-3450.g9a047fe7 is installed. 2024-05-03T22:00:07.085 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-03T22:00:07.085 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:00:07.086 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-03T22:00:07.155 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-05-03T22:00:07.155 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-03T22:00:07.222 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-03T22:00:07.222 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-03T22:00:07.284 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-03T22:00:07.284 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:00:07.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-05-03T22:00:07.350 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-03T22:00:07.455 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-05-03T22:00:07.455 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-05-03T22:00:07.519 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-03T22:00:07.620 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-03T22:00:07.620 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2024-05-03T22:00:07.691 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-03T22:00:07.800 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-03T22:00:07.801 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:00:07.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-03T22:00:07.865 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-03T22:00:07.968 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-05-03T22:00:07.968 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-03T22:00:08.037 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-03T22:00:08.139 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-03T22:00:08.139 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-03T22:00:08.201 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-03T22:00:08.301 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-03T22:00:08.301 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:00:08.301 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-05-03T22:00:08.376 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-03T22:00:08.478 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-05-03T22:00:08.478 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-05-03T22:00:08.541 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-03T22:00:08.651 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-03T22:00:08.651 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2024-05-03T22:00:08.714 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-03T22:00:08.815 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-03T22:00:08.914 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-05-03T22:00:08.914 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:00:08.915 INFO:tasks.cephadm:Cluster fsid is 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:00:08.915 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-03T22:00:08.915 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.82', 'mon.b': '172.21.15.116', 'mon.c': '172.21.15.130'} 2024-05-03T22:00:08.915 INFO:tasks.cephadm:First mon is mon.a on smithi082 2024-05-03T22:00:08.915 INFO:tasks.cephadm:First mgr is x 2024-05-03T22:00:08.915 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-03T22:00:08.915 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-05-03T22:00:08.982 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname $(hostname -s) 2024-05-03T22:00:09.063 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname $(hostname -s) 2024-05-03T22:00:09.127 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-03T22:00:09.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:00:09.344 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79034/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3450-g9a047fe7', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3450.g9a047fe7'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-02 00:36:37.664792', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240501.193033', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-03T22:00:09.568 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-rishabh-testing-20240501.193033, sha1 9a047fe7599a549042d06a3fb5b6813a203eabea from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:00:09.570 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm 2024-05-03T22:00:09.570 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-03T22:00:10.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 782467 May 3 22:00 /home/ubuntu/cephtest/cephadm 2024-05-03T22:00:10.231 DEBUG:teuthology.orchestra.run.smithi116:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-03T22:00:10.901 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r--. 1 ubuntu ubuntu 782467 May 3 22:00 /home/ubuntu/cephtest/cephadm 2024-05-03T22:00:10.901 DEBUG:teuthology.orchestra.run.smithi130:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-03T22:00:12.853 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r--. 1 ubuntu ubuntu 782467 May 3 22:00 /home/ubuntu/cephtest/cephadm 2024-05-03T22:00:12.853 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-03T22:00:12.904 DEBUG:teuthology.orchestra.run.smithi116:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-03T22:00:12.961 DEBUG:teuthology.orchestra.run.smithi130:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-03T22:00:13.036 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea on all hosts... 2024-05-03T22:00:13.037 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea pull 2024-05-03T22:00:13.044 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea pull 2024-05-03T22:00:13.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea pull 2024-05-03T22:00:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T22:00:15.171 INFO:teuthology.orchestra.run.smithi130.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T22:00:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T22:00:51.335 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-05-03T22:00:51.335 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T22:00:51.335 INFO:teuthology.orchestra.run.smithi130.stdout: "image_id": "ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012", 2024-05-03T22:00:51.335 INFO:teuthology.orchestra.run.smithi130.stdout: "repo_digests": [ 2024-05-03T22:00:51.335 INFO:teuthology.orchestra.run.smithi130.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd" 2024-05-03T22:00:51.335 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-05-03T22:00:51.335 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-05-03T22:00:54.040 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-05-03T22:00:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T22:00:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "image_id": "ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012", 2024-05-03T22:00:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "repo_digests": [ 2024-05-03T22:00:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd" 2024-05-03T22:00:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-05-03T22:00:54.041 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-05-03T22:01:03.060 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:01:03.060 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T22:01:03.060 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012", 2024-05-03T22:01:03.060 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-05-03T22:01:03.060 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd" 2024-05-03T22:01:03.060 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-03T22:01:03.060 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:01:03.125 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-05-03T22:01:03.213 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph 2024-05-03T22:01:03.304 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph 2024-05-03T22:01:03.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-05-03T22:01:03.483 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /etc/ceph 2024-05-03T22:01:03.571 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /etc/ceph 2024-05-03T22:01:03.659 INFO:tasks.cephadm:Writing seed config... 2024-05-03T22:01:03.660 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-03T22:01:03.660 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-03T22:01:03.660 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-03T22:01:03.660 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-03T22:01:03.660 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-03T22:01:03.660 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-03T22:01:03.660 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-03T22:01:03.660 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-03T22:01:03.660 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-03T22:01:03.661 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-03T22:01:03.662 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-03T22:01:03.663 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-03T22:01:03.663 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-03T22:01:03.663 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-03T22:01:03.663 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-03T22:01:03.663 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-03T22:01:03.663 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-03T22:01:03.664 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:01:03.664 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-03T22:01:03.722 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 81cd0262-0998-11ef-bc97-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-03T22:01:03.722 DEBUG:teuthology.orchestra.run.smithi082:mon.a> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.a.service 2024-05-03T22:01:03.770 DEBUG:teuthology.orchestra.run.smithi082:mgr.x> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.x.service 2024-05-03T22:01:03.817 INFO:tasks.cephadm:Bootstrapping... 2024-05-03T22:01:03.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea -v bootstrap --fsid 81cd0262-0998-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.82 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:01:04.088 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-05-03T22:01:04.088 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea', '-v', 'bootstrap', '--fsid', '81cd0262-0998-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.82', '--skip-admin-label'] 2024-05-03T22:01:04.088 INFO:teuthology.orchestra.run.smithi082.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-03T22:01:04.089 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying podman|docker is present... 2024-05-03T22:01:04.143 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-03T22:01:04.144 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying lvm2 is present... 2024-05-03T22:01:04.144 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying time synchronization is in place... 2024-05-03T22:01:04.162 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-03T22:01:04.163 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-03T22:01:04.182 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-03T22:01:04.182 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-03T22:01:04.205 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-05-03T22:01:04.225 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-05-03T22:01:04.226 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-05-03T22:01:04.226 INFO:teuthology.orchestra.run.smithi082.stdout:Repeating the final host check... 2024-05-03T22:01:04.285 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-03T22:01:04.286 INFO:teuthology.orchestra.run.smithi082.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-03T22:01:04.286 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl is present 2024-05-03T22:01:04.286 INFO:teuthology.orchestra.run.smithi082.stdout:lvcreate is present 2024-05-03T22:01:04.302 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-03T22:01:04.302 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-03T22:01:04.317 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-03T22:01:04.317 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-03T22:01:04.334 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-05-03T22:01:04.352 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-05-03T22:01:04.352 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-05-03T22:01:04.352 INFO:teuthology.orchestra.run.smithi082.stdout:Host looks OK 2024-05-03T22:01:04.352 INFO:teuthology.orchestra.run.smithi082.stdout:Cluster fsid: 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:01:04.352 INFO:teuthology.orchestra.run.smithi082.stdout:Acquiring lock 139646139911472 on /run/cephadm/81cd0262-0998-11ef-bc97-c7b262605968.lock 2024-05-03T22:01:04.353 INFO:teuthology.orchestra.run.smithi082.stdout:Lock 139646139911472 acquired on /run/cephadm/81cd0262-0998-11ef-bc97-c7b262605968.lock 2024-05-03T22:01:04.353 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 3300 ... 2024-05-03T22:01:04.353 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 6789 ... 2024-05-03T22:01:04.354 INFO:teuthology.orchestra.run.smithi082.stdout:Base mon IP(s) is [172.21.15.82:3300, 172.21.15.82:6789], mon addrv is [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-05-03T22:01:04.362 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.82 metric 100 2024-05-03T22:01:04.362 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.82 metric 100 2024-05-03T22:01:04.370 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-03T22:01:04.370 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-03T22:01:04.370 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1790sec hoplimit 64 pref medium 2024-05-03T22:01:04.377 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-03T22:01:04.377 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-03T22:01:04.377 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-03T22:01:04.377 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-03T22:01:04.377 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-05-03T22:01:04.377 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-03T22:01:04.378 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-05-03T22:01:04.378 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-05-03T22:01:04.378 INFO:teuthology.orchestra.run.smithi082.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-03T22:01:04.379 INFO:teuthology.orchestra.run.smithi082.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-03T22:01:04.380 INFO:teuthology.orchestra.run.smithi082.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T22:01:05.056 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 2024-05-03T22:01:05.056 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T22:01:05.057 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Getting image source signatures 2024-05-03T22:01:05.057 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:8173fd91c96404ae0424bb08037c57749051dcbdfaeee9354a65e201dad7b0e2 2024-05-03T22:01:05.057 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:e2f2fd2adca92139da4b4b907fa90a6775d3eb4eddaa977c42ef37c66eea70bd 2024-05-03T22:01:05.057 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying config sha256:ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 2024-05-03T22:01:05.057 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-03T22:01:15.685 INFO:teuthology.orchestra.run.smithi082.stdout:ceph: stdout ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev) 2024-05-03T22:01:15.686 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph version: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev) 2024-05-03T22:01:15.686 INFO:teuthology.orchestra.run.smithi082.stdout:Extracting ceph user uid/gid from container image... 2024-05-03T22:01:16.905 INFO:teuthology.orchestra.run.smithi082.stdout:stat: stdout 167 167 2024-05-03T22:01:16.905 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial keys... 2024-05-03T22:01:18.076 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQCtXjVmJHjNFhAA7m6xSTNSBcsUGXjMtsVoNg== 2024-05-03T22:01:19.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQCuXjVmFI1pIBAAtFUblvT6N7qILmd7qYCt1A== 2024-05-03T22:01:21.297 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQCvXjVmoC4RKBAAEMPwY9tWgrsbvfxh4Z4i+A== 2024-05-03T22:01:21.299 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial monmap... 2024-05-03T22:01:22.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-03T22:01:22.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-03T22:01:22.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:01:22.553 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-03T22:01:22.553 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool for a [v2:172.21.15.82:3300,v1:172.21.15.82:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-03T22:01:22.554 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = quincy 2024-05-03T22:01:22.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: set fsid to 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:01:22.554 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-03T22:01:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:01:22.554 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mon... 2024-05-03T22:01:23.771 INFO:teuthology.orchestra.run.smithi082.stdout:create mon.a on 2024-05-03T22:01:24.125 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-03T22:01:24.374 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-03T22:01:24.676 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-81cd0262-0998-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-81cd0262-0998-11ef-bc97-c7b262605968.target. 2024-05-03T22:01:24.677 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-81cd0262-0998-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-81cd0262-0998-11ef-bc97-c7b262605968.target. 2024-05-03T22:01:25.074 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.a 2024-05-03T22:01:25.075 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-03T22:01:25.359 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-81cd0262-0998-11ef-bc97-c7b262605968.target.wants/ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-81cd0262-0998-11ef-bc97-c7b262605968@.service. 2024-05-03T22:01:26.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:25 smithi082 podman[28007]: 2024-05-03 22:01:25.764569523 +0000 UTC m=+0.139392645 container create 69f23c514178752c899daa20257fe94294d720d0158d02c7b03ebf0d88eb6eeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-03T22:01:26.589 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T22:01:26.589 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-05-03T22:01:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T22:01:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-03T22:01:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-05-03T22:01:26.605 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-05-03T22:01:26.607 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon to start... 2024-05-03T22:01:26.607 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon... 2024-05-03T22:01:26.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:26 smithi082 podman[28007]: 2024-05-03 22:01:26.468667589 +0000 UTC m=+0.843490715 container init 69f23c514178752c899daa20257fe94294d720d0158d02c7b03ebf0d88eb6eeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-05-03T22:01:26.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:26 smithi082 podman[28007]: 2024-05-03 22:01:26.47942559 +0000 UTC m=+0.854248713 container start 69f23c514178752c899daa20257fe94294d720d0158d02c7b03ebf0d88eb6eeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-03T22:01:26.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:26 smithi082 ceph-mon[28025]: mkfs 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:01:26.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:26 smithi082 bash[28007]: 69f23c514178752c899daa20257fe94294d720d0158d02c7b03ebf0d88eb6eeb 2024-05-03T22:01:26.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:26 smithi082 ceph-mon[28025]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-03T22:01:26.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:26 smithi082 systemd[1]: Started Ceph mon.a for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:01:27.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-03T22:01:27.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: monmap epoch 1 2024-05-03T22:01:27.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:01:27.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: last_changed 2024-05-03T22:01:21.829502+0000 2024-05-03T22:01:27.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: created 2024-05-03T22:01:21.829502+0000 2024-05-03T22:01:27.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: min_mon_release 19 (squid) 2024-05-03T22:01:27.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: election_strategy: 1 2024-05-03T22:01:27.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-03T22:01:27.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: fsmap 2024-05-03T22:01:27.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: osdmap e1: 0 total, 0 up, 0 in 2024-05-03T22:01:27.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: mgrmap e1: no daemons active 2024-05-03T22:01:27.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:27 smithi082 ceph-mon[28025]: from='client.? 172.21.15.82:0/1825547291' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-03T22:01:28.124 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout cluster: 2024-05-03T22:01:28.132 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout id: 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:01:28.132 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-03T22:01:28.132 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:28.132 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout services: 2024-05-03T22:01:28.132 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.821462s) 2024-05-03T22:01:28.132 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-03T22:01:28.133 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-03T22:01:28.133 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:28.133 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout data: 2024-05-03T22:01:28.133 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-03T22:01:28.133 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-03T22:01:28.133 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-03T22:01:28.133 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pgs: 2024-05-03T22:01:28.133 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:28.133 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.283+0000 7f6c3f200700 1 Processor -- start 2024-05-03T22:01:28.133 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.283+0000 7f6c3f200700 1 -- start start 2024-05-03T22:01:28.134 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.284+0000 7f6c3f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4007d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:28.134 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.284+0000 7f6c3f200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4007d8e0 con 0x7f6c4007eeb0 2024-05-03T22:01:28.134 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.285+0000 7f6c3de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4007d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:28.134 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.285+0000 7f6c3de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4007d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39608/0 (socket says 172.21.15.82:39608) 2024-05-03T22:01:28.134 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.285+0000 7f6c3de00700 1 -- 172.21.15.82:0/3973187385 learned_addr learned my addr 172.21.15.82:0/3973187385 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:28.134 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.286+0000 7f6c3de00700 1 -- 172.21.15.82:0/3973187385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4007da60 con 0x7f6c4007eeb0 2024-05-03T22:01:28.134 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.286+0000 7f6c3de00700 1 --2- 172.21.15.82:0/3973187385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4007d310 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6c300098a0 tx=0x7f6c30009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f6b06b83985167 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:28.134 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.286+0000 7f6c3d400700 1 -- 172.21.15.82:0/3973187385 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c30004160 con 0x7f6c4007eeb0 2024-05-03T22:01:28.134 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.287+0000 7f6c3d400700 1 -- 172.21.15.82:0/3973187385 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c30004300 con 0x7f6c4007eeb0 2024-05-03T22:01:28.134 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.287+0000 7f6c3d400700 1 -- 172.21.15.82:0/3973187385 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c300036a0 con 0x7f6c4007eeb0 2024-05-03T22:01:28.135 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.287+0000 7f6c3f200700 1 -- 172.21.15.82:0/3973187385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 msgr2=0x7f6c4007d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:28.135 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.287+0000 7f6c3f200700 1 --2- 172.21.15.82:0/3973187385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4007d310 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6c300098a0 tx=0x7f6c30009bb0 comp rx=0 tx=0).stop 2024-05-03T22:01:28.135 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.287+0000 7f6c3f200700 1 -- 172.21.15.82:0/3973187385 shutdown_connections 2024-05-03T22:01:28.135 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.287+0000 7f6c3f200700 1 --2- 172.21.15.82:0/3973187385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4007d310 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:28.135 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.287+0000 7f6c3f200700 1 -- 172.21.15.82:0/3973187385 >> 172.21.15.82:0/3973187385 conn(0x7f6c401040f0 msgr2=0x7f6c40106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:28.135 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.287+0000 7f6c3f200700 1 -- 172.21.15.82:0/3973187385 shutdown_connections 2024-05-03T22:01:28.135 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.288+0000 7f6c3f200700 1 -- 172.21.15.82:0/3973187385 wait complete. 2024-05-03T22:01:28.135 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.289+0000 7f6c3f200700 1 Processor -- start 2024-05-03T22:01:28.135 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.289+0000 7f6c3f200700 1 -- start start 2024-05-03T22:01:28.135 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.289+0000 7f6c3f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4019e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:28.135 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.289+0000 7f6c3f200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4007df90 con 0x7f6c4007eeb0 2024-05-03T22:01:28.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.289+0000 7f6c3de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4019e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:28.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.289+0000 7f6c3de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4019e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39622/0 (socket says 172.21.15.82:39622) 2024-05-03T22:01:28.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.289+0000 7f6c3de00700 1 -- 172.21.15.82:0/1825547291 learned_addr learned my addr 172.21.15.82:0/1825547291 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:28.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.290+0000 7f6c3de00700 1 -- 172.21.15.82:0/1825547291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4019e900 con 0x7f6c4007eeb0 2024-05-03T22:01:28.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.290+0000 7f6c3de00700 1 --2- 172.21.15.82:0/1825547291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4019e3c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6c30000c00 tx=0x7f6c30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:28.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.290+0000 7f6c37400700 1 -- 172.21.15.82:0/1825547291 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c30003db0 con 0x7f6c4007eeb0 2024-05-03T22:01:28.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.290+0000 7f6c37400700 1 -- 172.21.15.82:0/1825547291 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c30011630 con 0x7f6c4007eeb0 2024-05-03T22:01:28.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.290+0000 7f6c37400700 1 -- 172.21.15.82:0/1825547291 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c30011950 con 0x7f6c4007eeb0 2024-05-03T22:01:28.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.290+0000 7f6c3f200700 1 -- 172.21.15.82:0/1825547291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4019eb90 con 0x7f6c4007eeb0 2024-05-03T22:01:28.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.291+0000 7f6c3f200700 1 -- 172.21.15.82:0/1825547291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c401a1880 con 0x7f6c4007eeb0 2024-05-03T22:01:28.136 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.291+0000 7f6c37400700 1 -- 172.21.15.82:0/1825547291 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c30011af0 con 0x7f6c4007eeb0 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.291+0000 7f6c37400700 1 -- 172.21.15.82:0/1825547291 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6c3001c450 con 0x7f6c4007eeb0 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.292+0000 7f6c3f200700 1 -- 172.21.15.82:0/1825547291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c40064b00 con 0x7f6c4007eeb0 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.295+0000 7f6c37400700 1 -- 172.21.15.82:0/1825547291 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6c30032020 con 0x7f6c4007eeb0 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.374+0000 7f6c3f200700 1 -- 172.21.15.82:0/1825547291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f6c4002e690 con 0x7f6c4007eeb0 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.375+0000 7f6c37400700 1 -- 172.21.15.82:0/1825547291 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f6c30004260 con 0x7f6c4007eeb0 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.376+0000 7f6c3f200700 1 -- 172.21.15.82:0/1825547291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 msgr2=0x7f6c4019e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.376+0000 7f6c3f200700 1 --2- 172.21.15.82:0/1825547291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4019e3c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6c30000c00 tx=0x7f6c30004750 comp rx=0 tx=0).stop 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.376+0000 7f6c3f200700 1 -- 172.21.15.82:0/1825547291 shutdown_connections 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.376+0000 7f6c3f200700 1 --2- 172.21.15.82:0/1825547291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c4007eeb0 0x7f6c4019e3c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.376+0000 7f6c3f200700 1 -- 172.21.15.82:0/1825547291 >> 172.21.15.82:0/1825547291 conn(0x7f6c401040f0 msgr2=0x7f6c40106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.376+0000 7f6c3f200700 1 -- 172.21.15.82:0/1825547291 shutdown_connections 2024-05-03T22:01:28.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:27.376+0000 7f6c3f200700 1 -- 172.21.15.82:0/1825547291 wait complete. 2024-05-03T22:01:28.138 INFO:teuthology.orchestra.run.smithi082.stdout:mon is available 2024-05-03T22:01:28.138 INFO:teuthology.orchestra.run.smithi082.stdout:Assimilating anything we can from ceph.conf... 2024-05-03T22:01:28.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:28 smithi082 ceph-mon[28025]: from='client.? 172.21.15.82:0/3514777938' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-03T22:01:28.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:28 smithi082 ceph-mon[28025]: from='client.? 172.21.15.82:0/3514777938' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-03T22:01:29.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:29.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-05-03T22:01:29.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:01:29.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-03T22:01:29.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-05-03T22:01:29.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-03T22:01:29.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-03T22:01:29.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-03T22:01:29.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.717+0000 7f607ea00700 1 Processor -- start 2024-05-03T22:01:29.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.717+0000 7f607ea00700 1 -- start start 2024-05-03T22:01:29.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.717+0000 7f607ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781120d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:29.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.718+0000 7f607ea00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6078083590 con 0x7f607810fce0 2024-05-03T22:01:29.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.718+0000 7f6077e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:29.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.718+0000 7f6077e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39626/0 (socket says 172.21.15.82:39626) 2024-05-03T22:01:29.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.718+0000 7f6077e00700 1 -- 172.21.15.82:0/284933259 learned_addr learned my addr 172.21.15.82:0/284933259 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:29.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.719+0000 7f6077e00700 1 -- 172.21.15.82:0/284933259 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6078112610 con 0x7f607810fce0 2024-05-03T22:01:29.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.719+0000 7f6077e00700 1 --2- 172.21.15.82:0/284933259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781120d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f60680098a0 tx=0x7f6068009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370eb1c1ef3663da server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:29.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.719+0000 7f6077400700 1 -- 172.21.15.82:0/284933259 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6068004160 con 0x7f607810fce0 2024-05-03T22:01:29.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.719+0000 7f6077400700 1 -- 172.21.15.82:0/284933259 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6068004300 con 0x7f607810fce0 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.719+0000 7f6077400700 1 -- 172.21.15.82:0/284933259 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60680036a0 con 0x7f607810fce0 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.720+0000 7f607ea00700 1 -- 172.21.15.82:0/284933259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 msgr2=0x7f60781120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.720+0000 7f607ea00700 1 --2- 172.21.15.82:0/284933259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781120d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f60680098a0 tx=0x7f6068009bb0 comp rx=0 tx=0).stop 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.720+0000 7f607ea00700 1 -- 172.21.15.82:0/284933259 shutdown_connections 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.720+0000 7f607ea00700 1 --2- 172.21.15.82:0/284933259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781120d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.720+0000 7f607ea00700 1 -- 172.21.15.82:0/284933259 >> 172.21.15.82:0/284933259 conn(0x7f607807e2f0 msgr2=0x7f6078080730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.720+0000 7f607ea00700 1 -- 172.21.15.82:0/284933259 shutdown_connections 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.720+0000 7f607ea00700 1 -- 172.21.15.82:0/284933259 wait complete. 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.721+0000 7f607ea00700 1 Processor -- start 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.721+0000 7f607ea00700 1 -- start start 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.722+0000 7f607ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781a2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:29.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.722+0000 7f607ea00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6078112b40 con 0x7f607810fce0 2024-05-03T22:01:29.538 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.722+0000 7f6077e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:29.538 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.722+0000 7f6077e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781a2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39640/0 (socket says 172.21.15.82:39640) 2024-05-03T22:01:29.538 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.722+0000 7f6077e00700 1 -- 172.21.15.82:0/3514777938 learned_addr learned my addr 172.21.15.82:0/3514777938 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:29.538 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.722+0000 7f6077e00700 1 -- 172.21.15.82:0/3514777938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60781a2ed0 con 0x7f607810fce0 2024-05-03T22:01:29.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.723+0000 7f6077e00700 1 --2- 172.21.15.82:0/3514777938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781a2990 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6068000c00 tx=0x7f6068004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:29.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.723+0000 7f6075600700 1 -- 172.21.15.82:0/3514777938 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6068003db0 con 0x7f607810fce0 2024-05-03T22:01:29.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.723+0000 7f6075600700 1 -- 172.21.15.82:0/3514777938 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6068011630 con 0x7f607810fce0 2024-05-03T22:01:29.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.723+0000 7f607ea00700 1 -- 172.21.15.82:0/3514777938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60781a3160 con 0x7f607810fce0 2024-05-03T22:01:29.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.723+0000 7f6075600700 1 -- 172.21.15.82:0/3514777938 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6068011950 con 0x7f607810fce0 2024-05-03T22:01:29.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.723+0000 7f607ea00700 1 -- 172.21.15.82:0/3514777938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60781a5e50 con 0x7f607810fce0 2024-05-03T22:01:29.541 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.723+0000 7f6075600700 1 -- 172.21.15.82:0/3514777938 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f606801a460 con 0x7f607810fce0 2024-05-03T22:01:29.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.723+0000 7f6075600700 1 -- 172.21.15.82:0/3514777938 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f606801b7d0 con 0x7f607810fce0 2024-05-03T22:01:29.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.724+0000 7f607ea00700 1 -- 172.21.15.82:0/3514777938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6078064b00 con 0x7f607810fce0 2024-05-03T22:01:29.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.727+0000 7f6075600700 1 -- 172.21.15.82:0/3514777938 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f606801b9d0 con 0x7f607810fce0 2024-05-03T22:01:29.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.803+0000 7f607ea00700 1 -- 172.21.15.82:0/3514777938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f607802e7d0 con 0x7f607810fce0 2024-05-03T22:01:29.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.809+0000 7f6075600700 1 -- 172.21.15.82:0/3514777938 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f606801bbb0 con 0x7f607810fce0 2024-05-03T22:01:29.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.809+0000 7f6075600700 1 -- 172.21.15.82:0/3514777938 <== mon.0 v2:172.21.15.82:3300/0 8 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f606801be30 con 0x7f607810fce0 2024-05-03T22:01:29.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.810+0000 7f607ea00700 1 -- 172.21.15.82:0/3514777938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 msgr2=0x7f60781a2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:29.542 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.810+0000 7f607ea00700 1 --2- 172.21.15.82:0/3514777938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781a2990 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6068000c00 tx=0x7f6068004750 comp rx=0 tx=0).stop 2024-05-03T22:01:29.543 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.810+0000 7f607ea00700 1 -- 172.21.15.82:0/3514777938 shutdown_connections 2024-05-03T22:01:29.543 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.810+0000 7f607ea00700 1 --2- 172.21.15.82:0/3514777938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f607810fce0 0x7f60781a2990 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:29.543 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.810+0000 7f607ea00700 1 -- 172.21.15.82:0/3514777938 >> 172.21.15.82:0/3514777938 conn(0x7f607807e2f0 msgr2=0x7f60780805e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:29.543 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.811+0000 7f607ea00700 1 -- 172.21.15.82:0/3514777938 shutdown_connections 2024-05-03T22:01:29.543 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:28.811+0000 7f607ea00700 1 -- 172.21.15.82:0/3514777938 wait complete. 2024-05-03T22:01:29.543 INFO:teuthology.orchestra.run.smithi082.stdout:Generating new minimal ceph.conf... 2024-05-03T22:01:30.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:30 smithi082 ceph-mon[28025]: from='client.? 172.21.15.82:0/1607125797' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:01:30.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.128+0000 7f066a000700 1 Processor -- start 2024-05-03T22:01:30.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.128+0000 7f066a000700 1 -- start start 2024-05-03T22:01:30.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.129+0000 7f066a000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f0664107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.129+0000 7f066a000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f066407ce60 con 0x7f0664107600 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.129+0000 7f0663400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f0664107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.129+0000 7f0663400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f0664107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39652/0 (socket says 172.21.15.82:39652) 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.129+0000 7f0663400700 1 -- 172.21.15.82:0/4278512582 learned_addr learned my addr 172.21.15.82:0/4278512582 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.130+0000 7f0663400700 1 -- 172.21.15.82:0/4278512582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0664107f60 con 0x7f0664107600 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.130+0000 7f0663400700 1 --2- 172.21.15.82:0/4278512582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f0664107a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f06540098a0 tx=0x7f0654009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e8ed5692cb9a6b server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.131+0000 7f0662000700 1 -- 172.21.15.82:0/4278512582 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0654004160 con 0x7f0664107600 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.131+0000 7f0662000700 1 -- 172.21.15.82:0/4278512582 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0654004300 con 0x7f0664107600 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.131+0000 7f0662000700 1 -- 172.21.15.82:0/4278512582 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06540119e0 con 0x7f0664107600 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.131+0000 7f066a000700 1 -- 172.21.15.82:0/4278512582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 msgr2=0x7f0664107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.131+0000 7f066a000700 1 --2- 172.21.15.82:0/4278512582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f0664107a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f06540098a0 tx=0x7f0654009bb0 comp rx=0 tx=0).stop 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.132+0000 7f066a000700 1 -- 172.21.15.82:0/4278512582 shutdown_connections 2024-05-03T22:01:30.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.132+0000 7f066a000700 1 --2- 172.21.15.82:0/4278512582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f0664107a20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.132+0000 7f066a000700 1 -- 172.21.15.82:0/4278512582 >> 172.21.15.82:0/4278512582 conn(0x7f0664103200 msgr2=0x7f0664105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.132+0000 7f066a000700 1 -- 172.21.15.82:0/4278512582 shutdown_connections 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.132+0000 7f066a000700 1 -- 172.21.15.82:0/4278512582 wait complete. 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.133+0000 7f066a000700 1 Processor -- start 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.133+0000 7f066a000700 1 -- start start 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.134+0000 7f066a000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f066419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.134+0000 7f066a000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0664108ec0 con 0x7f0664107600 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.134+0000 7f0663400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f066419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.134+0000 7f0663400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f066419ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39668/0 (socket says 172.21.15.82:39668) 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.134+0000 7f0663400700 1 -- 172.21.15.82:0/1607125797 learned_addr learned my addr 172.21.15.82:0/1607125797 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.134+0000 7f0663400700 1 -- 172.21.15.82:0/1607125797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066419f260 con 0x7f0664107600 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.135+0000 7f0663400700 1 --2- 172.21.15.82:0/1607125797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f066419ed20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f06540116a0 tx=0x7f06540046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:30.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.135+0000 7f065be00700 1 -- 172.21.15.82:0/1607125797 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0654003b70 con 0x7f0664107600 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.135+0000 7f065be00700 1 -- 172.21.15.82:0/1607125797 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f065401a8a0 con 0x7f0664107600 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.135+0000 7f066a000700 1 -- 172.21.15.82:0/1607125797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066419f4f0 con 0x7f0664107600 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.135+0000 7f065be00700 1 -- 172.21.15.82:0/1607125797 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0654024890 con 0x7f0664107600 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.135+0000 7f066a000700 1 -- 172.21.15.82:0/1607125797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06641a21d0 con 0x7f0664107600 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.135+0000 7f065be00700 1 -- 172.21.15.82:0/1607125797 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0654022020 con 0x7f0664107600 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.135+0000 7f065be00700 1 -- 172.21.15.82:0/1607125797 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f06540193c0 con 0x7f0664107600 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.137+0000 7f066a000700 1 -- 172.21.15.82:0/1607125797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0664064b00 con 0x7f0664107600 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.139+0000 7f065be00700 1 -- 172.21.15.82:0/1607125797 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f065402ddf0 con 0x7f0664107600 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.216+0000 7f066a000700 1 -- 172.21.15.82:0/1607125797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f066402e760 con 0x7f0664107600 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.217+0000 7f065be00700 1 -- 172.21.15.82:0/1607125797 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f065401aa50 con 0x7f0664107600 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.218+0000 7f066a000700 1 -- 172.21.15.82:0/1607125797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 msgr2=0x7f066419ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.218+0000 7f066a000700 1 --2- 172.21.15.82:0/1607125797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f066419ed20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f06540116a0 tx=0x7f06540046a0 comp rx=0 tx=0).stop 2024-05-03T22:01:30.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.218+0000 7f066a000700 1 -- 172.21.15.82:0/1607125797 shutdown_connections 2024-05-03T22:01:30.893 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.218+0000 7f066a000700 1 --2- 172.21.15.82:0/1607125797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0664107600 0x7f066419ed20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:30.893 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.218+0000 7f066a000700 1 -- 172.21.15.82:0/1607125797 >> 172.21.15.82:0/1607125797 conn(0x7f0664103200 msgr2=0x7f06641959c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:30.893 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.219+0000 7f066a000700 1 -- 172.21.15.82:0/1607125797 shutdown_connections 2024-05-03T22:01:30.893 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:30.219+0000 7f066a000700 1 -- 172.21.15.82:0/1607125797 wait complete. 2024-05-03T22:01:30.893 INFO:teuthology.orchestra.run.smithi082.stdout:Restarting the monitor... 2024-05-03T22:01:31.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:30 smithi082 systemd[1]: Stopping Ceph mon.a for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:01:31.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:31 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a[28021]: 2024-05-03T22:01:31.323+0000 7fc124a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:01:31.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:31 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a[28021]: 2024-05-03T22:01:31.323+0000 7fc124a00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-03T22:01:31.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:31 smithi082 podman[28277]: 2024-05-03 22:01:31.46659416 +0000 UTC m=+0.284265547 container died 69f23c514178752c899daa20257fe94294d720d0158d02c7b03ebf0d88eb6eeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-03T22:01:32.409 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:32 smithi082 podman[28277]: 2024-05-03 22:01:32.164723853 +0000 UTC m=+0.982395257 container cleanup 69f23c514178752c899daa20257fe94294d720d0158d02c7b03ebf0d88eb6eeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-03T22:01:32.409 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:32 smithi082 bash[28277]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a 2024-05-03T22:01:32.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:32 smithi082 podman[28291]: 2024-05-03 22:01:32.407502151 +0000 UTC m=+0.925365463 container remove 69f23c514178752c899daa20257fe94294d720d0158d02c7b03ebf0d88eb6eeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-05-03T22:01:33.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:32 smithi082 systemd[1]: ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-03T22:01:33.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:32 smithi082 systemd[1]: Stopped Ceph mon.a for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:01:33.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:32 smithi082 systemd[1]: ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.a.service: Consumed 1.788s CPU time. 2024-05-03T22:01:33.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:32 smithi082 systemd[1]: Starting Ceph mon.a for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:01:33.510 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 podman[28386]: 2024-05-03 22:01:33.164560534 +0000 UTC m=+0.034216106 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:01:33.510 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 podman[28386]: 2024-05-03 22:01:33.358551802 +0000 UTC m=+0.228207412 container create 7441df8970a66781196012546ef2983836624e855e2ce8900d1a94679f3f25f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:01:33.715 INFO:teuthology.orchestra.run.smithi082.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-03T22:01:33.764 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 podman[28386]: 2024-05-03 22:01:33.629166934 +0000 UTC m=+0.498822577 container init 7441df8970a66781196012546ef2983836624e855e2ce8900d1a94679f3f25f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-05-03T22:01:33.764 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 podman[28386]: 2024-05-03 22:01:33.639921625 +0000 UTC m=+0.509577242 container start 7441df8970a66781196012546ef2983836624e855e2ce8900d1a94679f3f25f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430) 2024-05-03T22:01:33.764 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: set uid:gid to 167:167 (ceph:ceph) 2024-05-03T22:01:33.764 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev), process ceph-mon, pid 2 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: pidfile_write: ignore empty --pid-file 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: load: jerasure load: lrc 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: RocksDB version: 7.9.2 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Git sha 0 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Compile date 2024-05-01 21:12:03 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: DB SUMMARY 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: DB Session ID: 24OVQQQHOOEZJZI1J08Y 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: CURRENT file: CURRENT 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: IDENTITY file: IDENTITY 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104134 ; 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.error_if_exists: 0 2024-05-03T22:01:33.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.create_if_missing: 0 2024-05-03T22:01:33.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.paranoid_checks: 1 2024-05-03T22:01:33.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-03T22:01:33.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-03T22:01:33.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-03T22:01:33.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.env: 0x564773482cc0 2024-05-03T22:01:33.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.fs: PosixFileSystem 2024-05-03T22:01:33.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.info_log: 0x5647a057fde0 2024-05-03T22:01:33.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_file_opening_threads: 16 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.statistics: (nil) 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.use_fsync: 0 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_log_file_size: 0 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.keep_log_file_num: 1000 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.recycle_log_file_num: 0 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.allow_fallocate: 1 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.allow_mmap_reads: 0 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.allow_mmap_writes: 0 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.use_direct_reads: 0 2024-05-03T22:01:33.768 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.create_missing_column_families: 0 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.db_log_dir: 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.wal_dir: 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.advise_random_on_open: 1 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.db_write_buffer_size: 0 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.write_buffer_manager: 0x5647a05510e0 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-03T22:01:33.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.rate_limiter: (nil) 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.wal_recovery_mode: 2 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.enable_thread_tracking: 0 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.enable_pipelined_write: 0 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.unordered_write: 0 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.row_cache: None 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.wal_filter: None 2024-05-03T22:01:33.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.allow_ingest_behind: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.two_write_queues: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.manual_wal_flush: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.wal_compression: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.atomic_flush: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.log_readahead_size: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.best_efforts_recovery: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.allow_data_in_errors: 0 2024-05-03T22:01:33.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.db_host_id: __hostname__ 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_background_jobs: 2 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_background_compactions: -1 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_subcompactions: 1 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_total_wal_size: 0 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_open_files: -1 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bytes_per_sync: 0 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-03T22:01:33.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_readahead_size: 0 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_background_flushes: -1 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Compression algorithms supported: 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: kZSTD supported: 0 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: kXpressCompression supported: 0 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: kLZ4HCCompression supported: 1 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: kZlibCompression supported: 1 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: kSnappyCompression supported: 1 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: kLZ4Compression supported: 1 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: kBZip2Compression supported: 0 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-03T22:01:33.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.merge_operator: 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_filter: None 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_filter_factory: None 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.sst_partitioner_factory: None 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5647a057ffa0) 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-05-03T22:01:33.774 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_type: 0 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_index_type: 0 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_shortening: 1 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: checksum: 4 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: no_block_cache: 0 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache: 0x5647a05831f0 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_options: 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: capacity : 536870912 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_shard_bits : 4 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: strict_capacity_limit : 0 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_compressed: (nil) 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: persistent_cache: (nil) 2024-05-03T22:01:33.775 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size: 4096 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size_deviation: 10 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_restart_interval: 16 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_block_restart_interval: 1 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: metadata_block_size: 4096 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: partition_filters: 0 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: use_delta_encoding: 1 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: filter_policy: bloomfilter 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: whole_key_filtering: 1 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: verify_compression: 0 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: format_version: 5 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_index_compression: 1 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_align: 0 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: max_auto_readahead_size: 262144 2024-05-03T22:01:33.776 INFO:journalctl@ceph.mon.a.smithi082.stdout: prepopulate_block_cache: 0 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout: initial_auto_readahead_size: 8192 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.write_buffer_size: 33554432 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_write_buffer_number: 2 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compression: NoCompression 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bottommost_compression: Disabled 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.prefix_extractor: nullptr 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.num_levels: 7 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-03T22:01:33.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compression_opts.level: 32767 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compression_opts.strategy: 0 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-03T22:01:33.778 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compression_opts.enabled: false 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.target_file_size_base: 67108864 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-03T22:01:33.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.arena_block_size: 1048576 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.disable_auto_compactions: 0 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-03T22:01:33.780 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.inplace_update_support: 0 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.bloom_locality: 0 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.max_successive_merges: 0 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.paranoid_file_checks: 0 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.force_consistency_checks: 1 2024-05-03T22:01:33.781 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.report_bg_io_stats: 0 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.ttl: 2592000 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.enable_blob_files: false 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.min_blob_size: 0 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.blob_file_size: 268435456 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.blob_file_starting_level: 0 2024-05-03T22:01:33.782 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fdf11c64-2df6-4fb9-8b51-7fa0d65ab80c 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714773693695479, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714773693697394, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99369, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 322, "table_properties": {"data_size": 97315, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13925, "raw_average_key_size": 49, "raw_value_size": 89694, "raw_average_value_size": 319, "num_data_blocks": 12, "num_entries": 281, "num_filter_entries": 281, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714773693, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fdf11c64-2df6-4fb9-8b51-7fa0d65ab80c", "db_session_id": "24OVQQQHOOEZJZI1J08Y", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714773693697599, "job": 1, "event": "recovery_finished"} 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5647a06a0000 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: DB pointer 0x5647a068c000 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** DB Stats ** 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:01:33.783 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: L0 2/0 98.90 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 77.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: Sum 2/0 98.90 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 77.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 77.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-05-03T22:01:33.784 INFO:journalctl@ceph.mon.a.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 77.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative compaction: 0.00 GB write, 14.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval compaction: 0.00 GB write, 14.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache BinnedLRUCache@0x5647a05831f0#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-03T22:01:33.785 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: starting mon.a rank 0 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 bash[28386]: 7441df8970a66781196012546ef2983836624e855e2ce8900d1a94679f3f25f8 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: mon.a@-1(???) e1 preinit fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: mon.a@-1(???).mds e1 new map 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: mon.a@-1(???).mds e1 print_map 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout: e1 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout: legacy client fscid: -1 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout: No filesystems configured 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:01:33.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 systemd[1]: Started Ceph mon.a for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: monmap epoch 1 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: last_changed 2024-05-03T22:01:21.829502+0000 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: created 2024-05-03T22:01:21.829502+0000 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: min_mon_release 19 (squid) 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: election_strategy: 1 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: fsmap 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: osdmap e1: 0 total, 0 up, 0 in 2024-05-03T22:01:33.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:33 smithi082 ceph-mon[28404]: mgrmap e1: no daemons active 2024-05-03T22:01:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.352+0000 7fec62800700 1 Processor -- start 2024-05-03T22:01:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.353+0000 7fec62800700 1 -- start start 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.353+0000 7fec62800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.353+0000 7fec62800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c109700 con 0x7fec5c108d10 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.354+0000 7fec5b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.354+0000 7fec5b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35234/0 (socket says 172.21.15.82:35234) 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.354+0000 7fec5b400700 1 -- 172.21.15.82:0/2080091775 learned_addr learned my addr 172.21.15.82:0/2080091775 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.354+0000 7fec5b400700 1 -- 172.21.15.82:0/2080091775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c109f10 con 0x7fec5c108d10 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.354+0000 7fec5b400700 1 --2- 172.21.15.82:0/2080091775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c109130 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0098a0 tx=0x7fec4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8011bc85189adc5b server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.355+0000 7fec5a000700 1 -- 172.21.15.82:0/2080091775 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec4c004160 con 0x7fec5c108d10 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.355+0000 7fec5a000700 1 -- 172.21.15.82:0/2080091775 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fec4c004300 con 0x7fec5c108d10 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.355+0000 7fec5a000700 1 -- 172.21.15.82:0/2080091775 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec4c0119e0 con 0x7fec5c108d10 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.355+0000 7fec62800700 1 -- 172.21.15.82:0/2080091775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 msgr2=0x7fec5c109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.355+0000 7fec62800700 1 --2- 172.21.15.82:0/2080091775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c109130 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0098a0 tx=0x7fec4c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.356+0000 7fec62800700 1 -- 172.21.15.82:0/2080091775 shutdown_connections 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.356+0000 7fec62800700 1 --2- 172.21.15.82:0/2080091775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c109130 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.356+0000 7fec62800700 1 -- 172.21.15.82:0/2080091775 >> 172.21.15.82:0/2080091775 conn(0x7fec5c1042d0 msgr2=0x7fec5c1066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.356+0000 7fec62800700 1 -- 172.21.15.82:0/2080091775 shutdown_connections 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.356+0000 7fec62800700 1 -- 172.21.15.82:0/2080091775 wait complete. 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.357+0000 7fec62800700 1 Processor -- start 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.357+0000 7fec62800700 1 -- start start 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.357+0000 7fec62800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.357+0000 7fec62800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c10d140 con 0x7fec5c108d10 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.358+0000 7fec5b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.358+0000 7fec5b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c19ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35244/0 (socket says 172.21.15.82:35244) 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.358+0000 7fec5b400700 1 -- 172.21.15.82:0/570455520 learned_addr learned my addr 172.21.15.82:0/570455520 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.358+0000 7fec5b400700 1 -- 172.21.15.82:0/570455520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c19f270 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.358+0000 7fec5b400700 1 --2- 172.21.15.82:0/570455520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c19ed30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fec4c006b20 tx=0x7fec4c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.359+0000 7fec53e00700 1 -- 172.21.15.82:0/570455520 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec4c003a60 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.359+0000 7fec53e00700 1 -- 172.21.15.82:0/570455520 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fec4c003c00 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.359+0000 7fec62800700 1 -- 172.21.15.82:0/570455520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5c19f500 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.359+0000 7fec53e00700 1 -- 172.21.15.82:0/570455520 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec4c024780 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.359+0000 7fec62800700 1 -- 172.21.15.82:0/570455520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5c1a21f0 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.359+0000 7fec53e00700 1 -- 172.21.15.82:0/570455520 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fec4c022020 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.359+0000 7fec53e00700 1 -- 172.21.15.82:0/570455520 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fec4c0193c0 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.360+0000 7fec62800700 1 -- 172.21.15.82:0/570455520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5c10d2c0 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.363+0000 7fec53e00700 1 -- 172.21.15.82:0/570455520 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fec4c042e50 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.439+0000 7fec62800700 1 -- 172.21.15.82:0/570455520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fec5c1a23c0 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.442+0000 7fec53e00700 1 -- 172.21.15.82:0/570455520 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fec4c031030 con 0x7fec5c108d10 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.444+0000 7fec62800700 1 -- 172.21.15.82:0/570455520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 msgr2=0x7fec5c19ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.444+0000 7fec62800700 1 --2- 172.21.15.82:0/570455520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c19ed30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fec4c006b20 tx=0x7fec4c011a60 comp rx=0 tx=0).stop 2024-05-03T22:01:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.444+0000 7fec62800700 1 -- 172.21.15.82:0/570455520 shutdown_connections 2024-05-03T22:01:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.444+0000 7fec62800700 1 --2- 172.21.15.82:0/570455520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec5c108d10 0x7fec5c19ed30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.444+0000 7fec62800700 1 -- 172.21.15.82:0/570455520 >> 172.21.15.82:0/570455520 conn(0x7fec5c1042d0 msgr2=0x7fec5c104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.444+0000 7fec62800700 1 -- 172.21.15.82:0/570455520 shutdown_connections 2024-05-03T22:01:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:34.444+0000 7fec62800700 1 -- 172.21.15.82:0/570455520 wait complete. 2024-05-03T22:01:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-03T22:01:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:01:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mgr... 2024-05-03T22:01:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-03T22:01:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-03T22:01:35.604 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.x 2024-05-03T22:01:35.604 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.x.service: Unit ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.x.service not loaded. 2024-05-03T22:01:35.725 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:35 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/570455520' entity='client.admin' 2024-05-03T22:01:35.865 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-81cd0262-0998-11ef-bc97-c7b262605968.target.wants/ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-81cd0262-0998-11ef-bc97-c7b262605968@.service. 2024-05-03T22:01:36.226 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:35 smithi082 systemd[1]: Starting Ceph mgr.x for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:01:36.550 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:36 smithi082 podman[28618]: 2024-05-03 22:01:36.156482253 +0000 UTC m=+0.034093225 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:01:36.550 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:36 smithi082 podman[28618]: 2024-05-03 22:01:36.27771181 +0000 UTC m=+0.155322776 container create 26e2b13a17ed719d4fda0b0459eaebebc205cbb4bca7aa9cebb239ae4cf51a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True) 2024-05-03T22:01:36.550 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:36 smithi082 podman[28618]: 2024-05-03 22:01:36.548034847 +0000 UTC m=+0.425645869 container init 26e2b13a17ed719d4fda0b0459eaebebc205cbb4bca7aa9cebb239ae4cf51a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:01:36.648 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T22:01:36.648 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-05-03T22:01:36.665 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T22:01:36.665 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-03T22:01:36.665 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-05-03T22:01:36.665 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-05-03T22:01:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T22:01:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-05-03T22:01:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T22:01:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-03T22:01:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-05-03T22:01:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-03T22:01:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr to start... 2024-05-03T22:01:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr... 2024-05-03T22:01:36.801 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:36 smithi082 podman[28618]: 2024-05-03 22:01:36.557744925 +0000 UTC m=+0.435355902 container start 26e2b13a17ed719d4fda0b0459eaebebc205cbb4bca7aa9cebb239ae4cf51a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-03T22:01:36.801 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:36 smithi082 bash[28618]: 26e2b13a17ed719d4fda0b0459eaebebc205cbb4bca7aa9cebb239ae4cf51a40 2024-05-03T22:01:36.801 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:36 smithi082 systemd[1]: Started Ceph mgr.x for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:01:37.054 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:36 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:36.798+0000 7fe398505200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T22:01:37.357 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:37 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:37.052+0000 7fe398505200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:01:37.357 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:37 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:37.185+0000 7fe398505200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T22:01:37.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:37 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2701760221' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T22:01:37.714 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:37 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:37.600+0000 7fe398505200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T22:01:37.715 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:37 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:37.712+0000 7fe398505200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T22:01:38.230 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:38.232 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:01:38.232 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:01:38.232 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T22:01:38.232 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:38.233 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T22:01:38.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T22:01:38.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:38.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T22:01:38.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:38.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T22:01:38.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T22:01:38.234 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T22:01:38.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T22:01:38.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T22:01:38.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T22:01:38.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:38.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T22:01:38.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T22:01:38.242 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T22:01:38.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T22:01:26.555819+0000", 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:38.244 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.354+0000 7f6416800700 1 Processor -- start 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.354+0000 7f6416800700 1 -- start start 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.355+0000 7f6416800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641007d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.355+0000 7f6416800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f641007d8e0 con 0x7f641007eeb0 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.355+0000 7f640f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641007d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.356+0000 7f640f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641007d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35276/0 (socket says 172.21.15.82:35276) 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.356+0000 7f640f400700 1 -- 172.21.15.82:0/1796842032 learned_addr learned my addr 172.21.15.82:0/1796842032 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.356+0000 7f640f400700 1 -- 172.21.15.82:0/1796842032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641007da60 con 0x7f641007eeb0 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.356+0000 7f640f400700 1 --2- 172.21.15.82:0/1796842032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641007d310 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f64000098a0 tx=0x7f6400009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669f59bf34fe5fb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.357+0000 7f640e000700 1 -- 172.21.15.82:0/1796842032 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6400004160 con 0x7f641007eeb0 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.357+0000 7f640e000700 1 -- 172.21.15.82:0/1796842032 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f6400004300 con 0x7f641007eeb0 2024-05-03T22:01:38.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.357+0000 7f640e000700 1 -- 172.21.15.82:0/1796842032 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64000119e0 con 0x7f641007eeb0 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.358+0000 7f6416800700 1 -- 172.21.15.82:0/1796842032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 msgr2=0x7f641007d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.358+0000 7f6416800700 1 --2- 172.21.15.82:0/1796842032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641007d310 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f64000098a0 tx=0x7f6400009bb0 comp rx=0 tx=0).stop 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.358+0000 7f6416800700 1 -- 172.21.15.82:0/1796842032 shutdown_connections 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.358+0000 7f6416800700 1 --2- 172.21.15.82:0/1796842032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641007d310 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.358+0000 7f6416800700 1 -- 172.21.15.82:0/1796842032 >> 172.21.15.82:0/1796842032 conn(0x7f64101042d0 msgr2=0x7f64101066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.358+0000 7f6416800700 1 -- 172.21.15.82:0/1796842032 shutdown_connections 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.358+0000 7f6416800700 1 -- 172.21.15.82:0/1796842032 wait complete. 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.359+0000 7f6416800700 1 Processor -- start 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.359+0000 7f6416800700 1 -- start start 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.360+0000 7f6416800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.360+0000 7f6416800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f641010f200 con 0x7f641007eeb0 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.360+0000 7f640f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.360+0000 7f640f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641019ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35290/0 (socket says 172.21.15.82:35290) 2024-05-03T22:01:38.246 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.360+0000 7f640f400700 1 -- 172.21.15.82:0/2701760221 learned_addr learned my addr 172.21.15.82:0/2701760221 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.360+0000 7f640f400700 1 -- 172.21.15.82:0/2701760221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641019f260 con 0x7f641007eeb0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.360+0000 7f640f400700 1 --2- 172.21.15.82:0/2701760221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641019ed20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6400006b20 tx=0x7f6400011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.361+0000 7f6407e00700 1 -- 172.21.15.82:0/2701760221 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6400003a60 con 0x7f641007eeb0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.361+0000 7f6407e00700 1 -- 172.21.15.82:0/2701760221 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f6400003c00 con 0x7f641007eeb0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.361+0000 7f6407e00700 1 -- 172.21.15.82:0/2701760221 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6400024780 con 0x7f641007eeb0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.361+0000 7f6416800700 1 -- 172.21.15.82:0/2701760221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641019f4f0 con 0x7f641007eeb0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.361+0000 7f6416800700 1 -- 172.21.15.82:0/2701760221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64101a21d0 con 0x7f641007eeb0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.361+0000 7f6407e00700 1 -- 172.21.15.82:0/2701760221 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6400022020 con 0x7f641007eeb0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.361+0000 7f6407e00700 1 -- 172.21.15.82:0/2701760221 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f640002dde0 con 0x7f641007eeb0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.362+0000 7f6416800700 1 -- 172.21.15.82:0/2701760221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6410064b00 con 0x7f641007eeb0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.365+0000 7f6407e00700 1 -- 172.21.15.82:0/2701760221 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f640001aba0 con 0x7f641007eeb0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.444+0000 7f6416800700 1 -- 172.21.15.82:0/2701760221 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f64101a23a0 con 0x7f641007eeb0 2024-05-03T22:01:38.247 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.444+0000 7f6407e00700 1 -- 172.21.15.82:0/2701760221 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f6400004300 con 0x7f641007eeb0 2024-05-03T22:01:38.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.445+0000 7f6416800700 1 -- 172.21.15.82:0/2701760221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 msgr2=0x7f641019ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:38.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.445+0000 7f6416800700 1 --2- 172.21.15.82:0/2701760221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641019ed20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6400006b20 tx=0x7f6400011a60 comp rx=0 tx=0).stop 2024-05-03T22:01:38.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.445+0000 7f6416800700 1 -- 172.21.15.82:0/2701760221 shutdown_connections 2024-05-03T22:01:38.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.445+0000 7f6416800700 1 --2- 172.21.15.82:0/2701760221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f641007eeb0 0x7f641019ed20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:38.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.445+0000 7f6416800700 1 -- 172.21.15.82:0/2701760221 >> 172.21.15.82:0/2701760221 conn(0x7f64101042d0 msgr2=0x7f6410104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:38.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.446+0000 7f6416800700 1 -- 172.21.15.82:0/2701760221 shutdown_connections 2024-05-03T22:01:38.248 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:37.446+0000 7f6416800700 1 -- 172.21.15.82:0/2701760221 wait complete. 2024-05-03T22:01:38.248 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (1/15)... 2024-05-03T22:01:39.698 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:39 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:39.266+0000 7fe398505200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T22:01:39.699 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:39 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:39.487+0000 7fe398505200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T22:01:39.699 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:39 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:39.696+0000 7fe398505200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T22:01:40.392 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:40 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:40.066+0000 7fe398505200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T22:01:40.392 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:40 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:40.184+0000 7fe398505200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T22:01:40.679 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:40 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:40.438+0000 7fe398505200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T22:01:40.938 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:40 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:40.693+0000 7fe398505200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:01:41.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:40 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1188281414' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T22:01:41.713 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:41 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:41.500+0000 7fe398505200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T22:01:41.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:41.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:01:41.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:01:41.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T22:01:41.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T22:01:41.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T22:01:41.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T22:01:41.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T22:01:41.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:41.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T22:01:41.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T22:01:41.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T22:01:41.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T22:01:41.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T22:01:41.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T22:01:41.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:41.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T22:01:41.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T22:01:41.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T22:01:41.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T22:01:41.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T22:01:41.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T22:01:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T22:01:41.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T22:01:41.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T22:01:41.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T22:01:41.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:41.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:01:41.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:41.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T22:01:41.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:41.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T22:01:26.555819+0000", 2024-05-03T22:01:41.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.827+0000 7f9d14e00700 1 Processor -- start 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.828+0000 7f9d14e00700 1 -- start start 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.828+0000 7f9d14e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d10109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.828+0000 7f9d14e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10109700 con 0x7f9d10108d10 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.829+0000 7f9d0de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d10109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.829+0000 7f9d0de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d10109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35302/0 (socket says 172.21.15.82:35302) 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.829+0000 7f9d0de00700 1 -- 172.21.15.82:0/4270147426 learned_addr learned my addr 172.21.15.82:0/4270147426 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.829+0000 7f9d0de00700 1 -- 172.21.15.82:0/4270147426 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d10109f10 con 0x7f9d10108d10 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.829+0000 7f9d0de00700 1 --2- 172.21.15.82:0/4270147426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d10109130 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9d000098a0 tx=0x7f9d00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7799d6b6cb5978d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.830+0000 7f9d0ca00700 1 -- 172.21.15.82:0/4270147426 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d00004160 con 0x7f9d10108d10 2024-05-03T22:01:41.737 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.830+0000 7f9d0ca00700 1 -- 172.21.15.82:0/4270147426 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9d00004300 con 0x7f9d10108d10 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.830+0000 7f9d0ca00700 1 -- 172.21.15.82:0/4270147426 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d000119e0 con 0x7f9d10108d10 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.830+0000 7f9d14e00700 1 -- 172.21.15.82:0/4270147426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 msgr2=0x7f9d10109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.830+0000 7f9d14e00700 1 --2- 172.21.15.82:0/4270147426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d10109130 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9d000098a0 tx=0x7f9d00009bb0 comp rx=0 tx=0).stop 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.831+0000 7f9d14e00700 1 -- 172.21.15.82:0/4270147426 shutdown_connections 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.831+0000 7f9d14e00700 1 --2- 172.21.15.82:0/4270147426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d10109130 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.831+0000 7f9d14e00700 1 -- 172.21.15.82:0/4270147426 >> 172.21.15.82:0/4270147426 conn(0x7f9d101042d0 msgr2=0x7f9d101066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.831+0000 7f9d14e00700 1 -- 172.21.15.82:0/4270147426 shutdown_connections 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.831+0000 7f9d14e00700 1 -- 172.21.15.82:0/4270147426 wait complete. 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.832+0000 7f9d14e00700 1 Processor -- start 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.832+0000 7f9d14e00700 1 -- start start 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.832+0000 7f9d14e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d1007eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.832+0000 7f9d14e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1010d140 con 0x7f9d10108d10 2024-05-03T22:01:41.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.832+0000 7f9d0de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d1007eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.832+0000 7f9d0de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d1007eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35306/0 (socket says 172.21.15.82:35306) 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.832+0000 7f9d0de00700 1 -- 172.21.15.82:0/1188281414 learned_addr learned my addr 172.21.15.82:0/1188281414 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.833+0000 7f9d0de00700 1 -- 172.21.15.82:0/1188281414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1007f0c0 con 0x7f9d10108d10 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.833+0000 7f9d0de00700 1 --2- 172.21.15.82:0/1188281414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d1007eb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d00006b20 tx=0x7f9d00011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.833+0000 7f9d06a00700 1 -- 172.21.15.82:0/1188281414 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d00003a60 con 0x7f9d10108d10 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.833+0000 7f9d06a00700 1 -- 172.21.15.82:0/1188281414 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9d00003c00 con 0x7f9d10108d10 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.833+0000 7f9d06a00700 1 -- 172.21.15.82:0/1188281414 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d00024780 con 0x7f9d10108d10 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.833+0000 7f9d14e00700 1 -- 172.21.15.82:0/1188281414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1007d2b0 con 0x7f9d10108d10 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.834+0000 7f9d14e00700 1 -- 172.21.15.82:0/1188281414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1007d7f0 con 0x7f9d10108d10 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.834+0000 7f9d06a00700 1 -- 172.21.15.82:0/1188281414 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9d00022020 con 0x7f9d10108d10 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.834+0000 7f9d06a00700 1 -- 172.21.15.82:0/1188281414 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9d000193c0 con 0x7f9d10108d10 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.835+0000 7f9d14e00700 1 -- 172.21.15.82:0/1188281414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d1010d2c0 con 0x7f9d10108d10 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.839+0000 7f9d06a00700 1 -- 172.21.15.82:0/1188281414 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9d0002dde0 con 0x7f9d10108d10 2024-05-03T22:01:41.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.918+0000 7f9d14e00700 1 -- 172.21.15.82:0/1188281414 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9d1007dee0 con 0x7f9d10108d10 2024-05-03T22:01:41.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.919+0000 7f9d06a00700 1 -- 172.21.15.82:0/1188281414 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f9d0001aba0 con 0x7f9d10108d10 2024-05-03T22:01:41.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.920+0000 7f9d14e00700 1 -- 172.21.15.82:0/1188281414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 msgr2=0x7f9d1007eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:41.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.920+0000 7f9d14e00700 1 --2- 172.21.15.82:0/1188281414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d1007eb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d00006b20 tx=0x7f9d00011a60 comp rx=0 tx=0).stop 2024-05-03T22:01:41.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.920+0000 7f9d14e00700 1 -- 172.21.15.82:0/1188281414 shutdown_connections 2024-05-03T22:01:41.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.920+0000 7f9d14e00700 1 --2- 172.21.15.82:0/1188281414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d10108d10 0x7f9d1007eb80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:41.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.920+0000 7f9d14e00700 1 -- 172.21.15.82:0/1188281414 >> 172.21.15.82:0/1188281414 conn(0x7f9d101042d0 msgr2=0x7f9d10104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:41.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.920+0000 7f9d14e00700 1 -- 172.21.15.82:0/1188281414 shutdown_connections 2024-05-03T22:01:41.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:40.920+0000 7f9d14e00700 1 -- 172.21.15.82:0/1188281414 wait complete. 2024-05-03T22:01:41.740 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (2/15)... 2024-05-03T22:01:41.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:41 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:41.789+0000 7fe398505200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T22:01:42.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:42 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:42.333+0000 7fe398505200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T22:01:42.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:42 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:42.456+0000 7fe398505200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T22:01:43.226 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:42 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:42.908+0000 7fe398505200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T22:01:43.626 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:43 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:43.349+0000 7fe398505200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T22:01:43.626 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:43 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:43.470+0000 7fe398505200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T22:01:43.890 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:43 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:43.816+0000 7fe398505200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T22:01:44.206 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:44.004+0000 7fe398505200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T22:01:44.457 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:44.401+0000 7fe398505200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T22:01:44.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:44 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2476117171' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T22:01:44.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:44.558+0000 7fe398505200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T22:01:44.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:44.680+0000 7fe398505200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T22:01:45.160 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:45.161 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:01:45.161 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:01:45.161 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T22:01:45.161 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T22:01:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T22:01:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T22:01:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T22:01:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T22:01:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-05-03T22:01:45.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T22:01:45.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T22:01:45.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T22:01:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T22:01:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T22:01:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T22:01:45.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:45.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T22:01:45.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-03T22:01:45.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T22:01:45.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T22:01:45.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T22:01:45.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T22:01:45.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T22:01:45.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:45.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:01:45.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:45.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T22:01:26.555819+0000", 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.363+0000 7f7e70000700 1 Processor -- start 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.363+0000 7f7e70000700 1 -- start start 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.363+0000 7f7e70000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e68109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.363+0000 7f7e70000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7e68109700 con 0x7f7e68108d10 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.364+0000 7f7e6d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e68109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.364+0000 7f7e6d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e68109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50240/0 (socket says 172.21.15.82:50240) 2024-05-03T22:01:45.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.364+0000 7f7e6d600700 1 -- 172.21.15.82:0/3895049190 learned_addr learned my addr 172.21.15.82:0/3895049190 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.364+0000 7f7e6d600700 1 -- 172.21.15.82:0/3895049190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e68109f10 con 0x7f7e68108d10 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.364+0000 7f7e6d600700 1 --2- 172.21.15.82:0/3895049190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e68109130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0098a0 tx=0x7f7e5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00ee0d5415da41f server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.365+0000 7f7e67e00700 1 -- 172.21.15.82:0/3895049190 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e5c004160 con 0x7f7e68108d10 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.365+0000 7f7e67e00700 1 -- 172.21.15.82:0/3895049190 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f7e5c004300 con 0x7f7e68108d10 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.365+0000 7f7e67e00700 1 -- 172.21.15.82:0/3895049190 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e5c0119e0 con 0x7f7e68108d10 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.365+0000 7f7e70000700 1 -- 172.21.15.82:0/3895049190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 msgr2=0x7f7e68109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.365+0000 7f7e70000700 1 --2- 172.21.15.82:0/3895049190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e68109130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0098a0 tx=0x7f7e5c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.366+0000 7f7e70000700 1 -- 172.21.15.82:0/3895049190 shutdown_connections 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.366+0000 7f7e70000700 1 --2- 172.21.15.82:0/3895049190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e68109130 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.366+0000 7f7e70000700 1 -- 172.21.15.82:0/3895049190 >> 172.21.15.82:0/3895049190 conn(0x7f7e681042d0 msgr2=0x7f7e681066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.366+0000 7f7e70000700 1 -- 172.21.15.82:0/3895049190 shutdown_connections 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.366+0000 7f7e70000700 1 -- 172.21.15.82:0/3895049190 wait complete. 2024-05-03T22:01:45.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.367+0000 7f7e70000700 1 Processor -- start 2024-05-03T22:01:45.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.367+0000 7f7e70000700 1 -- start start 2024-05-03T22:01:45.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.368+0000 7f7e70000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e6807eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:45.179 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.368+0000 7f7e70000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6810d140 con 0x7f7e68108d10 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.368+0000 7f7e6d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e6807eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.368+0000 7f7e6d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e6807eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50248/0 (socket says 172.21.15.82:50248) 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.368+0000 7f7e6d600700 1 -- 172.21.15.82:0/2476117171 learned_addr learned my addr 172.21.15.82:0/2476117171 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.368+0000 7f7e6d600700 1 -- 172.21.15.82:0/2476117171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6807f0c0 con 0x7f7e68108d10 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.369+0000 7f7e6d600700 1 --2- 172.21.15.82:0/2476117171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e6807eb80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c006b20 tx=0x7f7e5c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.369+0000 7f7e66000700 1 -- 172.21.15.82:0/2476117171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e5c003a60 con 0x7f7e68108d10 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.369+0000 7f7e66000700 1 -- 172.21.15.82:0/2476117171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f7e5c003c00 con 0x7f7e68108d10 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.369+0000 7f7e70000700 1 -- 172.21.15.82:0/2476117171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e6807d2b0 con 0x7f7e68108d10 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.369+0000 7f7e66000700 1 -- 172.21.15.82:0/2476117171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e5c024780 con 0x7f7e68108d10 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.369+0000 7f7e70000700 1 -- 172.21.15.82:0/2476117171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e6807d7f0 con 0x7f7e68108d10 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.370+0000 7f7e66000700 1 -- 172.21.15.82:0/2476117171 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7e5c022020 con 0x7f7e68108d10 2024-05-03T22:01:45.180 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.370+0000 7f7e66000700 1 -- 172.21.15.82:0/2476117171 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7e5c02dde0 con 0x7f7e68108d10 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.370+0000 7f7e70000700 1 -- 172.21.15.82:0/2476117171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e6810d2c0 con 0x7f7e68108d10 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.373+0000 7f7e66000700 1 -- 172.21.15.82:0/2476117171 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7e5c01aba0 con 0x7f7e68108d10 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.454+0000 7f7e70000700 1 -- 172.21.15.82:0/2476117171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7e6807dee0 con 0x7f7e68108d10 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.455+0000 7f7e66000700 1 -- 172.21.15.82:0/2476117171 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f7e5c004300 con 0x7f7e68108d10 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.456+0000 7f7e70000700 1 -- 172.21.15.82:0/2476117171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 msgr2=0x7f7e6807eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.456+0000 7f7e70000700 1 --2- 172.21.15.82:0/2476117171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e6807eb80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c006b20 tx=0x7f7e5c011a60 comp rx=0 tx=0).stop 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.456+0000 7f7e70000700 1 -- 172.21.15.82:0/2476117171 shutdown_connections 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.456+0000 7f7e70000700 1 --2- 172.21.15.82:0/2476117171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e68108d10 0x7f7e6807eb80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.456+0000 7f7e70000700 1 -- 172.21.15.82:0/2476117171 >> 172.21.15.82:0/2476117171 conn(0x7f7e681042d0 msgr2=0x7f7e68104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.457+0000 7f7e70000700 1 -- 172.21.15.82:0/2476117171 shutdown_connections 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:44.457+0000 7f7e70000700 1 -- 172.21.15.82:0/2476117171 wait complete. 2024-05-03T22:01:45.181 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (3/15)... 2024-05-03T22:01:45.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:45 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:45.450+0000 7fe398505200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T22:01:46.226 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:45 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:45.735+0000 7fe398505200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T22:01:46.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: Activating manager daemon x 2024-05-03T22:01:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: mgrmap e2: x(active, starting, since 0.0123073s) 2024-05-03T22:01:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-03T22:01:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-03T22:01:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-03T22:01:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-03T22:01:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-03T22:01:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-03T22:01:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:01:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-03T22:01:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: Manager daemon x is now available 2024-05-03T22:01:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-03T22:01:46.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-03T22:01:46.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' 2024-05-03T22:01:46.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:45 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' 2024-05-03T22:01:47.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:46 smithi082 ceph-mon[28404]: from='mgr.14100 172.21.15.82:0/51314280' entity='mgr.x' 2024-05-03T22:01:47.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:46 smithi082 ceph-mon[28404]: mgrmap e3: x(active, since 1.02187s) 2024-05-03T22:01:48.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:48.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:01:48.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:01:48.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T22:01:48.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T22:01:48.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T22:01:48.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T22:01:48.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:48.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T22:01:48.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:48.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T22:01:48.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T22:01:48.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T22:01:48.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T22:01:48.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T22:01:48.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T22:01:48.845 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:48.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:48.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T22:01:26.555819+0000", 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.736+0000 7fbee5400700 1 Processor -- start 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.736+0000 7fbee5400700 1 -- start start 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.737+0000 7fbee5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee010b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.737+0000 7fbee5400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbee010b870 con 0x7fbee010af10 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.737+0000 7fbede800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee010b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.737+0000 7fbede800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee010b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50322/0 (socket says 172.21.15.82:50322) 2024-05-03T22:01:48.848 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.737+0000 7fbede800700 1 -- 172.21.15.82:0/2266775602 learned_addr learned my addr 172.21.15.82:0/2266775602 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.738+0000 7fbede800700 1 -- 172.21.15.82:0/2266775602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee010c070 con 0x7fbee010af10 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.738+0000 7fbede800700 1 --2- 172.21.15.82:0/2266775602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee010b330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbed00098a0 tx=0x7fbed0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251d21c622b4be9a server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.738+0000 7fbedd400700 1 -- 172.21.15.82:0/2266775602 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed0004160 con 0x7fbee010af10 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.738+0000 7fbedd400700 1 -- 172.21.15.82:0/2266775602 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fbed0004300 con 0x7fbee010af10 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.739+0000 7fbedd400700 1 -- 172.21.15.82:0/2266775602 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed00119e0 con 0x7fbee010af10 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.739+0000 7fbee5400700 1 -- 172.21.15.82:0/2266775602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 msgr2=0x7fbee010b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.739+0000 7fbee5400700 1 --2- 172.21.15.82:0/2266775602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee010b330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbed00098a0 tx=0x7fbed0009bb0 comp rx=0 tx=0).stop 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.739+0000 7fbee5400700 1 -- 172.21.15.82:0/2266775602 shutdown_connections 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.739+0000 7fbee5400700 1 --2- 172.21.15.82:0/2266775602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee010b330 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.739+0000 7fbee5400700 1 -- 172.21.15.82:0/2266775602 >> 172.21.15.82:0/2266775602 conn(0x7fbee007e300 msgr2=0x7fbee007e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.739+0000 7fbee5400700 1 -- 172.21.15.82:0/2266775602 shutdown_connections 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.739+0000 7fbee5400700 1 -- 172.21.15.82:0/2266775602 wait complete. 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.740+0000 7fbee5400700 1 Processor -- start 2024-05-03T22:01:48.849 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.741+0000 7fbee5400700 1 -- start start 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.741+0000 7fbee5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.741+0000 7fbee5400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbee010f330 con 0x7fbee010af10 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.741+0000 7fbede800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.741+0000 7fbede800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee019ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50334/0 (socket says 172.21.15.82:50334) 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.741+0000 7fbede800700 1 -- 172.21.15.82:0/3777360551 learned_addr learned my addr 172.21.15.82:0/3777360551 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.741+0000 7fbede800700 1 -- 172.21.15.82:0/3777360551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee019f220 con 0x7fbee010af10 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.742+0000 7fbede800700 1 --2- 172.21.15.82:0/3777360551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee019ece0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbed00116a0 tx=0x7fbed00046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.742+0000 7fbed7400700 1 -- 172.21.15.82:0/3777360551 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed0003b70 con 0x7fbee010af10 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.742+0000 7fbed7400700 1 -- 172.21.15.82:0/3777360551 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fbed001a8a0 con 0x7fbee010af10 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.742+0000 7fbee5400700 1 -- 172.21.15.82:0/3777360551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee019f4b0 con 0x7fbee010af10 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.742+0000 7fbed7400700 1 -- 172.21.15.82:0/3777360551 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed0024890 con 0x7fbee010af10 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.742+0000 7fbee5400700 1 -- 172.21.15.82:0/3777360551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee01a2190 con 0x7fbee010af10 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.743+0000 7fbed7400700 1 -- 172.21.15.82:0/3777360551 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 3) ==== 50105+0+0 (secure 0 0 0) 0x7fbed0022020 con 0x7fbee010af10 2024-05-03T22:01:48.850 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.743+0000 7fbee5400700 1 -- 172.21.15.82:0/3777360551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee0064b00 con 0x7fbee010af10 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.744+0000 7fbed7400700 1 --2- 172.21.15.82:0/3777360551 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7fbec403e350 0x7fbec4040810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.744+0000 7fbed7400700 1 -- 172.21.15.82:0/3777360551 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbed00534f0 con 0x7fbee010af10 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.744+0000 7fbedde00700 1 --2- 172.21.15.82:0/3777360551 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7fbec403e350 0x7fbec4040810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.745+0000 7fbedde00700 1 --2- 172.21.15.82:0/3777360551 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7fbec403e350 0x7fbec4040810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbecc006fd0 tx=0x7fbecc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.750+0000 7fbed7400700 1 -- 172.21.15.82:0/3777360551 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fbed00212c0 con 0x7fbee010af10 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:47.801+0000 7fbed7400700 1 -- 172.21.15.82:0/3777360551 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fbed000f2e0 con 0x7fbee010af10 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.069+0000 7fbee5400700 1 -- 172.21.15.82:0/3777360551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbee01a2360 con 0x7fbee010af10 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.070+0000 7fbed7400700 1 -- 172.21.15.82:0/3777360551 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fbee01a2360 con 0x7fbee010af10 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.074+0000 7fbee5400700 1 -- 172.21.15.82:0/3777360551 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7fbec403e350 msgr2=0x7fbec4040810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.074+0000 7fbee5400700 1 --2- 172.21.15.82:0/3777360551 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7fbec403e350 0x7fbec4040810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbecc006fd0 tx=0x7fbecc006e40 comp rx=0 tx=0).stop 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.074+0000 7fbee5400700 1 -- 172.21.15.82:0/3777360551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 msgr2=0x7fbee019ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.074+0000 7fbee5400700 1 --2- 172.21.15.82:0/3777360551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee019ece0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbed00116a0 tx=0x7fbed00046a0 comp rx=0 tx=0).stop 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.075+0000 7fbee5400700 1 -- 172.21.15.82:0/3777360551 shutdown_connections 2024-05-03T22:01:48.851 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.075+0000 7fbee5400700 1 --2- 172.21.15.82:0/3777360551 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7fbec403e350 0x7fbec4040810 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:48.852 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.075+0000 7fbee5400700 1 --2- 172.21.15.82:0/3777360551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbee010af10 0x7fbee019ece0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:48.852 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.075+0000 7fbee5400700 1 -- 172.21.15.82:0/3777360551 >> 172.21.15.82:0/3777360551 conn(0x7fbee007e300 msgr2=0x7fbee0108410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:48.852 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.075+0000 7fbee5400700 1 -- 172.21.15.82:0/3777360551 shutdown_connections 2024-05-03T22:01:48.852 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:48.075+0000 7fbee5400700 1 -- 172.21.15.82:0/3777360551 wait complete. 2024-05-03T22:01:48.852 INFO:teuthology.orchestra.run.smithi082.stdout:mgr is available 2024-05-03T22:01:49.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:48 smithi082 ceph-mon[28404]: mgrmap e4: x(active, since 2s) 2024-05-03T22:01:49.196 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:48 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3777360551' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T22:01:50.176 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:49 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/654258816' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-03T22:01:50.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-03T22:01:50.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.536+0000 7f9ec3200700 1 Processor -- start 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.536+0000 7f9ec3200700 1 -- start start 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.536+0000 7f9ec3200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec410b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.536+0000 7f9ec3200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec407cea0 con 0x7f9ec41095e0 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.537+0000 7f9ec1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec410b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.537+0000 7f9ec1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec410b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50344/0 (socket says 172.21.15.82:50344) 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.537+0000 7f9ec1e00700 1 -- 172.21.15.82:0/2492912152 learned_addr learned my addr 172.21.15.82:0/2492912152 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:50.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.537+0000 7f9ec1e00700 1 -- 172.21.15.82:0/2492912152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec410bf10 con 0x7f9ec41095e0 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.538+0000 7f9ec1e00700 1 --2- 172.21.15.82:0/2492912152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec410b9d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40098a0 tx=0x7f9eb4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5188ee7ca3c7bf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.538+0000 7f9ec0a00700 1 -- 172.21.15.82:0/2492912152 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eb4004160 con 0x7f9ec41095e0 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.538+0000 7f9ec0a00700 1 -- 172.21.15.82:0/2492912152 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9eb4004300 con 0x7f9ec41095e0 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.538+0000 7f9ec0a00700 1 -- 172.21.15.82:0/2492912152 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eb40119e0 con 0x7f9ec41095e0 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.538+0000 7f9ec3200700 1 -- 172.21.15.82:0/2492912152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 msgr2=0x7f9ec410b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.538+0000 7f9ec3200700 1 --2- 172.21.15.82:0/2492912152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec410b9d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40098a0 tx=0x7f9eb4009bb0 comp rx=0 tx=0).stop 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.539+0000 7f9ec3200700 1 -- 172.21.15.82:0/2492912152 shutdown_connections 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.539+0000 7f9ec3200700 1 --2- 172.21.15.82:0/2492912152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec410b9d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.539+0000 7f9ec3200700 1 -- 172.21.15.82:0/2492912152 >> 172.21.15.82:0/2492912152 conn(0x7f9ec4102ff0 msgr2=0x7f9ec4105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.539+0000 7f9ec3200700 1 -- 172.21.15.82:0/2492912152 shutdown_connections 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.539+0000 7f9ec3200700 1 -- 172.21.15.82:0/2492912152 wait complete. 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.540+0000 7f9ec3200700 1 Processor -- start 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.540+0000 7f9ec3200700 1 -- start start 2024-05-03T22:01:50.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.540+0000 7f9ec3200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec4108e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:50.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.540+0000 7f9ec3200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec410cd90 con 0x7f9ec41095e0 2024-05-03T22:01:50.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.540+0000 7f9ec1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec4108e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:50.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.540+0000 7f9ec1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec4108e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50348/0 (socket says 172.21.15.82:50348) 2024-05-03T22:01:50.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.540+0000 7f9ec1e00700 1 -- 172.21.15.82:0/654258816 learned_addr learned my addr 172.21.15.82:0/654258816 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:50.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.541+0000 7f9ec1e00700 1 -- 172.21.15.82:0/654258816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec41093a0 con 0x7f9ec41095e0 2024-05-03T22:01:50.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.541+0000 7f9ec1e00700 1 --2- 172.21.15.82:0/654258816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec4108e60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009130 tx=0x7f9eb4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:50.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.541+0000 7f9ebaa00700 1 -- 172.21.15.82:0/654258816 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eb4003b20 con 0x7f9ec41095e0 2024-05-03T22:01:50.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.541+0000 7f9ebaa00700 1 -- 172.21.15.82:0/654258816 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9eb401a8a0 con 0x7f9ec41095e0 2024-05-03T22:01:50.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.541+0000 7f9ebaa00700 1 -- 172.21.15.82:0/654258816 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eb4024810 con 0x7f9ec41095e0 2024-05-03T22:01:50.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.541+0000 7f9ec3200700 1 -- 172.21.15.82:0/654258816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec4107590 con 0x7f9ec41095e0 2024-05-03T22:01:50.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.542+0000 7f9ec3200700 1 -- 172.21.15.82:0/654258816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec4107ad0 con 0x7f9ec41095e0 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.543+0000 7f9ebaa00700 1 -- 172.21.15.82:0/654258816 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f9eb4022020 con 0x7f9ec41095e0 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.543+0000 7f9ec3200700 1 -- 172.21.15.82:0/654258816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec4064b00 con 0x7f9ec41095e0 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.543+0000 7f9ebaa00700 1 --2- 172.21.15.82:0/654258816 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f9ea803e420 0x7f9ea80408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.543+0000 7f9ebaa00700 1 -- 172.21.15.82:0/654258816 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9eb40535f0 con 0x7f9ec41095e0 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.544+0000 7f9ec1400700 1 --2- 172.21.15.82:0/654258816 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f9ea803e420 0x7f9ea80408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.544+0000 7f9ec1400700 1 --2- 172.21.15.82:0/654258816 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f9ea803e420 0x7f9ea80408e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0006fd0 tx=0x7f9eb0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.549+0000 7f9ebaa00700 1 -- 172.21.15.82:0/654258816 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9eb402dc70 con 0x7f9ec41095e0 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.782+0000 7f9ec3200700 1 -- 172.21.15.82:0/654258816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f9ec4107db0 con 0x7f9ec41095e0 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.784+0000 7f9ebaa00700 1 -- 172.21.15.82:0/654258816 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f9eb400f2e0 con 0x7f9ec41095e0 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.787+0000 7f9ec3200700 1 -- 172.21.15.82:0/654258816 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f9ea803e420 msgr2=0x7f9ea80408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.787+0000 7f9ec3200700 1 --2- 172.21.15.82:0/654258816 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f9ea803e420 0x7f9ea80408e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0006fd0 tx=0x7f9eb0006e40 comp rx=0 tx=0).stop 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.787+0000 7f9ec3200700 1 -- 172.21.15.82:0/654258816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 msgr2=0x7f9ec4108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.787+0000 7f9ec3200700 1 --2- 172.21.15.82:0/654258816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec4108e60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009130 tx=0x7f9eb4011a60 comp rx=0 tx=0).stop 2024-05-03T22:01:50.527 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.787+0000 7f9ec3200700 1 -- 172.21.15.82:0/654258816 shutdown_connections 2024-05-03T22:01:50.528 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.787+0000 7f9ec3200700 1 --2- 172.21.15.82:0/654258816 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f9ea803e420 0x7f9ea80408e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:50.528 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.787+0000 7f9ec3200700 1 --2- 172.21.15.82:0/654258816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec41095e0 0x7f9ec4108e60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:50.528 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.787+0000 7f9ec3200700 1 -- 172.21.15.82:0/654258816 >> 172.21.15.82:0/654258816 conn(0x7f9ec4102ff0 msgr2=0x7f9ec41039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:50.528 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.787+0000 7f9ec3200700 1 -- 172.21.15.82:0/654258816 shutdown_connections 2024-05-03T22:01:50.528 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:49.787+0000 7f9ec3200700 1 -- 172.21.15.82:0/654258816 wait complete. 2024-05-03T22:01:50.528 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling cephadm module... 2024-05-03T22:01:51.842 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:51 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/481690106' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-03T22:01:51.842 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:51 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: ignoring --setuser ceph since I am not root 2024-05-03T22:01:51.842 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:51 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: ignoring --setgroup ceph since I am not root 2024-05-03T22:01:51.842 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:51 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:51.840+0000 7f4ce7cf8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T22:01:52.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:52 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:52.093+0000 7f4ce7cf8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:01:52.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:52 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:52.226+0000 7f4ce7cf8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T22:01:52.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.186+0000 7f2724000700 1 Processor -- start 2024-05-03T22:01:52.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.186+0000 7f2724000700 1 -- start start 2024-05-03T22:01:52.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.187+0000 7f2724000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c10b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:52.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.187+0000 7f2724000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f271c10b870 con 0x7f271c10af10 2024-05-03T22:01:52.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.187+0000 7f2721600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c10b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.187+0000 7f2721600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c10b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50354/0 (socket says 172.21.15.82:50354) 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.187+0000 7f2721600700 1 -- 172.21.15.82:0/247023175 learned_addr learned my addr 172.21.15.82:0/247023175 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.188+0000 7f2721600700 1 -- 172.21.15.82:0/247023175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c10c070 con 0x7f271c10af10 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.188+0000 7f2721600700 1 --2- 172.21.15.82:0/247023175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c10b330 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2710009e80 tx=0x7f271000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b27add64773576 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.188+0000 7f271be00700 1 -- 172.21.15.82:0/247023175 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2710017070 con 0x7f271c10af10 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.188+0000 7f271be00700 1 -- 172.21.15.82:0/247023175 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f271000b8c0 con 0x7f271c10af10 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.188+0000 7f271be00700 1 -- 172.21.15.82:0/247023175 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2710004420 con 0x7f271c10af10 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.189+0000 7f2724000700 1 -- 172.21.15.82:0/247023175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 msgr2=0x7f271c10b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.189+0000 7f2724000700 1 --2- 172.21.15.82:0/247023175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c10b330 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2710009e80 tx=0x7f271000b330 comp rx=0 tx=0).stop 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.189+0000 7f2724000700 1 -- 172.21.15.82:0/247023175 shutdown_connections 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.189+0000 7f2724000700 1 --2- 172.21.15.82:0/247023175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c10b330 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.189+0000 7f2724000700 1 -- 172.21.15.82:0/247023175 >> 172.21.15.82:0/247023175 conn(0x7f271c07e300 msgr2=0x7f271c07e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.189+0000 7f2724000700 1 -- 172.21.15.82:0/247023175 shutdown_connections 2024-05-03T22:01:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.189+0000 7f2724000700 1 -- 172.21.15.82:0/247023175 wait complete. 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.190+0000 7f2724000700 1 Processor -- start 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.190+0000 7f2724000700 1 -- start start 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.191+0000 7f2724000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.191+0000 7f2724000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f271c10f330 con 0x7f271c10af10 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.191+0000 7f2721600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.191+0000 7f2721600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c19ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50364/0 (socket says 172.21.15.82:50364) 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.191+0000 7f2721600700 1 -- 172.21.15.82:0/481690106 learned_addr learned my addr 172.21.15.82:0/481690106 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.191+0000 7f2721600700 1 -- 172.21.15.82:0/481690106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c19f2d0 con 0x7f271c10af10 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.192+0000 7f2721600700 1 --2- 172.21.15.82:0/481690106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c19ed90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f27100041b0 tx=0x7f2710003ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.192+0000 7f271a000700 1 -- 172.21.15.82:0/481690106 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2710017040 con 0x7f271c10af10 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.192+0000 7f271a000700 1 -- 172.21.15.82:0/481690106 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f2710022070 con 0x7f271c10af10 2024-05-03T22:01:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.192+0000 7f2724000700 1 -- 172.21.15.82:0/481690106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271c19f560 con 0x7f271c10af10 2024-05-03T22:01:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.192+0000 7f271a000700 1 -- 172.21.15.82:0/481690106 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2710012690 con 0x7f271c10af10 2024-05-03T22:01:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.192+0000 7f2724000700 1 -- 172.21.15.82:0/481690106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f271c1a2210 con 0x7f271c10af10 2024-05-03T22:01:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.193+0000 7f271a000700 1 -- 172.21.15.82:0/481690106 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f271001da60 con 0x7f271c10af10 2024-05-03T22:01:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.193+0000 7f2724000700 1 -- 172.21.15.82:0/481690106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271c064b00 con 0x7f271c10af10 2024-05-03T22:01:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.194+0000 7f271a000700 1 --2- 172.21.15.82:0/481690106 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f270403e470 0x7f2704040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.194+0000 7f271a000700 1 -- 172.21.15.82:0/481690106 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f271000f050 con 0x7f271c10af10 2024-05-03T22:01:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.194+0000 7f2720c00700 1 --2- 172.21.15.82:0/481690106 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f270403e470 0x7f2704040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.195+0000 7f2720c00700 1 --2- 172.21.15.82:0/481690106 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f270403e470 0x7f2704040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2708006fd0 tx=0x7f2708006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.199+0000 7f271a000700 1 -- 172.21.15.82:0/481690106 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2710053690 con 0x7f271c10af10 2024-05-03T22:01:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.491+0000 7f2724000700 1 -- 172.21.15.82:0/481690106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f271c1a2430 con 0x7f271c10af10 2024-05-03T22:01:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.544+0000 7f271a000700 1 -- 172.21.15.82:0/481690106 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f271c1a2430 con 0x7f271c10af10 2024-05-03T22:01:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.547+0000 7f2724000700 1 -- 172.21.15.82:0/481690106 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f270403e470 msgr2=0x7f2704040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.547+0000 7f2724000700 1 --2- 172.21.15.82:0/481690106 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f270403e470 0x7f2704040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2708006fd0 tx=0x7f2708006e40 comp rx=0 tx=0).stop 2024-05-03T22:01:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.547+0000 7f2724000700 1 -- 172.21.15.82:0/481690106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 msgr2=0x7f271c19ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.547+0000 7f2724000700 1 --2- 172.21.15.82:0/481690106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c19ed90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f27100041b0 tx=0x7f2710003ad0 comp rx=0 tx=0).stop 2024-05-03T22:01:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.548+0000 7f2724000700 1 -- 172.21.15.82:0/481690106 shutdown_connections 2024-05-03T22:01:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.548+0000 7f2724000700 1 --2- 172.21.15.82:0/481690106 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f270403e470 0x7f2704040930 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.548+0000 7f2724000700 1 --2- 172.21.15.82:0/481690106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f271c10af10 0x7f271c19ed90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.548+0000 7f2724000700 1 -- 172.21.15.82:0/481690106 >> 172.21.15.82:0/481690106 conn(0x7f271c07e300 msgr2=0x7f271c1084a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.548+0000 7f2724000700 1 -- 172.21.15.82:0/481690106 shutdown_connections 2024-05-03T22:01:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:51.549+0000 7f2724000700 1 -- 172.21.15.82:0/481690106 wait complete. 2024-05-03T22:01:52.635 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:52 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/481690106' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-03T22:01:52.635 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:52 smithi082 ceph-mon[28404]: mgrmap e5: x(active, since 5s) 2024-05-03T22:01:52.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:52 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:52.632+0000 7f4ce7cf8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T22:01:52.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:52 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:52.748+0000 7f4ce7cf8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T22:01:53.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:01:53 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2770632995' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-03T22:01:54.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:01:54.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-03T22:01:54.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.025+0000 7f17d1e00700 1 Processor -- start 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.026+0000 7f17d1e00700 1 -- start start 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.026+0000 7f17d1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc07d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.026+0000 7f17d1e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc07d8c0 con 0x7f17cc07ee90 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.026+0000 7f17caa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc07d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.026+0000 7f17caa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc07d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50392/0 (socket says 172.21.15.82:50392) 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.026+0000 7f17caa00700 1 -- 172.21.15.82:0/111348603 learned_addr learned my addr 172.21.15.82:0/111348603 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.027+0000 7f17caa00700 1 -- 172.21.15.82:0/111348603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc07da40 con 0x7f17cc07ee90 2024-05-03T22:01:54.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.027+0000 7f17caa00700 1 --2- 172.21.15.82:0/111348603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc07d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0098a0 tx=0x7f17bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35280c55dbe44caf server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.027+0000 7f17c9600700 1 -- 172.21.15.82:0/111348603 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17bc004160 con 0x7f17cc07ee90 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.027+0000 7f17c9600700 1 -- 172.21.15.82:0/111348603 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f17bc004300 con 0x7f17cc07ee90 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.027+0000 7f17c9600700 1 -- 172.21.15.82:0/111348603 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17bc0119e0 con 0x7f17cc07ee90 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.028+0000 7f17d1e00700 1 -- 172.21.15.82:0/111348603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 msgr2=0x7f17cc07d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.028+0000 7f17d1e00700 1 --2- 172.21.15.82:0/111348603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc07d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0098a0 tx=0x7f17bc009bb0 comp rx=0 tx=0).stop 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.028+0000 7f17d1e00700 1 -- 172.21.15.82:0/111348603 shutdown_connections 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.028+0000 7f17d1e00700 1 --2- 172.21.15.82:0/111348603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc07d2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.028+0000 7f17d1e00700 1 -- 172.21.15.82:0/111348603 >> 172.21.15.82:0/111348603 conn(0x7f17cc1042d0 msgr2=0x7f17cc1066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.028+0000 7f17d1e00700 1 -- 172.21.15.82:0/111348603 shutdown_connections 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.028+0000 7f17d1e00700 1 -- 172.21.15.82:0/111348603 wait complete. 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.029+0000 7f17d1e00700 1 Processor -- start 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.029+0000 7f17d1e00700 1 -- start start 2024-05-03T22:01:54.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.030+0000 7f17d1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc19ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.030+0000 7f17d1e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc10f220 con 0x7f17cc07ee90 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.030+0000 7f17caa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc19ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.030+0000 7f17caa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc19ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50394/0 (socket says 172.21.15.82:50394) 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.030+0000 7f17caa00700 1 -- 172.21.15.82:0/2770632995 learned_addr learned my addr 172.21.15.82:0/2770632995 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.030+0000 7f17caa00700 1 -- 172.21.15.82:0/2770632995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc19f1f0 con 0x7f17cc07ee90 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.031+0000 7f17caa00700 1 --2- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc19ecb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0116a0 tx=0x7f17bc0046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.031+0000 7f17d0a00700 1 -- 172.21.15.82:0/2770632995 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17bc003b70 con 0x7f17cc07ee90 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.031+0000 7f17d0a00700 1 -- 172.21.15.82:0/2770632995 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f17bc01a8a0 con 0x7f17cc07ee90 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.031+0000 7f17d0a00700 1 -- 172.21.15.82:0/2770632995 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17bc024890 con 0x7f17cc07ee90 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.031+0000 7f17d1e00700 1 -- 172.21.15.82:0/2770632995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17cc19f480 con 0x7f17cc07ee90 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.031+0000 7f17d1e00700 1 -- 172.21.15.82:0/2770632995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17cc1a2170 con 0x7f17cc07ee90 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.032+0000 7f17d1e00700 1 -- 172.21.15.82:0/2770632995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17cc064b00 con 0x7f17cc07ee90 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.032+0000 7f17d0a00700 1 -- 172.21.15.82:0/2770632995 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f17bc022020 con 0x7f17cc07ee90 2024-05-03T22:01:54.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.033+0000 7f17d0a00700 1 --2- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f17b003e4c0 0x7f17b0040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.033+0000 7f17d0a00700 1 -- 172.21.15.82:0/2770632995 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f17bc053770 con 0x7f17cc07ee90 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.033+0000 7f17ca000700 1 -- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f17b003e4c0 msgr2=0x7f17b0040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1944232139 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.033+0000 7f17ca000700 1 --2- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f17b003e4c0 0x7f17b0040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.038+0000 7f17d0a00700 1 -- 172.21.15.82:0/2770632995 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f17bc017e90 con 0x7f17cc07ee90 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.234+0000 7f17ca000700 1 -- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f17b003e4c0 msgr2=0x7f17b0040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1944232139 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.234+0000 7f17ca000700 1 --2- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f17b003e4c0 0x7f17b0040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.362+0000 7f17d1e00700 1 -- 172.21.15.82:0/2770632995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f17cc1a2340 con 0x7f17cc07ee90 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.362+0000 7f17d0a00700 1 -- 172.21.15.82:0/2770632995 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f17cc1a2340 con 0x7f17cc07ee90 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.365+0000 7f17d1e00700 1 -- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f17b003e4c0 msgr2=0x7f17b0040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.365+0000 7f17d1e00700 1 --2- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f17b003e4c0 0x7f17b0040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.365+0000 7f17d1e00700 1 -- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 msgr2=0x7f17cc19ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.365+0000 7f17d1e00700 1 --2- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc19ecb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0116a0 tx=0x7f17bc0046a0 comp rx=0 tx=0).stop 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.365+0000 7f17d1e00700 1 -- 172.21.15.82:0/2770632995 shutdown_connections 2024-05-03T22:01:54.120 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.365+0000 7f17d1e00700 1 --2- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f17b003e4c0 0x7f17b0040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:54.121 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.365+0000 7f17d1e00700 1 --2- 172.21.15.82:0/2770632995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17cc07ee90 0x7f17cc19ecb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:01:54.121 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.365+0000 7f17d1e00700 1 -- 172.21.15.82:0/2770632995 >> 172.21.15.82:0/2770632995 conn(0x7f17cc1042d0 msgr2=0x7f17cc104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:01:54.121 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.366+0000 7f17d1e00700 1 -- 172.21.15.82:0/2770632995 shutdown_connections 2024-05-03T22:01:54.121 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:53.366+0000 7f17d1e00700 1 -- 172.21.15.82:0/2770632995 wait complete. 2024-05-03T22:01:54.121 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-05-03T22:01:54.121 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 5... 2024-05-03T22:01:54.654 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:54 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:54.369+0000 7f4ce7cf8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T22:01:54.654 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:54 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:54.600+0000 7f4ce7cf8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T22:01:54.916 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:54 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:54.816+0000 7f4ce7cf8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T22:01:55.476 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:55 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:55.191+0000 7f4ce7cf8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T22:01:55.476 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:55 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:55.310+0000 7f4ce7cf8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T22:01:55.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:55 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:55.557+0000 7f4ce7cf8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T22:01:55.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:55 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:55.803+0000 7f4ce7cf8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:01:56.856 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:56 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:56.575+0000 7f4ce7cf8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T22:01:56.857 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:56 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:56.854+0000 7f4ce7cf8200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T22:01:57.721 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:57 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:57.405+0000 7f4ce7cf8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T22:01:57.721 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:57 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:57.531+0000 7f4ce7cf8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T22:01:58.440 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:57 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:57.998+0000 7f4ce7cf8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T22:01:58.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:58 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:58.438+0000 7f4ce7cf8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T22:01:58.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:58 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:58.558+0000 7f4ce7cf8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T22:01:59.226 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:58 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:58.872+0000 7f4ce7cf8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T22:01:59.226 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:59 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:59.045+0000 7f4ce7cf8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T22:01:59.681 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:59 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:59.411+0000 7f4ce7cf8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T22:01:59.681 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:59 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:59.558+0000 7f4ce7cf8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T22:01:59.681 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:01:59 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:01:59.678+0000 7f4ce7cf8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T22:02:00.705 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:00 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:00.422+0000 7f4ce7cf8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T22:02:00.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:00 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:00.703+0000 7f4ce7cf8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T22:02:00.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:00 smithi082 ceph-mon[28404]: Active manager daemon x restarted 2024-05-03T22:02:00.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:00 smithi082 ceph-mon[28404]: Activating manager daemon x 2024-05-03T22:02:00.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:00 smithi082 ceph-mon[28404]: osdmap e2: 0 total, 0 up, 0 in 2024-05-03T22:02:00.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:00 smithi082 ceph-mon[28404]: mgrmap e6: x(active, starting, since 0.0101332s) 2024-05-03T22:02:00.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:00 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:02:00.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:00 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-03T22:02:00.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:00 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-03T22:02:00.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:00 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-03T22:02:00.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:00 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-03T22:02:00.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:00 smithi082 ceph-mon[28404]: Manager daemon x is now available 2024-05-03T22:02:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:01 smithi082 ceph-mon[28404]: Found migration_current of "None". Setting to last migration. 2024-05-03T22:02:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:01 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:01.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:01 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:01.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:01 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:02:01.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:01 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:02:01.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:01 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-03T22:02:01.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:01 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-03T22:02:01.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:01 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:01.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:01 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:01.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:01 smithi082 ceph-mon[28404]: [03/May/2024:22:02:01] ENGINE Bus STARTING 2024-05-03T22:02:01.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:01 smithi082 ceph-mon[28404]: mgrmap e7: x(active, since 1.01346s) 2024-05-03T22:02:02.437 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:02:02.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-03T22:02:02.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-03T22:02:02.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:02:02.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.705+0000 7f3b06200700 1 Processor -- start 2024-05-03T22:02:02.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.705+0000 7f3b06200700 1 -- start start 2024-05-03T22:02:02.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.705+0000 7f3b06200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b00109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:02.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.705+0000 7f3b06200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3b00109700 con 0x7f3b00108d10 2024-05-03T22:02:02.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.706+0000 7f3aff400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b00109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:02.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.706+0000 7f3aff400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b00109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41854/0 (socket says 172.21.15.82:41854) 2024-05-03T22:02:02.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.706+0000 7f3aff400700 1 -- 172.21.15.82:0/2141096687 learned_addr learned my addr 172.21.15.82:0/2141096687 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.706+0000 7f3aff400700 1 -- 172.21.15.82:0/2141096687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b00109f10 con 0x7f3b00108d10 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.707+0000 7f3aff400700 1 --2- 172.21.15.82:0/2141096687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b00109130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3af00098a0 tx=0x7f3af0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e27d082175433a server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.707+0000 7f3afe000700 1 -- 172.21.15.82:0/2141096687 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af0004160 con 0x7f3b00108d10 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.707+0000 7f3afe000700 1 -- 172.21.15.82:0/2141096687 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f3af0004300 con 0x7f3b00108d10 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.707+0000 7f3afe000700 1 -- 172.21.15.82:0/2141096687 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af00119e0 con 0x7f3b00108d10 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.708+0000 7f3b06200700 1 -- 172.21.15.82:0/2141096687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 msgr2=0x7f3b00109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.708+0000 7f3b06200700 1 --2- 172.21.15.82:0/2141096687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b00109130 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3af00098a0 tx=0x7f3af0009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.708+0000 7f3b06200700 1 -- 172.21.15.82:0/2141096687 shutdown_connections 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.708+0000 7f3b06200700 1 --2- 172.21.15.82:0/2141096687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b00109130 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.708+0000 7f3b06200700 1 -- 172.21.15.82:0/2141096687 >> 172.21.15.82:0/2141096687 conn(0x7f3b001042d0 msgr2=0x7f3b001066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.708+0000 7f3b06200700 1 -- 172.21.15.82:0/2141096687 shutdown_connections 2024-05-03T22:02:02.445 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.708+0000 7f3b06200700 1 -- 172.21.15.82:0/2141096687 wait complete. 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.709+0000 7f3b06200700 1 Processor -- start 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.709+0000 7f3b06200700 1 -- start start 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.709+0000 7f3b06200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b0019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.709+0000 7f3b06200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0010d140 con 0x7f3b00108d10 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.710+0000 7f3aff400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b0019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.710+0000 7f3aff400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b0019ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41870/0 (socket says 172.21.15.82:41870) 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.710+0000 7f3aff400700 1 -- 172.21.15.82:0/3789314891 learned_addr learned my addr 172.21.15.82:0/3789314891 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.710+0000 7f3aff400700 1 -- 172.21.15.82:0/3789314891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0019f260 con 0x7f3b00108d10 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.710+0000 7f3aff400700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b0019ed20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3af0006b20 tx=0x7f3af0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.711+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af0003a60 con 0x7f3b00108d10 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.711+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f3af0003c00 con 0x7f3b00108d10 2024-05-03T22:02:02.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.711+0000 7f3b06200700 1 -- 172.21.15.82:0/3789314891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0019f4f0 con 0x7f3b00108d10 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.711+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af0024780 con 0x7f3b00108d10 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.711+0000 7f3b06200700 1 -- 172.21.15.82:0/3789314891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b001a21d0 con 0x7f3b00108d10 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.712+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f3af0022020 con 0x7f3b00108d10 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.713+0000 7f3af7e00700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 0x7f3ae4040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.713+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 --> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3ae4041090 con 0x7f3ae403e4c0 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.713+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3af00536a0 con 0x7f3b00108d10 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.713+0000 7f3afea00700 1 -- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 msgr2=0x7f3ae4040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1944232139 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.713+0000 7f3afea00700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 0x7f3ae4040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.914+0000 7f3afea00700 1 -- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 msgr2=0x7f3ae4040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1944232139 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:54.914+0000 7f3afea00700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 0x7f3ae4040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:55.315+0000 7f3afea00700 1 -- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 msgr2=0x7f3ae4040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1944232139 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:55.315+0000 7f3afea00700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 0x7f3ae4040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-03T22:02:02.447 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:56.116+0000 7f3afea00700 1 -- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 msgr2=0x7f3ae4040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1944232139 2024-05-03T22:02:02.450 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:56.116+0000 7f3afea00700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 0x7f3ae4040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-03T22:02:02.450 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:57.718+0000 7f3afea00700 1 -- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 msgr2=0x7f3ae4040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1944232139 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:01:57.718+0000 7f3afea00700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 0x7f3ae4040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:00.712+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7f3af001aba0 con 0x7f3b00108d10 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:00.712+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 msgr2=0x7f3ae4040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:00.712+0000 7f3af7e00700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 0x7f3ae4040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.715+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f3af0055120 con 0x7f3b00108d10 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.715+0000 7f3af7e00700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f3ae4041e00 0x7f3ae40441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.715+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 --> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3af00530f0 con 0x7f3ae4041e00 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.716+0000 7f3afea00700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f3ae4041e00 0x7f3ae40441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.718+0000 7f3afea00700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f3ae4041e00 0x7f3ae40441f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3aec003a10 tx=0x7f3aec0092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.720+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 <== mgr.14120 v2:172.21.15.82:6800/2219604538 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f3af00530f0 con 0x7f3ae4041e00 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.728+0000 7f3b06200700 1 -- 172.21.15.82:0/3789314891 --> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f3b0010d2c0 con 0x7f3ae4041e00 2024-05-03T22:02:02.451 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3af7e00700 1 -- 172.21.15.82:0/3789314891 <== mgr.14120 v2:172.21.15.82:6800/2219604538 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f3b0010d2c0 con 0x7f3ae4041e00 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3b06200700 1 -- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f3ae4041e00 msgr2=0x7f3ae40441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3b06200700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f3ae4041e00 0x7f3ae40441f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3aec003a10 tx=0x7f3aec0092b0 comp rx=0 tx=0).stop 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3b06200700 1 -- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 msgr2=0x7f3b0019ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3b06200700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b0019ed20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3af0006b20 tx=0x7f3af0011a60 comp rx=0 tx=0).stop 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3b06200700 1 -- 172.21.15.82:0/3789314891 shutdown_connections 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3b06200700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f3ae4041e00 0x7f3ae40441f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3b06200700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00108d10 0x7f3b0019ed20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3b06200700 1 --2- 172.21.15.82:0/3789314891 >> [v2:172.21.15.82:6800/1944232139,v1:172.21.15.82:6801/1944232139] conn(0x7f3ae403e4c0 0x7f3ae4040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3b06200700 1 -- 172.21.15.82:0/3789314891 >> 172.21.15.82:0/3789314891 conn(0x7f3b001042d0 msgr2=0x7f3b00104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3b06200700 1 -- 172.21.15.82:0/3789314891 shutdown_connections 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:01.729+0000 7f3b06200700 1 -- 172.21.15.82:0/3789314891 wait complete. 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 5 is available 2024-05-03T22:02:02.452 INFO:teuthology.orchestra.run.smithi082.stdout:Setting orchestrator backend to cephadm... 2024-05-03T22:02:03.094 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:02 smithi082 ceph-mon[28404]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-03T22:02:03.095 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:02 smithi082 ceph-mon[28404]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-03T22:02:03.095 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:02 smithi082 ceph-mon[28404]: [03/May/2024:22:02:01] ENGINE Serving on https://172.21.15.82:7150 2024-05-03T22:02:03.095 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:02 smithi082 ceph-mon[28404]: [03/May/2024:22:02:01] ENGINE Serving on http://172.21.15.82:8765 2024-05-03T22:02:03.095 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:02 smithi082 ceph-mon[28404]: [03/May/2024:22:02:01] ENGINE Bus STARTED 2024-05-03T22:02:03.095 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:02 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:02:04.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:03 smithi082 ceph-mon[28404]: mgrmap e8: x(active, since 2s) 2024-05-03T22:02:04.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:03 smithi082 ceph-mon[28404]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:02:04.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:03 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:04.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:03 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:02:04.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.135+0000 7efe61200700 1 Processor -- start 2024-05-03T22:02:04.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.135+0000 7efe61200700 1 -- start start 2024-05-03T22:02:04.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.136+0000 7efe61200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c07d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:04.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.136+0000 7efe61200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c07d8c0 con 0x7efe5c07ee90 2024-05-03T22:02:04.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.136+0000 7efe59e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c07d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:04.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.136+0000 7efe59e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c07d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41926/0 (socket says 172.21.15.82:41926) 2024-05-03T22:02:04.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.136+0000 7efe59e00700 1 -- 172.21.15.82:0/3908240368 learned_addr learned my addr 172.21.15.82:0/3908240368 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:04.187 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.137+0000 7efe59e00700 1 -- 172.21.15.82:0/3908240368 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c07da40 con 0x7efe5c07ee90 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.137+0000 7efe59e00700 1 --2- 172.21.15.82:0/3908240368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c07d2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0098a0 tx=0x7efe4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d7f7a5282b16b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.137+0000 7efe58a00700 1 -- 172.21.15.82:0/3908240368 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe4c004160 con 0x7efe5c07ee90 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.137+0000 7efe58a00700 1 -- 172.21.15.82:0/3908240368 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7efe4c004300 con 0x7efe5c07ee90 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.137+0000 7efe58a00700 1 -- 172.21.15.82:0/3908240368 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe4c0119e0 con 0x7efe5c07ee90 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.138+0000 7efe61200700 1 -- 172.21.15.82:0/3908240368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 msgr2=0x7efe5c07d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.138+0000 7efe61200700 1 --2- 172.21.15.82:0/3908240368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c07d2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0098a0 tx=0x7efe4c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.138+0000 7efe61200700 1 -- 172.21.15.82:0/3908240368 shutdown_connections 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.138+0000 7efe61200700 1 --2- 172.21.15.82:0/3908240368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c07d2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.138+0000 7efe61200700 1 -- 172.21.15.82:0/3908240368 >> 172.21.15.82:0/3908240368 conn(0x7efe5c1042d0 msgr2=0x7efe5c1066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.138+0000 7efe61200700 1 -- 172.21.15.82:0/3908240368 shutdown_connections 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.138+0000 7efe61200700 1 -- 172.21.15.82:0/3908240368 wait complete. 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.139+0000 7efe61200700 1 Processor -- start 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.139+0000 7efe61200700 1 -- start start 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.140+0000 7efe61200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:04.188 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.140+0000 7efe61200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c10f220 con 0x7efe5c07ee90 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.140+0000 7efe59e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.140+0000 7efe59e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c19ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41942/0 (socket says 172.21.15.82:41942) 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.140+0000 7efe59e00700 1 -- 172.21.15.82:0/3078273186 learned_addr learned my addr 172.21.15.82:0/3078273186 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.140+0000 7efe59e00700 1 -- 172.21.15.82:0/3078273186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c19f220 con 0x7efe5c07ee90 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.141+0000 7efe59e00700 1 --2- 172.21.15.82:0/3078273186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c19ece0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0116a0 tx=0x7efe4c0046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.141+0000 7efe52a00700 1 -- 172.21.15.82:0/3078273186 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe4c003b70 con 0x7efe5c07ee90 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.141+0000 7efe52a00700 1 -- 172.21.15.82:0/3078273186 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7efe4c01a8a0 con 0x7efe5c07ee90 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.141+0000 7efe52a00700 1 -- 172.21.15.82:0/3078273186 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe4c024890 con 0x7efe5c07ee90 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.141+0000 7efe61200700 1 -- 172.21.15.82:0/3078273186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5c19f4b0 con 0x7efe5c07ee90 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.141+0000 7efe61200700 1 -- 172.21.15.82:0/3078273186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe5c1a2190 con 0x7efe5c07ee90 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.142+0000 7efe52a00700 1 -- 172.21.15.82:0/3078273186 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7efe4c022020 con 0x7efe5c07ee90 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.142+0000 7efe61200700 1 -- 172.21.15.82:0/3078273186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe5c064b00 con 0x7efe5c07ee90 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.143+0000 7efe52a00700 1 --2- 172.21.15.82:0/3078273186 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7efe4003e4c0 0x7efe40040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.143+0000 7efe52a00700 1 -- 172.21.15.82:0/3078273186 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efe4c053a30 con 0x7efe5c07ee90 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.144+0000 7efe59400700 1 --2- 172.21.15.82:0/3078273186 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7efe4003e4c0 0x7efe40040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:04.189 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.144+0000 7efe59400700 1 --2- 172.21.15.82:0/3078273186 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7efe4003e4c0 0x7efe40040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe44006fd0 tx=0x7efe44006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.149+0000 7efe52a00700 1 -- 172.21.15.82:0/3078273186 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7efe4c0212c0 con 0x7efe5c07ee90 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.396+0000 7efe61200700 1 -- 172.21.15.82:0/3078273186 --> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7efe5c105490 con 0x7efe4003e4c0 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.407+0000 7efe52a00700 1 -- 172.21.15.82:0/3078273186 <== mgr.14120 v2:172.21.15.82:6800/2219604538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efe5c105490 con 0x7efe4003e4c0 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.410+0000 7efe61200700 1 -- 172.21.15.82:0/3078273186 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7efe4003e4c0 msgr2=0x7efe40040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.410+0000 7efe61200700 1 --2- 172.21.15.82:0/3078273186 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7efe4003e4c0 0x7efe40040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe44006fd0 tx=0x7efe44006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.410+0000 7efe61200700 1 -- 172.21.15.82:0/3078273186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 msgr2=0x7efe5c19ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.410+0000 7efe61200700 1 --2- 172.21.15.82:0/3078273186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c19ece0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0116a0 tx=0x7efe4c0046a0 comp rx=0 tx=0).stop 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.410+0000 7efe61200700 1 -- 172.21.15.82:0/3078273186 shutdown_connections 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.410+0000 7efe61200700 1 --2- 172.21.15.82:0/3078273186 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7efe4003e4c0 0x7efe40040980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.410+0000 7efe61200700 1 --2- 172.21.15.82:0/3078273186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe5c07ee90 0x7efe5c19ece0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.410+0000 7efe61200700 1 -- 172.21.15.82:0/3078273186 >> 172.21.15.82:0/3078273186 conn(0x7efe5c1042d0 msgr2=0x7efe5c104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.411+0000 7efe61200700 1 -- 172.21.15.82:0/3078273186 shutdown_connections 2024-05-03T22:02:04.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:03.411+0000 7efe61200700 1 -- 172.21.15.82:0/3078273186 wait complete. 2024-05-03T22:02:05.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-03T22:02:05.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.808+0000 7f2d3bc00700 1 Processor -- start 2024-05-03T22:02:05.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.808+0000 7f2d3bc00700 1 -- start start 2024-05-03T22:02:05.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.808+0000 7f2d3bc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d34108050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:05.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.808+0000 7f2d3bc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d34108620 con 0x7f2d34107c30 2024-05-03T22:02:05.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.809+0000 7f2d39200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d34108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:05.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.809+0000 7f2d39200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d34108050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46316/0 (socket says 172.21.15.82:46316) 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.809+0000 7f2d39200700 1 -- 172.21.15.82:0/3936663915 learned_addr learned my addr 172.21.15.82:0/3936663915 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.809+0000 7f2d39200700 1 -- 172.21.15.82:0/3936663915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d34108e30 con 0x7f2d34107c30 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.810+0000 7f2d39200700 1 --2- 172.21.15.82:0/3936663915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d34108050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d280098a0 tx=0x7f2d28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949f839c967784bb server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.810+0000 7f2d33400700 1 -- 172.21.15.82:0/3936663915 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d28004160 con 0x7f2d34107c30 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.810+0000 7f2d33400700 1 -- 172.21.15.82:0/3936663915 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f2d28004300 con 0x7f2d34107c30 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.810+0000 7f2d33400700 1 -- 172.21.15.82:0/3936663915 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d280119e0 con 0x7f2d34107c30 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.811+0000 7f2d3bc00700 1 -- 172.21.15.82:0/3936663915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 msgr2=0x7f2d34108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.811+0000 7f2d3bc00700 1 --2- 172.21.15.82:0/3936663915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d34108050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d280098a0 tx=0x7f2d28009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.811+0000 7f2d3bc00700 1 -- 172.21.15.82:0/3936663915 shutdown_connections 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.811+0000 7f2d3bc00700 1 --2- 172.21.15.82:0/3936663915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d34108050 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.811+0000 7f2d3bc00700 1 -- 172.21.15.82:0/3936663915 >> 172.21.15.82:0/3936663915 conn(0x7f2d341031d0 msgr2=0x7f2d34105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.811+0000 7f2d3bc00700 1 -- 172.21.15.82:0/3936663915 shutdown_connections 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.811+0000 7f2d3bc00700 1 -- 172.21.15.82:0/3936663915 wait complete. 2024-05-03T22:02:05.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.812+0000 7f2d3bc00700 1 Processor -- start 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.812+0000 7f2d3bc00700 1 -- start start 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.813+0000 7f2d3bc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d3419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.813+0000 7f2d3bc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3410c060 con 0x7f2d34107c30 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.813+0000 7f2d39200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d3419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.813+0000 7f2d39200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d3419cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46320/0 (socket says 172.21.15.82:46320) 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.813+0000 7f2d39200700 1 -- 172.21.15.82:0/1717712117 learned_addr learned my addr 172.21.15.82:0/1717712117 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.813+0000 7f2d39200700 1 -- 172.21.15.82:0/1717712117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3419d080 con 0x7f2d34107c30 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.814+0000 7f2d39200700 1 --2- 172.21.15.82:0/1717712117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d3419cb40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2d28006b20 tx=0x7f2d28011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.814+0000 7f2d31600700 1 -- 172.21.15.82:0/1717712117 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d28003a60 con 0x7f2d34107c30 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.814+0000 7f2d31600700 1 -- 172.21.15.82:0/1717712117 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f2d28003c00 con 0x7f2d34107c30 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.814+0000 7f2d31600700 1 -- 172.21.15.82:0/1717712117 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d28024780 con 0x7f2d34107c30 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.814+0000 7f2d3bc00700 1 -- 172.21.15.82:0/1717712117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3419d310 con 0x7f2d34107c30 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.814+0000 7f2d3bc00700 1 -- 172.21.15.82:0/1717712117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d341a0000 con 0x7f2d34107c30 2024-05-03T22:02:05.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.815+0000 7f2d31600700 1 -- 172.21.15.82:0/1717712117 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f2d28022020 con 0x7f2d34107c30 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.815+0000 7f2d3bc00700 1 -- 172.21.15.82:0/1717712117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3410c1e0 con 0x7f2d34107c30 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.816+0000 7f2d31600700 1 --2- 172.21.15.82:0/1717712117 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2d1c03e4c0 0x7f2d1c040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.816+0000 7f2d31600700 1 -- 172.21.15.82:0/1717712117 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2d28053ac0 con 0x7f2d34107c30 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.816+0000 7f2d33e00700 1 --2- 172.21.15.82:0/1717712117 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2d1c03e4c0 0x7f2d1c040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.817+0000 7f2d33e00700 1 --2- 172.21.15.82:0/1717712117 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2d1c03e4c0 0x7f2d1c040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2d20006fd0 tx=0x7f2d20006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:04.822+0000 7f2d31600700 1 -- 172.21.15.82:0/1717712117 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2d280212c0 con 0x7f2d34107c30 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.055+0000 7f2d3bc00700 1 -- 172.21.15.82:0/1717712117 --> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f2d3402e840 con 0x7f2d1c03e4c0 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.057+0000 7f2d31600700 1 -- 172.21.15.82:0/1717712117 <== mgr.14120 v2:172.21.15.82:6800/2219604538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f2d3402e840 con 0x7f2d1c03e4c0 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.059+0000 7f2d3bc00700 1 -- 172.21.15.82:0/1717712117 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2d1c03e4c0 msgr2=0x7f2d1c040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.059+0000 7f2d3bc00700 1 --2- 172.21.15.82:0/1717712117 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2d1c03e4c0 0x7f2d1c040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2d20006fd0 tx=0x7f2d20006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.059+0000 7f2d3bc00700 1 -- 172.21.15.82:0/1717712117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 msgr2=0x7f2d3419cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:05.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.059+0000 7f2d3bc00700 1 --2- 172.21.15.82:0/1717712117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d3419cb40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2d28006b20 tx=0x7f2d28011a60 comp rx=0 tx=0).stop 2024-05-03T22:02:05.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.059+0000 7f2d3bc00700 1 -- 172.21.15.82:0/1717712117 shutdown_connections 2024-05-03T22:02:05.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.059+0000 7f2d3bc00700 1 --2- 172.21.15.82:0/1717712117 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2d1c03e4c0 0x7f2d1c040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:05.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.059+0000 7f2d3bc00700 1 --2- 172.21.15.82:0/1717712117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d34107c30 0x7f2d3419cb40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:05.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.059+0000 7f2d3bc00700 1 -- 172.21.15.82:0/1717712117 >> 172.21.15.82:0/1717712117 conn(0x7f2d341031d0 msgr2=0x7f2d34103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:05.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.060+0000 7f2d3bc00700 1 -- 172.21.15.82:0/1717712117 shutdown_connections 2024-05-03T22:02:05.775 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:05.060+0000 7f2d3bc00700 1 -- 172.21.15.82:0/1717712117 wait complete. 2024-05-03T22:02:05.775 INFO:teuthology.orchestra.run.smithi082.stdout:Generating ssh key... 2024-05-03T22:02:05.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:05 smithi082 ceph-mon[28404]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:02:06.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:06 smithi082 ceph-mon[28404]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:02:06.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:06 smithi082 ceph-mon[28404]: Generating ssh key... 2024-05-03T22:02:07.478 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: Generating public/private rsa key pair. 2024-05-03T22:02:07.478 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: Your identification has been saved in /tmp/tmpoghsf6nj/key. 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: Your public key has been saved in /tmp/tmpoghsf6nj/key.pub. 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: The key fingerprint is: 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: SHA256:6WARLSh+RB5G98ycsM+h7z0sBgit66cCUY9u79rpNNc ceph-81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: The key's randomart image is: 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: +---[RSA 3072]----+ 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: | o=.+. | 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: | oooo.O.. | 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: | o *. o.B | 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: |. + + = o | 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: | o + .+ S | 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: |. + ...= | 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: |.. oo ..E. | 2024-05-03T22:02:07.479 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: |. .oo+ .o.o | 2024-05-03T22:02:07.480 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: | o+*= ..... | 2024-05-03T22:02:07.480 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: +----[SHA256]-----+ 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.417+0000 7f2c4b400700 1 Processor -- start 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.417+0000 7f2c4b400700 1 -- start start 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.417+0000 7f2c4b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441120d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.418+0000 7f2c4b400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c44083580 con 0x7f2c4410fce0 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.418+0000 7f2c48a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.418+0000 7f2c48a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46330/0 (socket says 172.21.15.82:46330) 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.418+0000 7f2c48a00700 1 -- 172.21.15.82:0/3276878373 learned_addr learned my addr 172.21.15.82:0/3276878373 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.419+0000 7f2c48a00700 1 -- 172.21.15.82:0/3276878373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c44112610 con 0x7f2c4410fce0 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.419+0000 7f2c48a00700 1 --2- 172.21.15.82:0/3276878373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441120d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2c380098a0 tx=0x7f2c38009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9a7aa9656c928a server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.419+0000 7f2c43400700 1 -- 172.21.15.82:0/3276878373 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c38004160 con 0x7f2c4410fce0 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.419+0000 7f2c43400700 1 -- 172.21.15.82:0/3276878373 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f2c38004300 con 0x7f2c4410fce0 2024-05-03T22:02:07.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.419+0000 7f2c43400700 1 -- 172.21.15.82:0/3276878373 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c380119e0 con 0x7f2c4410fce0 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.420+0000 7f2c4b400700 1 -- 172.21.15.82:0/3276878373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 msgr2=0x7f2c441120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.420+0000 7f2c4b400700 1 --2- 172.21.15.82:0/3276878373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441120d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2c380098a0 tx=0x7f2c38009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.420+0000 7f2c4b400700 1 -- 172.21.15.82:0/3276878373 shutdown_connections 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.420+0000 7f2c4b400700 1 --2- 172.21.15.82:0/3276878373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441120d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.420+0000 7f2c4b400700 1 -- 172.21.15.82:0/3276878373 >> 172.21.15.82:0/3276878373 conn(0x7f2c4407e300 msgr2=0x7f2c44080720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.420+0000 7f2c4b400700 1 -- 172.21.15.82:0/3276878373 shutdown_connections 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.420+0000 7f2c4b400700 1 -- 172.21.15.82:0/3276878373 wait complete. 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.421+0000 7f2c4b400700 1 Processor -- start 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.421+0000 7f2c4b400700 1 -- start start 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.422+0000 7f2c4b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441a30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.422+0000 7f2c4b400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c441135c0 con 0x7f2c4410fce0 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.422+0000 7f2c48a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441a30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.422+0000 7f2c48a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441a30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46334/0 (socket says 172.21.15.82:46334) 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.422+0000 7f2c48a00700 1 -- 172.21.15.82:0/2724186203 learned_addr learned my addr 172.21.15.82:0/2724186203 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.422+0000 7f2c48a00700 1 -- 172.21.15.82:0/2724186203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c441a3610 con 0x7f2c4410fce0 2024-05-03T22:02:07.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.423+0000 7f2c48a00700 1 --2- 172.21.15.82:0/2724186203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441a30d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2c380119e0 tx=0x7f2c380046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.423+0000 7f2c41600700 1 -- 172.21.15.82:0/2724186203 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c38003bf0 con 0x7f2c4410fce0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.423+0000 7f2c41600700 1 -- 172.21.15.82:0/2724186203 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f2c3801a8a0 con 0x7f2c4410fce0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.423+0000 7f2c41600700 1 -- 172.21.15.82:0/2724186203 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c380248c0 con 0x7f2c4410fce0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.423+0000 7f2c4b400700 1 -- 172.21.15.82:0/2724186203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c441a38a0 con 0x7f2c4410fce0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.423+0000 7f2c4b400700 1 -- 172.21.15.82:0/2724186203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c441a6590 con 0x7f2c4410fce0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.424+0000 7f2c4b400700 1 -- 172.21.15.82:0/2724186203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c44064b00 con 0x7f2c4410fce0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.424+0000 7f2c41600700 1 -- 172.21.15.82:0/2724186203 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f2c38022020 con 0x7f2c4410fce0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.425+0000 7f2c41600700 1 --2- 172.21.15.82:0/2724186203 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2c2c03e420 0x7f2c2c0408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.425+0000 7f2c41600700 1 -- 172.21.15.82:0/2724186203 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2c38053980 con 0x7f2c4410fce0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.425+0000 7f2c43e00700 1 --2- 172.21.15.82:0/2724186203 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2c2c03e420 0x7f2c2c0408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.426+0000 7f2c43e00700 1 --2- 172.21.15.82:0/2724186203 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2c2c03e420 0x7f2c2c0408e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c30006fd0 tx=0x7f2c30006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.430+0000 7f2c41600700 1 -- 172.21.15.82:0/2724186203 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2c3802c350 con 0x7f2c4410fce0 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:06.664+0000 7f2c4b400700 1 -- 172.21.15.82:0/2724186203 --> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f2c4407f460 con 0x7f2c2c03e420 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:07.124+0000 7f2c41600700 1 -- 172.21.15.82:0/2724186203 <== mgr.14120 v2:172.21.15.82:6800/2219604538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2c4407f460 con 0x7f2c2c03e420 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:07.127+0000 7f2c4b400700 1 -- 172.21.15.82:0/2724186203 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2c2c03e420 msgr2=0x7f2c2c0408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:07.856 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:07.127+0000 7f2c4b400700 1 --2- 172.21.15.82:0/2724186203 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2c2c03e420 0x7f2c2c0408e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c30006fd0 tx=0x7f2c30006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:07.857 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:07.127+0000 7f2c4b400700 1 -- 172.21.15.82:0/2724186203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 msgr2=0x7f2c441a30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:07.857 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:07.127+0000 7f2c4b400700 1 --2- 172.21.15.82:0/2724186203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441a30d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2c380119e0 tx=0x7f2c380046a0 comp rx=0 tx=0).stop 2024-05-03T22:02:07.857 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:07.127+0000 7f2c4b400700 1 -- 172.21.15.82:0/2724186203 shutdown_connections 2024-05-03T22:02:07.857 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:07.127+0000 7f2c4b400700 1 --2- 172.21.15.82:0/2724186203 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f2c2c03e420 0x7f2c2c0408e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:07.857 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:07.127+0000 7f2c4b400700 1 --2- 172.21.15.82:0/2724186203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4410fce0 0x7f2c441a30d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:07.857 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:07.127+0000 7f2c4b400700 1 -- 172.21.15.82:0/2724186203 >> 172.21.15.82:0/2724186203 conn(0x7f2c4407e300 msgr2=0x7f2c4407ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:07.857 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:07.127+0000 7f2c4b400700 1 -- 172.21.15.82:0/2724186203 shutdown_connections 2024-05-03T22:02:07.857 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:07.127+0000 7f2c4b400700 1 -- 172.21.15.82:0/2724186203 wait complete. 2024-05-03T22:02:08.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:08 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:08.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:08 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:09.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs6FxIs7qd7EhxYr0FpgR5C/FFotbTk3SujeCisoXr8vZ4+Zwd1gITKCWN7mmxSHU/bxl6ib3w24xnxzJR0/J+Jad57JT45kLc9TFOiJN9q1LWTdVCd1vFxoCWNsHV+VJFUid/AZpM7W7wU5XiKJhNY2YVrWrwQz8EGjvdbl1eKSjhiR8uffpYu+E4/BiG7Qpa1Jka0NrwjV77/EGIOHvvYzal/hntkiKihzxc4Cqbx8g1BHDqSYCIliky3OXqIvDXOYDGZGn8D8AbLLuoN0OvrsefaDublOq2k44Y6Rjr88aKnMvbMiUtQHIB8qFm9GcSJxccKrU9VybNfvPdzbBxlkQzKGHjXZBK00Z5FtN7iwpnk/7WtnIgWB5+W9BXTqU4eBoEqdrKHg6DlGQb0uFendtqzWRmKu9+GtiK4nJOEraiYvF9u6s1/XSxAxff03k5iFqlQYhUttb9Qcnur/rWZbWIjlotYrudopzcLF+TQnwazeCJI+m9/3o1eeEbpcM= ceph-81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:02:09.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.504+0000 7f4b32800700 1 Processor -- start 2024-05-03T22:02:09.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.504+0000 7f4b32800700 1 -- start start 2024-05-03T22:02:09.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.505+0000 7f4b32800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:09.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.505+0000 7f4b32800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c109700 con 0x7f4b2c108d10 2024-05-03T22:02:09.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.505+0000 7f4b2b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:09.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.505+0000 7f4b2b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46340/0 (socket says 172.21.15.82:46340) 2024-05-03T22:02:09.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.505+0000 7f4b2b400700 1 -- 172.21.15.82:0/3348866258 learned_addr learned my addr 172.21.15.82:0/3348866258 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:09.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.506+0000 7f4b2b400700 1 -- 172.21.15.82:0/3348866258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c109f10 con 0x7f4b2c108d10 2024-05-03T22:02:09.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.506+0000 7f4b2b400700 1 --2- 172.21.15.82:0/3348866258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c109130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0098a0 tx=0x7f4b1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edebb43fe362a0af server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:09.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.506+0000 7f4b2a000700 1 -- 172.21.15.82:0/3348866258 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c004160 con 0x7f4b2c108d10 2024-05-03T22:02:09.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.507+0000 7f4b2a000700 1 -- 172.21.15.82:0/3348866258 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4b1c004300 con 0x7f4b2c108d10 2024-05-03T22:02:09.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.507+0000 7f4b2a000700 1 -- 172.21.15.82:0/3348866258 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c0119e0 con 0x7f4b2c108d10 2024-05-03T22:02:09.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.507+0000 7f4b32800700 1 -- 172.21.15.82:0/3348866258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 msgr2=0x7f4b2c109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:09.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.507+0000 7f4b32800700 1 --2- 172.21.15.82:0/3348866258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c109130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0098a0 tx=0x7f4b1c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:09.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.507+0000 7f4b32800700 1 -- 172.21.15.82:0/3348866258 shutdown_connections 2024-05-03T22:02:09.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.507+0000 7f4b32800700 1 --2- 172.21.15.82:0/3348866258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c109130 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:09.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.507+0000 7f4b32800700 1 -- 172.21.15.82:0/3348866258 >> 172.21.15.82:0/3348866258 conn(0x7f4b2c1042d0 msgr2=0x7f4b2c1066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:09.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.507+0000 7f4b32800700 1 -- 172.21.15.82:0/3348866258 shutdown_connections 2024-05-03T22:02:09.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.508+0000 7f4b32800700 1 -- 172.21.15.82:0/3348866258 wait complete. 2024-05-03T22:02:09.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.509+0000 7f4b32800700 1 Processor -- start 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.509+0000 7f4b32800700 1 -- start start 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.509+0000 7f4b32800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c19cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.509+0000 7f4b32800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c10d140 con 0x7f4b2c108d10 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.509+0000 7f4b2b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c19cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.509+0000 7f4b2b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c19cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46350/0 (socket says 172.21.15.82:46350) 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.509+0000 7f4b2b400700 1 -- 172.21.15.82:0/1186499160 learned_addr learned my addr 172.21.15.82:0/1186499160 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.510+0000 7f4b2b400700 1 -- 172.21.15.82:0/1186499160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c19d040 con 0x7f4b2c108d10 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.510+0000 7f4b2b400700 1 --2- 172.21.15.82:0/1186499160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c19cb00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c006b20 tx=0x7f4b1c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.510+0000 7f4b23e00700 1 -- 172.21.15.82:0/1186499160 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c003a60 con 0x7f4b2c108d10 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.510+0000 7f4b23e00700 1 -- 172.21.15.82:0/1186499160 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4b1c003c00 con 0x7f4b2c108d10 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.510+0000 7f4b23e00700 1 -- 172.21.15.82:0/1186499160 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1c024780 con 0x7f4b2c108d10 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.510+0000 7f4b32800700 1 -- 172.21.15.82:0/1186499160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2c19d2d0 con 0x7f4b2c108d10 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.510+0000 7f4b32800700 1 -- 172.21.15.82:0/1186499160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2c19ffc0 con 0x7f4b2c108d10 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.512+0000 7f4b32800700 1 -- 172.21.15.82:0/1186499160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b2c10d2c0 con 0x7f4b2c108d10 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.512+0000 7f4b23e00700 1 -- 172.21.15.82:0/1186499160 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f4b1c022020 con 0x7f4b2c108d10 2024-05-03T22:02:09.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.512+0000 7f4b23e00700 1 --2- 172.21.15.82:0/1186499160 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4b1003e4c0 0x7f4b10040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:09.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.512+0000 7f4b23e00700 1 -- 172.21.15.82:0/1186499160 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4b1c053a80 con 0x7f4b2c108d10 2024-05-03T22:02:09.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.512+0000 7f4b2aa00700 1 --2- 172.21.15.82:0/1186499160 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4b1003e4c0 0x7f4b10040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:09.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.513+0000 7f4b2aa00700 1 --2- 172.21.15.82:0/1186499160 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4b1003e4c0 0x7f4b10040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4b18006fd0 tx=0x7f4b18006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:09.503 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.517+0000 7f4b23e00700 1 -- 172.21.15.82:0/1186499160 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4b1c0212c0 con 0x7f4b2c108d10 2024-05-03T22:02:09.503 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.750+0000 7f4b32800700 1 -- 172.21.15.82:0/1186499160 --> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f4b2c1053e0 con 0x7f4b1003e4c0 2024-05-03T22:02:09.503 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.752+0000 7f4b23e00700 1 -- 172.21.15.82:0/1186499160 <== mgr.14120 v2:172.21.15.82:6800/2219604538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f4b2c1053e0 con 0x7f4b1003e4c0 2024-05-03T22:02:09.503 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.754+0000 7f4b32800700 1 -- 172.21.15.82:0/1186499160 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4b1003e4c0 msgr2=0x7f4b10040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:09.504 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.755+0000 7f4b32800700 1 --2- 172.21.15.82:0/1186499160 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4b1003e4c0 0x7f4b10040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4b18006fd0 tx=0x7f4b18006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:09.504 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.755+0000 7f4b32800700 1 -- 172.21.15.82:0/1186499160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 msgr2=0x7f4b2c19cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:09.504 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.755+0000 7f4b32800700 1 --2- 172.21.15.82:0/1186499160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c19cb00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c006b20 tx=0x7f4b1c011a60 comp rx=0 tx=0).stop 2024-05-03T22:02:09.504 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.755+0000 7f4b32800700 1 -- 172.21.15.82:0/1186499160 shutdown_connections 2024-05-03T22:02:09.504 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.755+0000 7f4b32800700 1 --2- 172.21.15.82:0/1186499160 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4b1003e4c0 0x7f4b10040980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:09.504 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.755+0000 7f4b32800700 1 --2- 172.21.15.82:0/1186499160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b2c108d10 0x7f4b2c19cb00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:09.504 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.755+0000 7f4b32800700 1 -- 172.21.15.82:0/1186499160 >> 172.21.15.82:0/1186499160 conn(0x7f4b2c1042d0 msgr2=0x7f4b2c104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:09.504 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.755+0000 7f4b32800700 1 -- 172.21.15.82:0/1186499160 shutdown_connections 2024-05-03T22:02:09.504 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:08.755+0000 7f4b32800700 1 -- 172.21.15.82:0/1186499160 wait complete. 2024-05-03T22:02:09.504 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-03T22:02:09.504 INFO:teuthology.orchestra.run.smithi082.stdout:Adding key to root@localhost authorized_keys... 2024-05-03T22:02:09.505 INFO:teuthology.orchestra.run.smithi082.stdout:Adding host smithi082... 2024-05-03T22:02:10.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:09 smithi082 ceph-mon[28404]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:02:11.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:10 smithi082 ceph-mon[28404]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:02:12.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:12 smithi082 ceph-mon[28404]: Deploying cephadm binary to smithi082 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Added host 'smithi082' with addr '172.21.15.82' 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.183+0000 7f9401c00700 1 Processor -- start 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.184+0000 7f9401c00700 1 -- start start 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.184+0000 7f9401c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc10b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.184+0000 7f9401c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc10b730 con 0x7f93fc10ad40 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.184+0000 7f93fbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc10b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.185+0000 7f93fbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc10b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46366/0 (socket says 172.21.15.82:46366) 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.185+0000 7f93fbe00700 1 -- 172.21.15.82:0/1647229170 learned_addr learned my addr 172.21.15.82:0/1647229170 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.185+0000 7f93fbe00700 1 -- 172.21.15.82:0/1647229170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc10bf40 con 0x7f93fc10ad40 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.185+0000 7f93fbe00700 1 --2- 172.21.15.82:0/1647229170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc10b160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0098a0 tx=0x7f93ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d015cb9b4d86b95 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.186+0000 7f93faa00700 1 -- 172.21.15.82:0/1647229170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ec004160 con 0x7f93fc10ad40 2024-05-03T22:02:17.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.186+0000 7f93faa00700 1 -- 172.21.15.82:0/1647229170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f93ec004300 con 0x7f93fc10ad40 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.186+0000 7f93faa00700 1 -- 172.21.15.82:0/1647229170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ec0119e0 con 0x7f93fc10ad40 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.186+0000 7f9401c00700 1 -- 172.21.15.82:0/1647229170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 msgr2=0x7f93fc10b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.186+0000 7f9401c00700 1 --2- 172.21.15.82:0/1647229170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc10b160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0098a0 tx=0x7f93ec009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.186+0000 7f9401c00700 1 -- 172.21.15.82:0/1647229170 shutdown_connections 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.186+0000 7f9401c00700 1 --2- 172.21.15.82:0/1647229170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc10b160 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.186+0000 7f9401c00700 1 -- 172.21.15.82:0/1647229170 >> 172.21.15.82:0/1647229170 conn(0x7f93fc07e110 msgr2=0x7f93fc07e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.187+0000 7f9401c00700 1 -- 172.21.15.82:0/1647229170 shutdown_connections 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.187+0000 7f9401c00700 1 -- 172.21.15.82:0/1647229170 wait complete. 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.188+0000 7f9401c00700 1 Processor -- start 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.188+0000 7f9401c00700 1 -- start start 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.188+0000 7f9401c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.188+0000 7f9401c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc10f170 con 0x7f93fc10ad40 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.189+0000 7f93fbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:17.362 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.189+0000 7f93fbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc19eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46376/0 (socket says 172.21.15.82:46376) 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.189+0000 7f93fbe00700 1 -- 172.21.15.82:0/366906049 learned_addr learned my addr 172.21.15.82:0/366906049 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.189+0000 7f93fbe00700 1 -- 172.21.15.82:0/366906049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc19f040 con 0x7f93fc10ad40 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.189+0000 7f93fbe00700 1 --2- 172.21.15.82:0/366906049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc19eb00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0119b0 tx=0x7f93ec011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.190+0000 7f93f8c00700 1 -- 172.21.15.82:0/366906049 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ec003af0 con 0x7f93fc10ad40 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.190+0000 7f93f8c00700 1 -- 172.21.15.82:0/366906049 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f93ec01a8a0 con 0x7f93fc10ad40 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.190+0000 7f93f8c00700 1 -- 172.21.15.82:0/366906049 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ec024830 con 0x7f93fc10ad40 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.190+0000 7f9401c00700 1 -- 172.21.15.82:0/366906049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93fc19f2d0 con 0x7f93fc10ad40 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.190+0000 7f9401c00700 1 -- 172.21.15.82:0/366906049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93fc1a1fc0 con 0x7f93fc10ad40 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.191+0000 7f9401c00700 1 -- 172.21.15.82:0/366906049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93fc10f2f0 con 0x7f93fc10ad40 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.191+0000 7f93f8c00700 1 -- 172.21.15.82:0/366906049 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f93ec022020 con 0x7f93fc10ad40 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.192+0000 7f93f8c00700 1 --2- 172.21.15.82:0/366906049 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f93e003e4c0 0x7f93e0040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.192+0000 7f93f8c00700 1 -- 172.21.15.82:0/366906049 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f93ec053920 con 0x7f93fc10ad40 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.193+0000 7f93fb400700 1 --2- 172.21.15.82:0/366906049 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f93e003e4c0 0x7f93e0040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.193+0000 7f93fb400700 1 --2- 172.21.15.82:0/366906049 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f93e003e4c0 0x7f93e0040980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f93e8006fd0 tx=0x7f93e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:17.363 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.198+0000 7f93f8c00700 1 -- 172.21.15.82:0/366906049 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f93ec053270 con 0x7f93fc10ad40 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:10.432+0000 7f9401c00700 1 -- 172.21.15.82:0/366906049 --> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}) -- 0x7f93fc108ad0 con 0x7f93e003e4c0 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:16.365+0000 7f93f8c00700 1 -- 172.21.15.82:0/366906049 <== mgr.14120 v2:172.21.15.82:6800/2219604538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f93fc108ad0 con 0x7f93e003e4c0 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:16.369+0000 7f9401c00700 1 -- 172.21.15.82:0/366906049 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f93e003e4c0 msgr2=0x7f93e0040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:16.369+0000 7f9401c00700 1 --2- 172.21.15.82:0/366906049 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f93e003e4c0 0x7f93e0040980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f93e8006fd0 tx=0x7f93e8006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:16.369+0000 7f9401c00700 1 -- 172.21.15.82:0/366906049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 msgr2=0x7f93fc19eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:16.369+0000 7f9401c00700 1 --2- 172.21.15.82:0/366906049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc19eb00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0119b0 tx=0x7f93ec011a90 comp rx=0 tx=0).stop 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:16.370+0000 7f9401c00700 1 -- 172.21.15.82:0/366906049 shutdown_connections 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:16.370+0000 7f9401c00700 1 --2- 172.21.15.82:0/366906049 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f93e003e4c0 0x7f93e0040980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:16.370+0000 7f9401c00700 1 --2- 172.21.15.82:0/366906049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93fc10ad40 0x7f93fc19eb00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:16.370+0000 7f9401c00700 1 -- 172.21.15.82:0/366906049 >> 172.21.15.82:0/366906049 conn(0x7f93fc07e110 msgr2=0x7f93fc1083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:16.370+0000 7f9401c00700 1 -- 172.21.15.82:0/366906049 shutdown_connections 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:16.370+0000 7f9401c00700 1 -- 172.21.15.82:0/366906049 wait complete. 2024-05-03T22:02:17.364 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mon service... 2024-05-03T22:02:17.606 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:17 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:17.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:17 smithi082 ceph-mon[28404]: Added host smithi082 2024-05-03T22:02:17.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:17 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:02:19.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-03T22:02:19.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.094+0000 7f408d600700 1 Processor -- start 2024-05-03T22:02:19.262 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.094+0000 7f408d600700 1 -- start start 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.094+0000 7f408d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408807d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.094+0000 7f408d600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f408807d8c0 con 0x7f408807ee90 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.095+0000 7f4086a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408807d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.095+0000 7f4086a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408807d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38160/0 (socket says 172.21.15.82:38160) 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.095+0000 7f4086a00700 1 -- 172.21.15.82:0/3821374024 learned_addr learned my addr 172.21.15.82:0/3821374024 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.095+0000 7f4086a00700 1 -- 172.21.15.82:0/3821374024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408807da40 con 0x7f408807ee90 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.096+0000 7f4086a00700 1 --2- 172.21.15.82:0/3821374024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408807d2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f40780098a0 tx=0x7f4078009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41752c50618d08dd server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.096+0000 7f4085600700 1 -- 172.21.15.82:0/3821374024 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4078004160 con 0x7f408807ee90 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.096+0000 7f4085600700 1 -- 172.21.15.82:0/3821374024 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4078004300 con 0x7f408807ee90 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.096+0000 7f4085600700 1 -- 172.21.15.82:0/3821374024 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40780119e0 con 0x7f408807ee90 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.097+0000 7f408d600700 1 -- 172.21.15.82:0/3821374024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 msgr2=0x7f408807d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:19.263 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.097+0000 7f408d600700 1 --2- 172.21.15.82:0/3821374024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408807d2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f40780098a0 tx=0x7f4078009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.097+0000 7f408d600700 1 -- 172.21.15.82:0/3821374024 shutdown_connections 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.097+0000 7f408d600700 1 --2- 172.21.15.82:0/3821374024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408807d2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.097+0000 7f408d600700 1 -- 172.21.15.82:0/3821374024 >> 172.21.15.82:0/3821374024 conn(0x7f40881042d0 msgr2=0x7f40881066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.097+0000 7f408d600700 1 -- 172.21.15.82:0/3821374024 shutdown_connections 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.097+0000 7f408d600700 1 -- 172.21.15.82:0/3821374024 wait complete. 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.098+0000 7f408d600700 1 Processor -- start 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.098+0000 7f408d600700 1 -- start start 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.098+0000 7f408d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408819ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.098+0000 7f408d600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f408810f220 con 0x7f408807ee90 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.099+0000 7f4086a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408819ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.099+0000 7f4086a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408819ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38176/0 (socket says 172.21.15.82:38176) 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.099+0000 7f4086a00700 1 -- 172.21.15.82:0/736615627 learned_addr learned my addr 172.21.15.82:0/736615627 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.099+0000 7f4086a00700 1 -- 172.21.15.82:0/736615627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408819f1f0 con 0x7f408807ee90 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.099+0000 7f4086a00700 1 --2- 172.21.15.82:0/736615627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408819ecb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f40780119e0 tx=0x7f40780046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:19.264 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.100+0000 7f407f400700 1 -- 172.21.15.82:0/736615627 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4078003bf0 con 0x7f408807ee90 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.100+0000 7f407f400700 1 -- 172.21.15.82:0/736615627 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f407801a8a0 con 0x7f408807ee90 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.100+0000 7f407f400700 1 -- 172.21.15.82:0/736615627 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40780248c0 con 0x7f408807ee90 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.100+0000 7f408d600700 1 -- 172.21.15.82:0/736615627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408819f480 con 0x7f408807ee90 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.100+0000 7f408d600700 1 -- 172.21.15.82:0/736615627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40881a2170 con 0x7f408807ee90 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.101+0000 7f408d600700 1 -- 172.21.15.82:0/736615627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4088064b00 con 0x7f408807ee90 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.101+0000 7f407f400700 1 -- 172.21.15.82:0/736615627 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f4078022020 con 0x7f408807ee90 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.102+0000 7f407f400700 1 --2- 172.21.15.82:0/736615627 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f406c03e420 0x7f406c0408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.102+0000 7f407f400700 1 -- 172.21.15.82:0/736615627 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4078053ba0 con 0x7f408807ee90 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.102+0000 7f4086000700 1 --2- 172.21.15.82:0/736615627 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f406c03e420 0x7f406c0408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.103+0000 7f4086000700 1 --2- 172.21.15.82:0/736615627 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f406c03e420 0x7f406c0408e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4074006fd0 tx=0x7f4074006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.108+0000 7f407f400700 1 -- 172.21.15.82:0/736615627 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f407802b350 con 0x7f408807ee90 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.374+0000 7f408d600700 1 -- 172.21.15.82:0/736615627 --> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f40881053e0 con 0x7f406c03e420 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.386+0000 7f407f400700 1 -- 172.21.15.82:0/736615627 <== mgr.14120 v2:172.21.15.82:6800/2219604538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f40881053e0 con 0x7f406c03e420 2024-05-03T22:02:19.265 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.389+0000 7f408d600700 1 -- 172.21.15.82:0/736615627 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f406c03e420 msgr2=0x7f406c0408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:19.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.389+0000 7f408d600700 1 --2- 172.21.15.82:0/736615627 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f406c03e420 0x7f406c0408e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4074006fd0 tx=0x7f4074006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:19.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.389+0000 7f408d600700 1 -- 172.21.15.82:0/736615627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 msgr2=0x7f408819ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:19.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.389+0000 7f408d600700 1 --2- 172.21.15.82:0/736615627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408819ecb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f40780119e0 tx=0x7f40780046a0 comp rx=0 tx=0).stop 2024-05-03T22:02:19.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.389+0000 7f408d600700 1 -- 172.21.15.82:0/736615627 shutdown_connections 2024-05-03T22:02:19.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.389+0000 7f408d600700 1 --2- 172.21.15.82:0/736615627 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f406c03e420 0x7f406c0408e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:19.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.389+0000 7f408d600700 1 --2- 172.21.15.82:0/736615627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f408807ee90 0x7f408819ecb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:19.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.389+0000 7f408d600700 1 -- 172.21.15.82:0/736615627 >> 172.21.15.82:0/736615627 conn(0x7f40881042d0 msgr2=0x7f4088104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:19.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.390+0000 7f408d600700 1 -- 172.21.15.82:0/736615627 shutdown_connections 2024-05-03T22:02:19.266 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:18.390+0000 7f408d600700 1 -- 172.21.15.82:0/736615627 wait complete. 2024-05-03T22:02:19.266 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mgr service... 2024-05-03T22:02:19.592 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:19 smithi082 ceph-mon[28404]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:02:19.593 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:19 smithi082 ceph-mon[28404]: Saving service mon spec with placement count:5 2024-05-03T22:02:19.593 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:19 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:21.750 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-03T22:02:21.750 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.341+0000 7f276c200700 1 Processor -- start 2024-05-03T22:02:21.750 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.341+0000 7f276c200700 1 -- start start 2024-05-03T22:02:21.750 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.342+0000 7f276c200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276410b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:21.750 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.342+0000 7f276c200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f276410b870 con 0x7f276410af10 2024-05-03T22:02:21.751 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.342+0000 7f2769800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276410b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:21.751 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.342+0000 7f2769800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276410b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38192/0 (socket says 172.21.15.82:38192) 2024-05-03T22:02:21.751 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.342+0000 7f2769800700 1 -- 172.21.15.82:0/2136923365 learned_addr learned my addr 172.21.15.82:0/2136923365 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:21.751 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.342+0000 7f2769800700 1 -- 172.21.15.82:0/2136923365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276410c070 con 0x7f276410af10 2024-05-03T22:02:21.751 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.343+0000 7f2769800700 1 --2- 172.21.15.82:0/2136923365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276410b330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f27580098a0 tx=0x7f2758009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d8f45d6dc4388d server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:21.751 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.343+0000 7f2763e00700 1 -- 172.21.15.82:0/2136923365 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2758004160 con 0x7f276410af10 2024-05-03T22:02:21.751 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.343+0000 7f2763e00700 1 -- 172.21.15.82:0/2136923365 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f2758004300 con 0x7f276410af10 2024-05-03T22:02:21.751 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.343+0000 7f2763e00700 1 -- 172.21.15.82:0/2136923365 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27580119e0 con 0x7f276410af10 2024-05-03T22:02:21.751 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.343+0000 7f276c200700 1 -- 172.21.15.82:0/2136923365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 msgr2=0x7f276410b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:21.751 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.344+0000 7f276c200700 1 --2- 172.21.15.82:0/2136923365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276410b330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f27580098a0 tx=0x7f2758009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:21.751 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.344+0000 7f276c200700 1 -- 172.21.15.82:0/2136923365 shutdown_connections 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.344+0000 7f276c200700 1 --2- 172.21.15.82:0/2136923365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276410b330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.344+0000 7f276c200700 1 -- 172.21.15.82:0/2136923365 >> 172.21.15.82:0/2136923365 conn(0x7f276407e300 msgr2=0x7f276407e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.344+0000 7f276c200700 1 -- 172.21.15.82:0/2136923365 shutdown_connections 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.344+0000 7f276c200700 1 -- 172.21.15.82:0/2136923365 wait complete. 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.345+0000 7f276c200700 1 Processor -- start 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.345+0000 7f276c200700 1 -- start start 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.345+0000 7f276c200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276419ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.345+0000 7f276c200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f276410f330 con 0x7f276410af10 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.345+0000 7f2769800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276419ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.345+0000 7f2769800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276419ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38200/0 (socket says 172.21.15.82:38200) 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.345+0000 7f2769800700 1 -- 172.21.15.82:0/869503617 learned_addr learned my addr 172.21.15.82:0/869503617 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:21.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.346+0000 7f2769800700 1 -- 172.21.15.82:0/869503617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276419f220 con 0x7f276410af10 2024-05-03T22:02:21.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.346+0000 7f2769800700 1 --2- 172.21.15.82:0/869503617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276419ece0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f27580119e0 tx=0x7f27580046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:21.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.346+0000 7f2762000700 1 -- 172.21.15.82:0/869503617 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2758003bf0 con 0x7f276410af10 2024-05-03T22:02:21.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.346+0000 7f2762000700 1 -- 172.21.15.82:0/869503617 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f275801a8a0 con 0x7f276410af10 2024-05-03T22:02:21.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.346+0000 7f2762000700 1 -- 172.21.15.82:0/869503617 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27580248c0 con 0x7f276410af10 2024-05-03T22:02:21.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.346+0000 7f276c200700 1 -- 172.21.15.82:0/869503617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276419f4b0 con 0x7f276410af10 2024-05-03T22:02:21.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.346+0000 7f276c200700 1 -- 172.21.15.82:0/869503617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27641a2190 con 0x7f276410af10 2024-05-03T22:02:21.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.347+0000 7f2762000700 1 -- 172.21.15.82:0/869503617 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f2758022020 con 0x7f276410af10 2024-05-03T22:02:21.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.347+0000 7f276c200700 1 -- 172.21.15.82:0/869503617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2764064b00 con 0x7f276410af10 2024-05-03T22:02:21.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.348+0000 7f2762000700 1 --2- 172.21.15.82:0/869503617 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f274c03e420 0x7f274c0408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:21.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.348+0000 7f2762000700 1 -- 172.21.15.82:0/869503617 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2758053980 con 0x7f276410af10 2024-05-03T22:02:21.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.348+0000 7f2768e00700 1 --2- 172.21.15.82:0/869503617 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f274c03e420 0x7f274c0408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:21.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.349+0000 7f2768e00700 1 --2- 172.21.15.82:0/869503617 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f274c03e420 0x7f274c0408e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2750006fd0 tx=0x7f2750006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:21.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.353+0000 7f2762000700 1 -- 172.21.15.82:0/869503617 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f275802c350 con 0x7f276410af10 2024-05-03T22:02:21.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.589+0000 7f276c200700 1 -- 172.21.15.82:0/869503617 --> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2764108b20 con 0x7f274c03e420 2024-05-03T22:02:21.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.600+0000 7f2762000700 1 -- 172.21.15.82:0/869503617 <== mgr.14120 v2:172.21.15.82:6800/2219604538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2764108b20 con 0x7f274c03e420 2024-05-03T22:02:21.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.602+0000 7f276c200700 1 -- 172.21.15.82:0/869503617 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f274c03e420 msgr2=0x7f274c0408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:21.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.602+0000 7f276c200700 1 --2- 172.21.15.82:0/869503617 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f274c03e420 0x7f274c0408e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2750006fd0 tx=0x7f2750006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:21.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.602+0000 7f276c200700 1 -- 172.21.15.82:0/869503617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 msgr2=0x7f276419ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:21.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.602+0000 7f276c200700 1 --2- 172.21.15.82:0/869503617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276419ece0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f27580119e0 tx=0x7f27580046a0 comp rx=0 tx=0).stop 2024-05-03T22:02:21.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.602+0000 7f276c200700 1 -- 172.21.15.82:0/869503617 shutdown_connections 2024-05-03T22:02:21.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.602+0000 7f276c200700 1 --2- 172.21.15.82:0/869503617 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f274c03e420 0x7f274c0408e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:21.755 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.602+0000 7f276c200700 1 --2- 172.21.15.82:0/869503617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276410af10 0x7f276419ece0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:21.755 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.602+0000 7f276c200700 1 -- 172.21.15.82:0/869503617 >> 172.21.15.82:0/869503617 conn(0x7f276407e300 msgr2=0x7f2764108410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:21.755 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.603+0000 7f276c200700 1 -- 172.21.15.82:0/869503617 shutdown_connections 2024-05-03T22:02:21.755 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:20.603+0000 7f276c200700 1 -- 172.21.15.82:0/869503617 wait complete. 2024-05-03T22:02:21.895 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:21 smithi082 ceph-mon[28404]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:02:21.895 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:21 smithi082 ceph-mon[28404]: Saving service mgr spec with placement count:2 2024-05-03T22:02:21.895 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:21 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:21.895 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:21 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:22 smithi082 ceph-mon[28404]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:02:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:22 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:23.340 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.363+0000 7f6ac9a00700 1 Processor -- start 2024-05-03T22:02:23.340 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.363+0000 7f6ac9a00700 1 -- start start 2024-05-03T22:02:23.340 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.364+0000 7f6ac9a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac4109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:23.340 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.364+0000 7f6ac9a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac4109700 con 0x7f6ac4108d10 2024-05-03T22:02:23.340 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.364+0000 7f6ac2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac4109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:23.340 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.364+0000 7f6ac2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac4109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38214/0 (socket says 172.21.15.82:38214) 2024-05-03T22:02:23.340 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.364+0000 7f6ac2a00700 1 -- 172.21.15.82:0/1713216145 learned_addr learned my addr 172.21.15.82:0/1713216145 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:23.340 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.365+0000 7f6ac2a00700 1 -- 172.21.15.82:0/1713216145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac4109f10 con 0x7f6ac4108d10 2024-05-03T22:02:23.340 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.365+0000 7f6ac2a00700 1 --2- 172.21.15.82:0/1713216145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac4109130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40098a0 tx=0x7f6ab4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b775fed3e984eea8 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:23.340 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.365+0000 7f6ac1600700 1 -- 172.21.15.82:0/1713216145 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ab4004160 con 0x7f6ac4108d10 2024-05-03T22:02:23.340 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.365+0000 7f6ac1600700 1 -- 172.21.15.82:0/1713216145 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ab4004300 con 0x7f6ac4108d10 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.365+0000 7f6ac1600700 1 -- 172.21.15.82:0/1713216145 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ab4011960 con 0x7f6ac4108d10 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.366+0000 7f6ac9a00700 1 -- 172.21.15.82:0/1713216145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 msgr2=0x7f6ac4109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.366+0000 7f6ac9a00700 1 --2- 172.21.15.82:0/1713216145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac4109130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40098a0 tx=0x7f6ab4009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.366+0000 7f6ac9a00700 1 -- 172.21.15.82:0/1713216145 shutdown_connections 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.366+0000 7f6ac9a00700 1 --2- 172.21.15.82:0/1713216145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac4109130 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.366+0000 7f6ac9a00700 1 -- 172.21.15.82:0/1713216145 >> 172.21.15.82:0/1713216145 conn(0x7f6ac41042d0 msgr2=0x7f6ac41066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.366+0000 7f6ac9a00700 1 -- 172.21.15.82:0/1713216145 shutdown_connections 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.366+0000 7f6ac9a00700 1 -- 172.21.15.82:0/1713216145 wait complete. 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.367+0000 7f6ac9a00700 1 Processor -- start 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.367+0000 7f6ac9a00700 1 -- start start 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.368+0000 7f6ac9a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac407eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.368+0000 7f6ac9a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac410d140 con 0x7f6ac4108d10 2024-05-03T22:02:23.341 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.368+0000 7f6ac2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac407eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.368+0000 7f6ac2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac407eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38228/0 (socket says 172.21.15.82:38228) 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.368+0000 7f6ac2a00700 1 -- 172.21.15.82:0/3648200701 learned_addr learned my addr 172.21.15.82:0/3648200701 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.368+0000 7f6ac2a00700 1 -- 172.21.15.82:0/3648200701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac407f0c0 con 0x7f6ac4108d10 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.369+0000 7f6ac2a00700 1 --2- 172.21.15.82:0/3648200701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac407eb80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4011670 tx=0x7f6ab4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.369+0000 7f6abb400700 1 -- 172.21.15.82:0/3648200701 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ab401f070 con 0x7f6ac4108d10 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.369+0000 7f6abb400700 1 -- 172.21.15.82:0/3648200701 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ab4003b20 con 0x7f6ac4108d10 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.369+0000 7f6abb400700 1 -- 172.21.15.82:0/3648200701 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ab4019580 con 0x7f6ac4108d10 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.369+0000 7f6ac9a00700 1 -- 172.21.15.82:0/3648200701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac407d2b0 con 0x7f6ac4108d10 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.369+0000 7f6ac9a00700 1 -- 172.21.15.82:0/3648200701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac407d7f0 con 0x7f6ac4108d10 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.370+0000 7f6ac9a00700 1 -- 172.21.15.82:0/3648200701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac4064b00 con 0x7f6ac4108d10 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.371+0000 7f6abb400700 1 -- 172.21.15.82:0/3648200701 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f6ab4022070 con 0x7f6ac4108d10 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.371+0000 7f6abb400700 1 --2- 172.21.15.82:0/3648200701 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f6aa803e4c0 0x7f6aa8040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.371+0000 7f6abb400700 1 -- 172.21.15.82:0/3648200701 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6ab40539a0 con 0x7f6ac4108d10 2024-05-03T22:02:23.342 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.371+0000 7f6ac2000700 1 --2- 172.21.15.82:0/3648200701 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f6aa803e4c0 0x7f6aa8040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.372+0000 7f6ac2000700 1 --2- 172.21.15.82:0/3648200701 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f6aa803e4c0 0x7f6aa8040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0006fd0 tx=0x7f6ab0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.377+0000 7f6abb400700 1 -- 172.21.15.82:0/3648200701 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6ab402cd00 con 0x7f6ac4108d10 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.609+0000 7f6ac9a00700 1 -- 172.21.15.82:0/3648200701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f6ac407e090 con 0x7f6ac4108d10 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.617+0000 7f6abb400700 1 -- 172.21.15.82:0/3648200701 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f6ab401ba80 con 0x7f6ac4108d10 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.620+0000 7f6ac9a00700 1 -- 172.21.15.82:0/3648200701 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f6aa803e4c0 msgr2=0x7f6aa8040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.620+0000 7f6ac9a00700 1 --2- 172.21.15.82:0/3648200701 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f6aa803e4c0 0x7f6aa8040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0006fd0 tx=0x7f6ab0006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.620+0000 7f6ac9a00700 1 -- 172.21.15.82:0/3648200701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 msgr2=0x7f6ac407eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.620+0000 7f6ac9a00700 1 --2- 172.21.15.82:0/3648200701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac407eb80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4011670 tx=0x7f6ab4011a30 comp rx=0 tx=0).stop 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.620+0000 7f6ac9a00700 1 -- 172.21.15.82:0/3648200701 shutdown_connections 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.620+0000 7f6ac9a00700 1 --2- 172.21.15.82:0/3648200701 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f6aa803e4c0 0x7f6aa8040980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.620+0000 7f6ac9a00700 1 --2- 172.21.15.82:0/3648200701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ac4108d10 0x7f6ac407eb80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.620+0000 7f6ac9a00700 1 -- 172.21.15.82:0/3648200701 >> 172.21.15.82:0/3648200701 conn(0x7f6ac41042d0 msgr2=0x7f6ac4104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.620+0000 7f6ac9a00700 1 -- 172.21.15.82:0/3648200701 shutdown_connections 2024-05-03T22:02:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:22.620+0000 7f6ac9a00700 1 -- 172.21.15.82:0/3648200701 wait complete. 2024-05-03T22:02:23.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:23 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3648200701' entity='client.admin' 2024-05-03T22:02:24.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:24 smithi082 ceph-mon[28404]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:02:24.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:24 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3183221927' entity='client.admin' 2024-05-03T22:02:25.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.972+0000 7f9860600700 1 Processor -- start 2024-05-03T22:02:25.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.972+0000 7f9860600700 1 -- start start 2024-05-03T22:02:25.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.973+0000 7f9860600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f9858109140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:25.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.973+0000 7f9860600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9858109710 con 0x7f9858108d20 2024-05-03T22:02:25.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.973+0000 7f985dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f9858109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:25.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.973+0000 7f985dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f9858109140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51340/0 (socket says 172.21.15.82:51340) 2024-05-03T22:02:25.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.973+0000 7f985dc00700 1 -- 172.21.15.82:0/2282645461 learned_addr learned my addr 172.21.15.82:0/2282645461 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:25.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.973+0000 7f985dc00700 1 -- 172.21.15.82:0/2282645461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9858109f20 con 0x7f9858108d20 2024-05-03T22:02:25.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.974+0000 7f985dc00700 1 --2- 172.21.15.82:0/2282645461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f9858109140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f984c0098a0 tx=0x7f984c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fffe60792f7ff server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:25.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.974+0000 7f9857e00700 1 -- 172.21.15.82:0/2282645461 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c004160 con 0x7f9858108d20 2024-05-03T22:02:25.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.974+0000 7f9857e00700 1 -- 172.21.15.82:0/2282645461 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f984c004300 con 0x7f9858108d20 2024-05-03T22:02:25.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.974+0000 7f9857e00700 1 -- 172.21.15.82:0/2282645461 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c011960 con 0x7f9858108d20 2024-05-03T22:02:25.299 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.975+0000 7f9860600700 1 -- 172.21.15.82:0/2282645461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 msgr2=0x7f9858109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:25.299 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.975+0000 7f9860600700 1 --2- 172.21.15.82:0/2282645461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f9858109140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f984c0098a0 tx=0x7f984c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:25.299 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.975+0000 7f9860600700 1 -- 172.21.15.82:0/2282645461 shutdown_connections 2024-05-03T22:02:25.299 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.975+0000 7f9860600700 1 --2- 172.21.15.82:0/2282645461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f9858109140 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:25.299 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.975+0000 7f9860600700 1 -- 172.21.15.82:0/2282645461 >> 172.21.15.82:0/2282645461 conn(0x7f98581042a0 msgr2=0x7f9858106700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:25.299 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.975+0000 7f9860600700 1 -- 172.21.15.82:0/2282645461 shutdown_connections 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.975+0000 7f9860600700 1 -- 172.21.15.82:0/2282645461 wait complete. 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.976+0000 7f9860600700 1 Processor -- start 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.976+0000 7f9860600700 1 -- start start 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.976+0000 7f9860600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f985807eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.976+0000 7f9860600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f985810d150 con 0x7f9858108d20 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.977+0000 7f985dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f985807eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.977+0000 7f985dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f985807eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51348/0 (socket says 172.21.15.82:51348) 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.977+0000 7f985dc00700 1 -- 172.21.15.82:0/3183221927 learned_addr learned my addr 172.21.15.82:0/3183221927 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.977+0000 7f985dc00700 1 -- 172.21.15.82:0/3183221927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985807f0c0 con 0x7f9858108d20 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.977+0000 7f985dc00700 1 --2- 172.21.15.82:0/3183221927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f985807eb80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f984c011670 tx=0x7f984c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.978+0000 7f9856000700 1 -- 172.21.15.82:0/3183221927 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c003aa0 con 0x7f9858108d20 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.978+0000 7f9856000700 1 -- 172.21.15.82:0/3183221927 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f984c01b8d0 con 0x7f9858108d20 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.978+0000 7f9860600700 1 -- 172.21.15.82:0/3183221927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985807d2b0 con 0x7f9858108d20 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.978+0000 7f9856000700 1 -- 172.21.15.82:0/3183221927 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f984c0197f0 con 0x7f9858108d20 2024-05-03T22:02:25.300 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.978+0000 7f9860600700 1 -- 172.21.15.82:0/3183221927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985807d7f0 con 0x7f9858108d20 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.979+0000 7f9856000700 1 -- 172.21.15.82:0/3183221927 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f984c01b440 con 0x7f9858108d20 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.979+0000 7f9860600700 1 -- 172.21.15.82:0/3183221927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9858064b00 con 0x7f9858108d20 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.979+0000 7f9856000700 1 --2- 172.21.15.82:0/3183221927 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f984003e470 0x7f9840040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.980+0000 7f9856000700 1 -- 172.21.15.82:0/3183221927 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f984c053e50 con 0x7f9858108d20 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.980+0000 7f985d200700 1 --2- 172.21.15.82:0/3183221927 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f984003e470 0x7f9840040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.980+0000 7f985d200700 1 --2- 172.21.15.82:0/3183221927 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f984003e470 0x7f9840040930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9844006fd0 tx=0x7f9844006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:23.985+0000 7f9856000700 1 -- 172.21.15.82:0/3183221927 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f984c01f030 con 0x7f9858108d20 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.217+0000 7f9860600700 1 -- 172.21.15.82:0/3183221927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f985807da70 con 0x7f9858108d20 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.221+0000 7f9856000700 1 -- 172.21.15.82:0/3183221927 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f984c055070 con 0x7f9858108d20 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.224+0000 7f9860600700 1 -- 172.21.15.82:0/3183221927 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f984003e470 msgr2=0x7f9840040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.224+0000 7f9860600700 1 --2- 172.21.15.82:0/3183221927 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f984003e470 0x7f9840040930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9844006fd0 tx=0x7f9844006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.224+0000 7f9860600700 1 -- 172.21.15.82:0/3183221927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 msgr2=0x7f985807eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.225+0000 7f9860600700 1 --2- 172.21.15.82:0/3183221927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f985807eb80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f984c011670 tx=0x7f984c011a30 comp rx=0 tx=0).stop 2024-05-03T22:02:25.301 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.225+0000 7f9860600700 1 -- 172.21.15.82:0/3183221927 shutdown_connections 2024-05-03T22:02:25.302 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.225+0000 7f9860600700 1 --2- 172.21.15.82:0/3183221927 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f984003e470 0x7f9840040930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:25.302 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.225+0000 7f9860600700 1 --2- 172.21.15.82:0/3183221927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9858108d20 0x7f985807eb80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:25.302 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.225+0000 7f9860600700 1 -- 172.21.15.82:0/3183221927 >> 172.21.15.82:0/3183221927 conn(0x7f98581042a0 msgr2=0x7f9858104dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:25.302 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.225+0000 7f9860600700 1 -- 172.21.15.82:0/3183221927 shutdown_connections 2024-05-03T22:02:25.302 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:24.225+0000 7f9860600700 1 -- 172.21.15.82:0/3183221927 wait complete. 2024-05-03T22:02:25.302 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling the dashboard module... 2024-05-03T22:02:26.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:26 smithi082 ceph-mon[28404]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:02:26.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:26 smithi082 ceph-mon[28404]: from='mgr.14120 172.21.15.82:0/406925967' entity='mgr.x' 2024-05-03T22:02:27.389 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:27 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/315600760' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-03T22:02:27.390 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:27 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: ignoring --setuser ceph since I am not root 2024-05-03T22:02:27.390 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:27 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: ignoring --setgroup ceph since I am not root 2024-05-03T22:02:27.390 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:27 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:27.387+0000 7f2be5c5a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T22:02:27.946 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:27 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:27.649+0000 7f2be5c5a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:02:27.946 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:27 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:27.787+0000 7f2be5c5a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T22:02:27.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.987+0000 7fb666200700 1 Processor -- start 2024-05-03T22:02:27.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.988+0000 7fb666200700 1 -- start start 2024-05-03T22:02:27.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.988+0000 7fb666200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb660109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:27.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.988+0000 7fb666200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb660109700 con 0x7fb660108d10 2024-05-03T22:02:27.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.989+0000 7fb65f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb660109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:27.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.989+0000 7fb65f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb660109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51356/0 (socket says 172.21.15.82:51356) 2024-05-03T22:02:27.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.989+0000 7fb65f400700 1 -- 172.21.15.82:0/2587864160 learned_addr learned my addr 172.21.15.82:0/2587864160 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:27.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.989+0000 7fb65f400700 1 -- 172.21.15.82:0/2587864160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb660109f10 con 0x7fb660108d10 2024-05-03T22:02:27.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.989+0000 7fb65f400700 1 --2- 172.21.15.82:0/2587864160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb660109130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb6500098a0 tx=0x7fb650009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217ad1b006ce5284 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:27.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.990+0000 7fb65e000700 1 -- 172.21.15.82:0/2587864160 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb650004160 con 0x7fb660108d10 2024-05-03T22:02:27.961 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.990+0000 7fb65e000700 1 -- 172.21.15.82:0/2587864160 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb650004300 con 0x7fb660108d10 2024-05-03T22:02:27.961 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.990+0000 7fb65e000700 1 -- 172.21.15.82:0/2587864160 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb650011960 con 0x7fb660108d10 2024-05-03T22:02:27.961 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.990+0000 7fb666200700 1 -- 172.21.15.82:0/2587864160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 msgr2=0x7fb660109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:27.965 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.990+0000 7fb666200700 1 --2- 172.21.15.82:0/2587864160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb660109130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb6500098a0 tx=0x7fb650009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:27.965 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.991+0000 7fb666200700 1 -- 172.21.15.82:0/2587864160 shutdown_connections 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.991+0000 7fb666200700 1 --2- 172.21.15.82:0/2587864160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb660109130 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.991+0000 7fb666200700 1 -- 172.21.15.82:0/2587864160 >> 172.21.15.82:0/2587864160 conn(0x7fb6601042d0 msgr2=0x7fb6601066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.991+0000 7fb666200700 1 -- 172.21.15.82:0/2587864160 shutdown_connections 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.991+0000 7fb666200700 1 -- 172.21.15.82:0/2587864160 wait complete. 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.992+0000 7fb666200700 1 Processor -- start 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.992+0000 7fb666200700 1 -- start start 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.992+0000 7fb666200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb66007eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.992+0000 7fb666200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb66010d140 con 0x7fb660108d10 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.993+0000 7fb65f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb66007eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.993+0000 7fb65f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb66007eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51360/0 (socket says 172.21.15.82:51360) 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.993+0000 7fb65f400700 1 -- 172.21.15.82:0/315600760 learned_addr learned my addr 172.21.15.82:0/315600760 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:27.966 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.993+0000 7fb65f400700 1 -- 172.21.15.82:0/315600760 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66007f0c0 con 0x7fb660108d10 2024-05-03T22:02:27.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.993+0000 7fb65f400700 1 --2- 172.21.15.82:0/315600760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb66007eb80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb650011670 tx=0x7fb650011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:27.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.993+0000 7fb657e00700 1 -- 172.21.15.82:0/315600760 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb65001f070 con 0x7fb660108d10 2024-05-03T22:02:27.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.994+0000 7fb657e00700 1 -- 172.21.15.82:0/315600760 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb650003b20 con 0x7fb660108d10 2024-05-03T22:02:27.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.994+0000 7fb657e00700 1 -- 172.21.15.82:0/315600760 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb650019580 con 0x7fb660108d10 2024-05-03T22:02:27.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.994+0000 7fb666200700 1 -- 172.21.15.82:0/315600760 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66007d2b0 con 0x7fb660108d10 2024-05-03T22:02:27.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.994+0000 7fb666200700 1 -- 172.21.15.82:0/315600760 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66007d7f0 con 0x7fb660108d10 2024-05-03T22:02:27.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.995+0000 7fb657e00700 1 -- 172.21.15.82:0/315600760 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fb650022070 con 0x7fb660108d10 2024-05-03T22:02:27.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.995+0000 7fb666200700 1 -- 172.21.15.82:0/315600760 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb660064b00 con 0x7fb660108d10 2024-05-03T22:02:27.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.996+0000 7fb657e00700 1 --2- 172.21.15.82:0/315600760 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fb64403e4c0 0x7fb644040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:27.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.996+0000 7fb657e00700 1 -- 172.21.15.82:0/315600760 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb6500539a0 con 0x7fb660108d10 2024-05-03T22:02:27.967 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.996+0000 7fb65ea00700 1 --2- 172.21.15.82:0/315600760 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fb64403e4c0 0x7fb644040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:25.997+0000 7fb65ea00700 1 --2- 172.21.15.82:0/315600760 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fb64403e4c0 0x7fb644040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb64c006fd0 tx=0x7fb64c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:26.001+0000 7fb657e00700 1 -- 172.21.15.82:0/315600760 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb65002cd00 con 0x7fb660108d10 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:26.307+0000 7fb666200700 1 -- 172.21.15.82:0/315600760 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fb66007da70 con 0x7fb660108d10 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.062+0000 7fb657e00700 1 -- 172.21.15.82:0/315600760 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fb65001ba80 con 0x7fb660108d10 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.065+0000 7fb657e00700 1 -- 172.21.15.82:0/315600760 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fb65002c710 con 0x7fb660108d10 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.067+0000 7fb666200700 1 -- 172.21.15.82:0/315600760 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fb64403e4c0 msgr2=0x7fb644040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.067+0000 7fb666200700 1 --2- 172.21.15.82:0/315600760 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fb64403e4c0 0x7fb644040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb64c006fd0 tx=0x7fb64c006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.067+0000 7fb666200700 1 -- 172.21.15.82:0/315600760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 msgr2=0x7fb66007eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.067+0000 7fb666200700 1 --2- 172.21.15.82:0/315600760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb66007eb80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb650011670 tx=0x7fb650011a30 comp rx=0 tx=0).stop 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.067+0000 7fb666200700 1 -- 172.21.15.82:0/315600760 shutdown_connections 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.067+0000 7fb666200700 1 --2- 172.21.15.82:0/315600760 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fb64403e4c0 0x7fb644040980 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.067+0000 7fb666200700 1 --2- 172.21.15.82:0/315600760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb660108d10 0x7fb66007eb80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.067+0000 7fb666200700 1 -- 172.21.15.82:0/315600760 >> 172.21.15.82:0/315600760 conn(0x7fb6601042d0 msgr2=0x7fb660104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:27.968 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.068+0000 7fb666200700 1 -- 172.21.15.82:0/315600760 shutdown_connections 2024-05-03T22:02:27.969 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:27.068+0000 7fb666200700 1 -- 172.21.15.82:0/315600760 wait complete. 2024-05-03T22:02:28.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:28 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/315600760' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-03T22:02:28.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:28 smithi082 ceph-mon[28404]: mgrmap e9: x(active, since 26s) 2024-05-03T22:02:28.226 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:28 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:28.189+0000 7f2be5c5a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T22:02:28.603 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:28 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:28.306+0000 7f2be5c5a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T22:02:29.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:29 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1541646412' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-03T22:02:29.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:02:29.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-03T22:02:29.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-03T22:02:29.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-03T22:02:29.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-03T22:02:29.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:02:29.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.601+0000 7fef8f200700 1 Processor -- start 2024-05-03T22:02:29.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.601+0000 7fef8f200700 1 -- start start 2024-05-03T22:02:29.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.601+0000 7fef8f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9010b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:29.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.601+0000 7fef8f200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef9010b790 con 0x7fef9010ada0 2024-05-03T22:02:29.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.602+0000 7fef8de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9010b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:29.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.602+0000 7fef8de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9010b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51386/0 (socket says 172.21.15.82:51386) 2024-05-03T22:02:29.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.602+0000 7fef8de00700 1 -- 172.21.15.82:0/973377770 learned_addr learned my addr 172.21.15.82:0/973377770 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:29.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.603+0000 7fef8de00700 1 -- 172.21.15.82:0/973377770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9010bf50 con 0x7fef9010ada0 2024-05-03T22:02:29.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.603+0000 7fef8de00700 1 --2- 172.21.15.82:0/973377770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9010b1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef800098a0 tx=0x7fef80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214d7213c1c39998 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:29.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.603+0000 7fef8ca00700 1 -- 172.21.15.82:0/973377770 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef80004160 con 0x7fef9010ada0 2024-05-03T22:02:29.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.603+0000 7fef8ca00700 1 -- 172.21.15.82:0/973377770 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef80004300 con 0x7fef9010ada0 2024-05-03T22:02:29.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.603+0000 7fef8ca00700 1 -- 172.21.15.82:0/973377770 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef80011960 con 0x7fef9010ada0 2024-05-03T22:02:29.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.604+0000 7fef8f200700 1 -- 172.21.15.82:0/973377770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 msgr2=0x7fef9010b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:29.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.604+0000 7fef8f200700 1 --2- 172.21.15.82:0/973377770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9010b1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef800098a0 tx=0x7fef80009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:29.726 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.604+0000 7fef8f200700 1 -- 172.21.15.82:0/973377770 shutdown_connections 2024-05-03T22:02:29.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.604+0000 7fef8f200700 1 --2- 172.21.15.82:0/973377770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9010b1c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:29.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.604+0000 7fef8f200700 1 -- 172.21.15.82:0/973377770 >> 172.21.15.82:0/973377770 conn(0x7fef9007e100 msgr2=0x7fef9007e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:29.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.605+0000 7fef8f200700 1 -- 172.21.15.82:0/973377770 shutdown_connections 2024-05-03T22:02:29.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.605+0000 7fef8f200700 1 -- 172.21.15.82:0/973377770 wait complete. 2024-05-03T22:02:29.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.606+0000 7fef8f200700 1 Processor -- start 2024-05-03T22:02:29.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.606+0000 7fef8f200700 1 -- start start 2024-05-03T22:02:29.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.606+0000 7fef8f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:29.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.606+0000 7fef8f200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef9010f180 con 0x7fef9010ada0 2024-05-03T22:02:29.729 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.606+0000 7fef8de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.606+0000 7fef8de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9019eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51394/0 (socket says 172.21.15.82:51394) 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.606+0000 7fef8de00700 1 -- 172.21.15.82:0/1541646412 learned_addr learned my addr 172.21.15.82:0/1541646412 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.607+0000 7fef8de00700 1 -- 172.21.15.82:0/1541646412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9019f060 con 0x7fef9010ada0 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.607+0000 7fef8de00700 1 --2- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9019eb20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef80011670 tx=0x7fef80011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.607+0000 7fef86a00700 1 -- 172.21.15.82:0/1541646412 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef80003a60 con 0x7fef9010ada0 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.607+0000 7fef86a00700 1 -- 172.21.15.82:0/1541646412 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef8001b8d0 con 0x7fef9010ada0 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.607+0000 7fef8f200700 1 -- 172.21.15.82:0/1541646412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef9019f2f0 con 0x7fef9010ada0 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.607+0000 7fef86a00700 1 -- 172.21.15.82:0/1541646412 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef80023750 con 0x7fef9010ada0 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.607+0000 7fef8f200700 1 -- 172.21.15.82:0/1541646412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef901a1fe0 con 0x7fef9010ada0 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.608+0000 7fef8f200700 1 -- 172.21.15.82:0/1541646412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef90064b00 con 0x7fef9010ada0 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.608+0000 7fef86a00700 1 -- 172.21.15.82:0/1541646412 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fef8001b440 con 0x7fef9010ada0 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.609+0000 7fef86a00700 1 --2- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fef7403e4d0 0x7fef74040990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.609+0000 7fef86a00700 1 -- 172.21.15.82:0/1541646412 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fef80053fa0 con 0x7fef9010ada0 2024-05-03T22:02:29.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.609+0000 7fef8d400700 1 -- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fef7403e4d0 msgr2=0x7fef74040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2219604538 2024-05-03T22:02:29.731 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.609+0000 7fef8d400700 1 --2- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fef7403e4d0 0x7fef74040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:02:29.731 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.614+0000 7fef86a00700 1 -- 172.21.15.82:0/1541646412 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fef8001f030 con 0x7fef9010ada0 2024-05-03T22:02:29.731 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.810+0000 7fef8d400700 1 -- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fef7403e4d0 msgr2=0x7fef74040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2219604538 2024-05-03T22:02:29.731 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.810+0000 7fef8d400700 1 --2- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fef7403e4d0 0x7fef74040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T22:02:29.731 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.938+0000 7fef8f200700 1 -- 172.21.15.82:0/1541646412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fef901a2590 con 0x7fef9010ada0 2024-05-03T22:02:29.731 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.939+0000 7fef86a00700 1 -- 172.21.15.82:0/1541646412 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fef800202b0 con 0x7fef9010ada0 2024-05-03T22:02:29.731 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.943+0000 7fef8f200700 1 -- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fef7403e4d0 msgr2=0x7fef74040990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:02:29.731 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.943+0000 7fef8f200700 1 --2- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fef7403e4d0 0x7fef74040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:29.733 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.943+0000 7fef8f200700 1 -- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 msgr2=0x7fef9019eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:29.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.943+0000 7fef8f200700 1 --2- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9019eb20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef80011670 tx=0x7fef80011a30 comp rx=0 tx=0).stop 2024-05-03T22:02:29.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.943+0000 7fef8f200700 1 -- 172.21.15.82:0/1541646412 shutdown_connections 2024-05-03T22:02:29.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.943+0000 7fef8f200700 1 --2- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7fef7403e4d0 0x7fef74040990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:29.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.943+0000 7fef8f200700 1 --2- 172.21.15.82:0/1541646412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9010ada0 0x7fef9019eb20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:29.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.943+0000 7fef8f200700 1 -- 172.21.15.82:0/1541646412 >> 172.21.15.82:0/1541646412 conn(0x7fef9007e100 msgr2=0x7fef901083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:29.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.944+0000 7fef8f200700 1 -- 172.21.15.82:0/1541646412 shutdown_connections 2024-05-03T22:02:29.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:28.944+0000 7fef8f200700 1 -- 172.21.15.82:0/1541646412 wait complete. 2024-05-03T22:02:29.735 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-05-03T22:02:29.735 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 9... 2024-05-03T22:02:29.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:29 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:29.911+0000 7f2be5c5a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T22:02:30.365 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:30 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:30.149+0000 7f2be5c5a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T22:02:30.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:30 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:30.370+0000 7f2be5c5a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T22:02:31.012 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:30 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:30.755+0000 7f2be5c5a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T22:02:31.012 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:30 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:30.875+0000 7f2be5c5a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T22:02:31.377 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:31 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:31.126+0000 7f2be5c5a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T22:02:31.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:31 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:31.375+0000 7f2be5c5a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:02:32.476 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:32 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:32.193+0000 7f2be5c5a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T22:02:32.956 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:32 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:32.487+0000 7f2be5c5a200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T22:02:33.226 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:33 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:33.054+0000 7f2be5c5a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T22:02:33.226 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:33 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:33.182+0000 7f2be5c5a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T22:02:33.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:33 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:33.644+0000 7f2be5c5a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T22:02:34.476 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:34 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:34.094+0000 7f2be5c5a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T22:02:34.476 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:34 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:34.216+0000 7f2be5c5a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T22:02:34.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:34 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:34.539+0000 7f2be5c5a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T22:02:34.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:34 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:34.714+0000 7f2be5c5a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T22:02:35.364 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:35 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:35.084+0000 7f2be5c5a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T22:02:35.364 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:35 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:35.236+0000 7f2be5c5a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T22:02:35.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:35 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:35.362+0000 7f2be5c5a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T22:02:36.414 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:36 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:36.120+0000 7f2be5c5a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T22:02:36.726 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:02:36 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:02:36.412+0000 7f2be5c5a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T22:02:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:36 smithi082 ceph-mon[28404]: Active manager daemon x restarted 2024-05-03T22:02:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:36 smithi082 ceph-mon[28404]: Activating manager daemon x 2024-05-03T22:02:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:36 smithi082 ceph-mon[28404]: osdmap e3: 0 total, 0 up, 0 in 2024-05-03T22:02:36.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:36 smithi082 ceph-mon[28404]: mgrmap e10: x(active, starting, since 0.0110051s) 2024-05-03T22:02:36.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:02:36.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-03T22:02:36.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-03T22:02:36.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-03T22:02:36.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-03T22:02:36.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:36 smithi082 ceph-mon[28404]: Manager daemon x is now available 2024-05-03T22:02:37.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:02:37.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-03T22:02:37.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-03T22:02:37.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:37 smithi082 ceph-mon[28404]: [03/May/2024:22:02:36] ENGINE Bus STARTING 2024-05-03T22:02:37.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:37 smithi082 ceph-mon[28404]: [03/May/2024:22:02:37] ENGINE Serving on http://172.21.15.82:8765 2024-05-03T22:02:37.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:37 smithi082 ceph-mon[28404]: [03/May/2024:22:02:37] ENGINE Serving on https://172.21.15.82:7150 2024-05-03T22:02:37.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:37 smithi082 ceph-mon[28404]: [03/May/2024:22:02:37] ENGINE Bus STARTED 2024-05-03T22:02:37.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:37 smithi082 ceph-mon[28404]: mgrmap e11: x(active, since 1.01074s) 2024-05-03T22:02:38.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:02:38.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-03T22:02:38.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-03T22:02:38.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:02:38.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.399+0000 7f4d90c00700 1 Processor -- start 2024-05-03T22:02:38.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.400+0000 7f4d90c00700 1 -- start start 2024-05-03T22:02:38.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.400+0000 7f4d90c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c07d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:38.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.400+0000 7f4d90c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c07d8a0 con 0x7f4d8c07ee70 2024-05-03T22:02:38.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.401+0000 7f4d89e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c07d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:38.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.401+0000 7f4d89e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c07d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51406/0 (socket says 172.21.15.82:51406) 2024-05-03T22:02:38.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.401+0000 7f4d89e00700 1 -- 172.21.15.82:0/999928542 learned_addr learned my addr 172.21.15.82:0/999928542 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.401+0000 7f4d89e00700 1 -- 172.21.15.82:0/999928542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c07da20 con 0x7f4d8c07ee70 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.401+0000 7f4d89e00700 1 --2- 172.21.15.82:0/999928542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c07d2d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0098a0 tx=0x7f4d7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2d1c253874d92a server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.402+0000 7f4d88a00700 1 -- 172.21.15.82:0/999928542 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d7c004160 con 0x7f4d8c07ee70 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.402+0000 7f4d88a00700 1 -- 172.21.15.82:0/999928542 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d7c004300 con 0x7f4d8c07ee70 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.402+0000 7f4d88a00700 1 -- 172.21.15.82:0/999928542 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d7c011960 con 0x7f4d8c07ee70 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.403+0000 7f4d90c00700 1 -- 172.21.15.82:0/999928542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 msgr2=0x7f4d8c07d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.403+0000 7f4d90c00700 1 --2- 172.21.15.82:0/999928542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c07d2d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0098a0 tx=0x7f4d7c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.403+0000 7f4d90c00700 1 -- 172.21.15.82:0/999928542 shutdown_connections 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.403+0000 7f4d90c00700 1 --2- 172.21.15.82:0/999928542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c07d2d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.403+0000 7f4d90c00700 1 -- 172.21.15.82:0/999928542 >> 172.21.15.82:0/999928542 conn(0x7f4d8c1042d0 msgr2=0x7f4d8c1066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.403+0000 7f4d90c00700 1 -- 172.21.15.82:0/999928542 shutdown_connections 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.403+0000 7f4d90c00700 1 -- 172.21.15.82:0/999928542 wait complete. 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.404+0000 7f4d90c00700 1 Processor -- start 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.404+0000 7f4d90c00700 1 -- start start 2024-05-03T22:02:38.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.405+0000 7f4d90c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c19ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.405+0000 7f4d90c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c10f290 con 0x7f4d8c07ee70 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.405+0000 7f4d89e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c19ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.405+0000 7f4d89e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c19ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51420/0 (socket says 172.21.15.82:51420) 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.405+0000 7f4d89e00700 1 -- 172.21.15.82:0/1371617500 learned_addr learned my addr 172.21.15.82:0/1371617500 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.405+0000 7f4d89e00700 1 -- 172.21.15.82:0/1371617500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c19f250 con 0x7f4d8c07ee70 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.406+0000 7f4d89e00700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c19ed10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c004660 tx=0x7f4d7c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.406+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d7c003aa0 con 0x7f4d8c07ee70 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.406+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d7c01b8d0 con 0x7f4d8c07ee70 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.406+0000 7f4d90c00700 1 -- 172.21.15.82:0/1371617500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8c19f4e0 con 0x7f4d8c07ee70 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.406+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d7c023820 con 0x7f4d8c07ee70 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.406+0000 7f4d90c00700 1 -- 172.21.15.82:0/1371617500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8c1a21c0 con 0x7f4d8c07ee70 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.407+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f4d7c01b440 con 0x7f4d8c07ee70 2024-05-03T22:02:38.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.408+0000 7f4d82a00700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 0x7f4d70040990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.408+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 --> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4d700410a0 con 0x7f4d7003e4d0 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.408+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4d7c053e10 con 0x7f4d8c07ee70 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.408+0000 7f4d89400700 1 -- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 msgr2=0x7f4d70040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2219604538 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.408+0000 7f4d89400700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 0x7f4d70040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.609+0000 7f4d89400700 1 -- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 msgr2=0x7f4d70040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2219604538 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:30.609+0000 7f4d89400700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 0x7f4d70040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:31.010+0000 7f4d89400700 1 -- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 msgr2=0x7f4d70040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2219604538 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:31.010+0000 7f4d89400700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 0x7f4d70040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:31.811+0000 7f4d89400700 1 -- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 msgr2=0x7f4d70040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2219604538 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:31.811+0000 7f4d89400700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 0x7f4d70040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:33.413+0000 7f4d89400700 1 -- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 msgr2=0x7f4d70040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/2219604538 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:33.413+0000 7f4d89400700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 0x7f4d70040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:36.422+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7f4d7c0239c0 con 0x7f4d8c07ee70 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:36.422+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 msgr2=0x7f4d70040990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:02:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:36.422+0000 7f4d82a00700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 0x7f4d70040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.423+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7f4d7c055bb0 con 0x7f4d8c07ee70 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.424+0000 7f4d82a00700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4d70041f50 0x7f4d70044340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.424+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4d7c010d10 con 0x7f4d70041f50 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.426+0000 7f4d89400700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4d70041f50 0x7f4d70044340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.429+0000 7f4d89400700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4d70041f50 0x7f4d70044340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4d78003a10 tx=0x7f4d78009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.431+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f4d7c010d10 con 0x7f4d70041f50 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.440+0000 7f4d90c00700 1 -- 172.21.15.82:0/1371617500 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4d8c064b00 con 0x7f4d70041f50 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.441+0000 7f4d82a00700 1 -- 172.21.15.82:0/1371617500 <== mgr.14152 v2:172.21.15.82:6800/3338115086 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f4d8c064b00 con 0x7f4d70041f50 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.442+0000 7f4d90c00700 1 -- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4d70041f50 msgr2=0x7f4d70044340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.442+0000 7f4d90c00700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4d70041f50 0x7f4d70044340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4d78003a10 tx=0x7f4d78009270 comp rx=0 tx=0).stop 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.442+0000 7f4d90c00700 1 -- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 msgr2=0x7f4d8c19ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.442+0000 7f4d90c00700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c19ed10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c004660 tx=0x7f4d7c011a30 comp rx=0 tx=0).stop 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.442+0000 7f4d90c00700 1 -- 172.21.15.82:0/1371617500 shutdown_connections 2024-05-03T22:02:38.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.442+0000 7f4d90c00700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4d70041f50 0x7f4d70044340 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:38.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.442+0000 7f4d90c00700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d8c07ee70 0x7f4d8c19ed10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:38.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.442+0000 7f4d90c00700 1 --2- 172.21.15.82:0/1371617500 >> [v2:172.21.15.82:6800/2219604538,v1:172.21.15.82:6801/2219604538] conn(0x7f4d7003e4d0 0x7f4d70040990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:38.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.442+0000 7f4d90c00700 1 -- 172.21.15.82:0/1371617500 >> 172.21.15.82:0/1371617500 conn(0x7f4d8c1042d0 msgr2=0x7f4d8c104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:38.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.442+0000 7f4d90c00700 1 -- 172.21.15.82:0/1371617500 shutdown_connections 2024-05-03T22:02:38.177 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:37.442+0000 7f4d90c00700 1 -- 172.21.15.82:0/1371617500 wait complete. 2024-05-03T22:02:38.177 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 9 is available 2024-05-03T22:02:38.177 INFO:teuthology.orchestra.run.smithi082.stdout:Generating a dashboard self-signed certificate... 2024-05-03T22:02:38.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:38 smithi082 ceph-mon[28404]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-03T22:02:38.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:38 smithi082 ceph-mon[28404]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-03T22:02:39.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:39 smithi082 ceph-mon[28404]: mgrmap e12: x(active, since 2s) 2024-05-03T22:02:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:40 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:40 smithi082 ceph-mon[28404]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:02:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:40 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:40 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:40.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-03T22:02:40.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.530+0000 7fe424200700 1 Processor -- start 2024-05-03T22:02:40.763 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.530+0000 7fe424200700 1 -- start start 2024-05-03T22:02:40.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.531+0000 7fe424200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c109140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:40.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.531+0000 7fe424200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c109710 con 0x7fe41c108d20 2024-05-03T22:02:40.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.531+0000 7fe421800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:40.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.531+0000 7fe421800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c109140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59716/0 (socket says 172.21.15.82:59716) 2024-05-03T22:02:40.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.531+0000 7fe421800700 1 -- 172.21.15.82:0/4046944784 learned_addr learned my addr 172.21.15.82:0/4046944784 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:40.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.532+0000 7fe421800700 1 -- 172.21.15.82:0/4046944784 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41c109f20 con 0x7fe41c108d20 2024-05-03T22:02:40.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.532+0000 7fe421800700 1 --2- 172.21.15.82:0/4046944784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c109140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4100098a0 tx=0x7fe410009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997a127654be62ba server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:40.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.533+0000 7fe41be00700 1 -- 172.21.15.82:0/4046944784 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe410004160 con 0x7fe41c108d20 2024-05-03T22:02:40.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.533+0000 7fe41be00700 1 -- 172.21.15.82:0/4046944784 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe410004300 con 0x7fe41c108d20 2024-05-03T22:02:40.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.533+0000 7fe41be00700 1 -- 172.21.15.82:0/4046944784 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe410011960 con 0x7fe41c108d20 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.534+0000 7fe424200700 1 -- 172.21.15.82:0/4046944784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 msgr2=0x7fe41c109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.534+0000 7fe424200700 1 --2- 172.21.15.82:0/4046944784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c109140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4100098a0 tx=0x7fe410009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.534+0000 7fe424200700 1 -- 172.21.15.82:0/4046944784 shutdown_connections 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.534+0000 7fe424200700 1 --2- 172.21.15.82:0/4046944784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c109140 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.534+0000 7fe424200700 1 -- 172.21.15.82:0/4046944784 >> 172.21.15.82:0/4046944784 conn(0x7fe41c1042a0 msgr2=0x7fe41c106700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.534+0000 7fe424200700 1 -- 172.21.15.82:0/4046944784 shutdown_connections 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.534+0000 7fe424200700 1 -- 172.21.15.82:0/4046944784 wait complete. 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.536+0000 7fe424200700 1 Processor -- start 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.536+0000 7fe424200700 1 -- start start 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.536+0000 7fe424200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c1a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.536+0000 7fe424200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c10d150 con 0x7fe41c108d20 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.537+0000 7fe421800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c1a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.537+0000 7fe421800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c1a5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59726/0 (socket says 172.21.15.82:59726) 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.537+0000 7fe421800700 1 -- 172.21.15.82:0/2003529606 learned_addr learned my addr 172.21.15.82:0/2003529606 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.537+0000 7fe421800700 1 -- 172.21.15.82:0/2003529606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41c1a58a0 con 0x7fe41c108d20 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.538+0000 7fe421800700 1 --2- 172.21.15.82:0/2003529606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c1a5360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe410011670 tx=0x7fe410011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.538+0000 7fe41a000700 1 -- 172.21.15.82:0/2003529606 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe410003aa0 con 0x7fe41c108d20 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.538+0000 7fe41a000700 1 -- 172.21.15.82:0/2003529606 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe41001b8d0 con 0x7fe41c108d20 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.538+0000 7fe424200700 1 -- 172.21.15.82:0/2003529606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe41c1a5b30 con 0x7fe41c108d20 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.539+0000 7fe424200700 1 -- 172.21.15.82:0/2003529606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe41c1a8820 con 0x7fe41c108d20 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.539+0000 7fe41a000700 1 -- 172.21.15.82:0/2003529606 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4100197f0 con 0x7fe41c108d20 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.540+0000 7fe41a000700 1 -- 172.21.15.82:0/2003529606 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fe410019990 con 0x7fe41c108d20 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.540+0000 7fe424200700 1 -- 172.21.15.82:0/2003529606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3fc005360 con 0x7fe41c108d20 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.541+0000 7fe41a000700 1 --2- 172.21.15.82:0/2003529606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe40403e4d0 0x7fe404040990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.541+0000 7fe41a000700 1 -- 172.21.15.82:0/2003529606 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe410053ff0 con 0x7fe41c108d20 2024-05-03T22:02:40.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.541+0000 7fe420e00700 1 --2- 172.21.15.82:0/2003529606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe40403e4d0 0x7fe404040990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.542+0000 7fe420e00700 1 --2- 172.21.15.82:0/2003529606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe40403e4d0 0x7fe404040990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe408006fd0 tx=0x7fe408006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.547+0000 7fe41a000700 1 -- 172.21.15.82:0/2003529606 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe41001f030 con 0x7fe41c108d20 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.789+0000 7fe424200700 1 -- 172.21.15.82:0/2003529606 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fe3fc000bf0 con 0x7fe40403e4d0 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.956+0000 7fe41a000700 1 -- 172.21.15.82:0/2003529606 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fe3fc000bf0 con 0x7fe40403e4d0 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.959+0000 7fe424200700 1 -- 172.21.15.82:0/2003529606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe40403e4d0 msgr2=0x7fe404040990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.959+0000 7fe424200700 1 --2- 172.21.15.82:0/2003529606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe40403e4d0 0x7fe404040990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe408006fd0 tx=0x7fe408006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.959+0000 7fe424200700 1 -- 172.21.15.82:0/2003529606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 msgr2=0x7fe41c1a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.959+0000 7fe424200700 1 --2- 172.21.15.82:0/2003529606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c1a5360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe410011670 tx=0x7fe410011a30 comp rx=0 tx=0).stop 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.960+0000 7fe424200700 1 -- 172.21.15.82:0/2003529606 shutdown_connections 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.960+0000 7fe424200700 1 --2- 172.21.15.82:0/2003529606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe40403e4d0 0x7fe404040990 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.960+0000 7fe424200700 1 --2- 172.21.15.82:0/2003529606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe41c108d20 0x7fe41c1a5360 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.960+0000 7fe424200700 1 -- 172.21.15.82:0/2003529606 >> 172.21.15.82:0/2003529606 conn(0x7fe41c1042a0 msgr2=0x7fe41c104dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.960+0000 7fe424200700 1 -- 172.21.15.82:0/2003529606 shutdown_connections 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:39.960+0000 7fe424200700 1 -- 172.21.15.82:0/2003529606 wait complete. 2024-05-03T22:02:40.771 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial admin user... 2024-05-03T22:02:42.815 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$aKlSYi23ZxIjZGkO.dsre.RQtLKPUxC94.iPoFcQrNkriYg.X.Xa2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714773761, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-03T22:02:42.816 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.435+0000 7fd5fce00700 1 Processor -- start 2024-05-03T22:02:42.816 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.435+0000 7fd5fce00700 1 -- start start 2024-05-03T22:02:42.816 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.435+0000 7fd5fce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f810bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:42.816 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.435+0000 7fd5fce00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f807ce60 con 0x7fd5f8109810 2024-05-03T22:02:42.816 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.436+0000 7fd5f5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f810bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:42.816 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.436+0000 7fd5f5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f810bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59742/0 (socket says 172.21.15.82:59742) 2024-05-03T22:02:42.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.436+0000 7fd5f5e00700 1 -- 172.21.15.82:0/1369707106 learned_addr learned my addr 172.21.15.82:0/1369707106 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:42.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.436+0000 7fd5f5e00700 1 -- 172.21.15.82:0/1369707106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f810c140 con 0x7fd5f8109810 2024-05-03T22:02:42.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.437+0000 7fd5f5e00700 1 --2- 172.21.15.82:0/1369707106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f810bc00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80098a0 tx=0x7fd5e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6065318da59d6686 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:42.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.437+0000 7fd5f4a00700 1 -- 172.21.15.82:0/1369707106 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e8004160 con 0x7fd5f8109810 2024-05-03T22:02:42.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.437+0000 7fd5f4a00700 1 -- 172.21.15.82:0/1369707106 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5e8004300 con 0x7fd5f8109810 2024-05-03T22:02:42.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.437+0000 7fd5f4a00700 1 -- 172.21.15.82:0/1369707106 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e8011960 con 0x7fd5f8109810 2024-05-03T22:02:42.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.438+0000 7fd5fce00700 1 -- 172.21.15.82:0/1369707106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 msgr2=0x7fd5f810bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:42.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.438+0000 7fd5fce00700 1 --2- 172.21.15.82:0/1369707106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f810bc00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80098a0 tx=0x7fd5e8009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:42.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.438+0000 7fd5fce00700 1 -- 172.21.15.82:0/1369707106 shutdown_connections 2024-05-03T22:02:42.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.438+0000 7fd5fce00700 1 --2- 172.21.15.82:0/1369707106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f810bc00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:42.819 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.438+0000 7fd5fce00700 1 -- 172.21.15.82:0/1369707106 >> 172.21.15.82:0/1369707106 conn(0x7fd5f8103200 msgr2=0x7fd5f8105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.438+0000 7fd5fce00700 1 -- 172.21.15.82:0/1369707106 shutdown_connections 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.438+0000 7fd5fce00700 1 -- 172.21.15.82:0/1369707106 wait complete. 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.439+0000 7fd5fce00700 1 Processor -- start 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.439+0000 7fd5fce00700 1 -- start start 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.440+0000 7fd5fce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.440+0000 7fd5fce00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f810d090 con 0x7fd5f8109810 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.440+0000 7fd5f5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.440+0000 7fd5f5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f819ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59758/0 (socket says 172.21.15.82:59758) 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.440+0000 7fd5f5e00700 1 -- 172.21.15.82:0/1354516474 learned_addr learned my addr 172.21.15.82:0/1354516474 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.440+0000 7fd5f5e00700 1 -- 172.21.15.82:0/1354516474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f819f280 con 0x7fd5f8109810 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.441+0000 7fd5f5e00700 1 --2- 172.21.15.82:0/1354516474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f819ed40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8011670 tx=0x7fd5e8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:42.820 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.441+0000 7fd5eea00700 1 -- 172.21.15.82:0/1354516474 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e801f070 con 0x7fd5f8109810 2024-05-03T22:02:42.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.441+0000 7fd5eea00700 1 -- 172.21.15.82:0/1354516474 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5e8003b20 con 0x7fd5f8109810 2024-05-03T22:02:42.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.441+0000 7fd5eea00700 1 -- 172.21.15.82:0/1354516474 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e80195f0 con 0x7fd5f8109810 2024-05-03T22:02:42.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.441+0000 7fd5fce00700 1 -- 172.21.15.82:0/1354516474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f819f510 con 0x7fd5f8109810 2024-05-03T22:02:42.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.441+0000 7fd5fce00700 1 -- 172.21.15.82:0/1354516474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f81a2200 con 0x7fd5f8109810 2024-05-03T22:02:42.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.442+0000 7fd5fce00700 1 -- 172.21.15.82:0/1354516474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f8064b00 con 0x7fd5f8109810 2024-05-03T22:02:42.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.442+0000 7fd5eea00700 1 -- 172.21.15.82:0/1354516474 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fd5e8022070 con 0x7fd5f8109810 2024-05-03T22:02:42.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.443+0000 7fd5eea00700 1 --2- 172.21.15.82:0/1354516474 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5dc03e4c0 0x7fd5dc040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:42.822 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.443+0000 7fd5eea00700 1 -- 172.21.15.82:0/1354516474 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd5e8053db0 con 0x7fd5f8109810 2024-05-03T22:02:42.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.443+0000 7fd5f5400700 1 --2- 172.21.15.82:0/1354516474 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5dc03e4c0 0x7fd5dc040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:42.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.444+0000 7fd5f5400700 1 --2- 172.21.15.82:0/1354516474 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5dc03e4c0 0x7fd5dc040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4006fd0 tx=0x7fd5e4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:42.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.448+0000 7fd5eea00700 1 -- 172.21.15.82:0/1354516474 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd5e8058070 con 0x7fd5f8109810 2024-05-03T22:02:42.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.712+0000 7fd5fce00700 1 -- 172.21.15.82:0/1354516474 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fd5f819f9f0 con 0x7fd5dc03e4c0 2024-05-03T22:02:42.823 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.970+0000 7fd5eea00700 1 -- 172.21.15.82:0/1354516474 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fd5f819f9f0 con 0x7fd5dc03e4c0 2024-05-03T22:02:42.824 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.974+0000 7fd5fce00700 1 -- 172.21.15.82:0/1354516474 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5dc03e4c0 msgr2=0x7fd5dc040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:42.824 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.974+0000 7fd5fce00700 1 --2- 172.21.15.82:0/1354516474 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5dc03e4c0 0x7fd5dc040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4006fd0 tx=0x7fd5e4006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:42.824 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.974+0000 7fd5fce00700 1 -- 172.21.15.82:0/1354516474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 msgr2=0x7fd5f819ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:42.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.974+0000 7fd5fce00700 1 --2- 172.21.15.82:0/1354516474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f819ed40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8011670 tx=0x7fd5e8011a30 comp rx=0 tx=0).stop 2024-05-03T22:02:42.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.975+0000 7fd5fce00700 1 -- 172.21.15.82:0/1354516474 shutdown_connections 2024-05-03T22:02:42.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.975+0000 7fd5fce00700 1 --2- 172.21.15.82:0/1354516474 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5dc03e4c0 0x7fd5dc040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:42.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.975+0000 7fd5fce00700 1 --2- 172.21.15.82:0/1354516474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5f8109810 0x7fd5f819ed40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:42.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.975+0000 7fd5fce00700 1 -- 172.21.15.82:0/1354516474 >> 172.21.15.82:0/1354516474 conn(0x7fd5f8103200 msgr2=0x7fd5f8103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:42.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.975+0000 7fd5fce00700 1 -- 172.21.15.82:0/1354516474 shutdown_connections 2024-05-03T22:02:42.825 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:41.975+0000 7fd5fce00700 1 -- 172.21.15.82:0/1354516474 wait complete. 2024-05-03T22:02:42.825 INFO:teuthology.orchestra.run.smithi082.stdout:Fetching dashboard port number... 2024-05-03T22:02:43.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:42 smithi082 ceph-mon[28404]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:02:43.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:42 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:43.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:42 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:44.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:43 smithi082 ceph-mon[28404]: mgrmap e13: x(active, since 6s) 2024-05-03T22:02:44.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:43 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/371865903' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-03T22:02:45.303 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 8443 2024-05-03T22:02:45.304 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.684+0000 7f511de00700 1 Processor -- start 2024-05-03T22:02:45.304 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.684+0000 7f511de00700 1 -- start start 2024-05-03T22:02:45.304 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.684+0000 7f511de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f5118109130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:45.304 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.684+0000 7f511de00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5118109700 con 0x7f5118108d10 2024-05-03T22:02:45.304 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.685+0000 7f5116a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f5118109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:45.305 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.685+0000 7f5116a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f5118109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59762/0 (socket says 172.21.15.82:59762) 2024-05-03T22:02:45.305 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.685+0000 7f5116a00700 1 -- 172.21.15.82:0/1899598270 learned_addr learned my addr 172.21.15.82:0/1899598270 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:45.305 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.685+0000 7f5116a00700 1 -- 172.21.15.82:0/1899598270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5118109f10 con 0x7f5118108d10 2024-05-03T22:02:45.305 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.686+0000 7f5116a00700 1 --2- 172.21.15.82:0/1899598270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f5118109130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f51080098a0 tx=0x7f5108009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3a2ccae3bd93bb server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:45.305 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.686+0000 7f5115600700 1 -- 172.21.15.82:0/1899598270 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5108004160 con 0x7f5118108d10 2024-05-03T22:02:45.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.686+0000 7f5115600700 1 -- 172.21.15.82:0/1899598270 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5108004300 con 0x7f5118108d10 2024-05-03T22:02:45.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.686+0000 7f5115600700 1 -- 172.21.15.82:0/1899598270 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5108011960 con 0x7f5118108d10 2024-05-03T22:02:45.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.687+0000 7f511de00700 1 -- 172.21.15.82:0/1899598270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 msgr2=0x7f5118109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:45.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.687+0000 7f511de00700 1 --2- 172.21.15.82:0/1899598270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f5118109130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f51080098a0 tx=0x7f5108009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:45.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.687+0000 7f511de00700 1 -- 172.21.15.82:0/1899598270 shutdown_connections 2024-05-03T22:02:45.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.687+0000 7f511de00700 1 --2- 172.21.15.82:0/1899598270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f5118109130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:45.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.687+0000 7f511de00700 1 -- 172.21.15.82:0/1899598270 >> 172.21.15.82:0/1899598270 conn(0x7f51181042d0 msgr2=0x7f51181066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:45.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.687+0000 7f511de00700 1 -- 172.21.15.82:0/1899598270 shutdown_connections 2024-05-03T22:02:45.307 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.687+0000 7f511de00700 1 -- 172.21.15.82:0/1899598270 wait complete. 2024-05-03T22:02:45.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.688+0000 7f511de00700 1 Processor -- start 2024-05-03T22:02:45.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.688+0000 7f511de00700 1 -- start start 2024-05-03T22:02:45.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.688+0000 7f511de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f511819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:45.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.688+0000 7f511de00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f511810d140 con 0x7f5118108d10 2024-05-03T22:02:45.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.689+0000 7f5116a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f511819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:45.309 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.689+0000 7f5116a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f511819eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59772/0 (socket says 172.21.15.82:59772) 2024-05-03T22:02:45.310 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.689+0000 7f5116a00700 1 -- 172.21.15.82:0/371865903 learned_addr learned my addr 172.21.15.82:0/371865903 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:45.310 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.689+0000 7f5116a00700 1 -- 172.21.15.82:0/371865903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511819f2e0 con 0x7f5118108d10 2024-05-03T22:02:45.310 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.689+0000 7f5116a00700 1 --2- 172.21.15.82:0/371865903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f511819eda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5108011670 tx=0x7f5108011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:45.310 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.689+0000 7f511ca00700 1 -- 172.21.15.82:0/371865903 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510801f070 con 0x7f5118108d10 2024-05-03T22:02:45.310 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.689+0000 7f511ca00700 1 -- 172.21.15.82:0/371865903 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5108003b20 con 0x7f5118108d10 2024-05-03T22:02:45.310 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.689+0000 7f511ca00700 1 -- 172.21.15.82:0/371865903 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5108019580 con 0x7f5118108d10 2024-05-03T22:02:45.310 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.689+0000 7f511de00700 1 -- 172.21.15.82:0/371865903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511819f570 con 0x7f5118108d10 2024-05-03T22:02:45.310 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.690+0000 7f511de00700 1 -- 172.21.15.82:0/371865903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51181a2260 con 0x7f5118108d10 2024-05-03T22:02:45.310 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.691+0000 7f511de00700 1 -- 172.21.15.82:0/371865903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5118064b00 con 0x7f5118108d10 2024-05-03T22:02:45.310 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.691+0000 7f511ca00700 1 -- 172.21.15.82:0/371865903 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5108022070 con 0x7f5118108d10 2024-05-03T22:02:45.310 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.691+0000 7f511ca00700 1 --2- 172.21.15.82:0/371865903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50fc03e560 0x7f50fc040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:45.312 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.691+0000 7f511ca00700 1 -- 172.21.15.82:0/371865903 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5108053c10 con 0x7f5118108d10 2024-05-03T22:02:45.312 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.692+0000 7f5116000700 1 --2- 172.21.15.82:0/371865903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50fc03e560 0x7f50fc040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:45.312 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.692+0000 7f5116000700 1 --2- 172.21.15.82:0/371865903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50fc03e560 0x7f50fc040a20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5104006fd0 tx=0x7f5104006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:45.312 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.697+0000 7f511ca00700 1 -- 172.21.15.82:0/371865903 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f51080172b0 con 0x7f5118108d10 2024-05-03T22:02:45.312 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.932+0000 7f511de00700 1 -- 172.21.15.82:0/371865903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f51181a2810 con 0x7f5118108d10 2024-05-03T22:02:45.312 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.933+0000 7f511ca00700 1 -- 172.21.15.82:0/371865903 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f510801ba80 con 0x7f5118108d10 2024-05-03T22:02:45.312 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.937+0000 7f511de00700 1 -- 172.21.15.82:0/371865903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50fc03e560 msgr2=0x7f50fc040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:45.312 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.937+0000 7f511de00700 1 --2- 172.21.15.82:0/371865903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50fc03e560 0x7f50fc040a20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5104006fd0 tx=0x7f5104006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:45.312 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.937+0000 7f511de00700 1 -- 172.21.15.82:0/371865903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 msgr2=0x7f511819eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:45.313 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.937+0000 7f511de00700 1 --2- 172.21.15.82:0/371865903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f511819eda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5108011670 tx=0x7f5108011a30 comp rx=0 tx=0).stop 2024-05-03T22:02:45.313 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.937+0000 7f511de00700 1 -- 172.21.15.82:0/371865903 shutdown_connections 2024-05-03T22:02:45.313 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.937+0000 7f511de00700 1 --2- 172.21.15.82:0/371865903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50fc03e560 0x7f50fc040a20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:45.313 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.937+0000 7f511de00700 1 --2- 172.21.15.82:0/371865903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5118108d10 0x7f511819eda0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:45.313 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.937+0000 7f511de00700 1 -- 172.21.15.82:0/371865903 >> 172.21.15.82:0/371865903 conn(0x7f51181042d0 msgr2=0x7f5118104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:45.313 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.937+0000 7f511de00700 1 -- 172.21.15.82:0/371865903 shutdown_connections 2024-05-03T22:02:45.313 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:43.937+0000 7f511de00700 1 -- 172.21.15.82:0/371865903 wait complete. 2024-05-03T22:02:45.350 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T22:02:45.350 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-05-03T22:02:45.376 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T22:02:45.377 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-03T22:02:45.377 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-05-03T22:02:45.377 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-03T22:02:45.385 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph Dashboard is now available at: 2024-05-03T22:02:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:02:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: URL: https://smithi082.front.sepia.ceph.com:8443/ 2024-05-03T22:02:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: User: admin 2024-05-03T22:02:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: Password: 8gxsy4ixu2 2024-05-03T22:02:45.385 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:02:45.386 INFO:teuthology.orchestra.run.smithi082.stdout:Saving cluster configuration to /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config directory 2024-05-03T22:02:45.388 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling autotune for osd_memory_target 2024-05-03T22:02:47.086 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.049+0000 7fc320a00700 1 Processor -- start 2024-05-03T22:02:47.086 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.049+0000 7fc320a00700 1 -- start start 2024-05-03T22:02:47.086 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.050+0000 7fc320a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c10b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:47.086 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.050+0000 7fc320a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c10b790 con 0x7fc31c10ada0 2024-05-03T22:02:47.086 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.050+0000 7fc31a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c10b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:47.086 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.050+0000 7fc31a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c10b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38028/0 (socket says 172.21.15.82:38028) 2024-05-03T22:02:47.086 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.050+0000 7fc31a800700 1 -- 172.21.15.82:0/4163044919 learned_addr learned my addr 172.21.15.82:0/4163044919 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.051+0000 7fc31a800700 1 -- 172.21.15.82:0/4163044919 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c10bf50 con 0x7fc31c10ada0 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.051+0000 7fc31a800700 1 --2- 172.21.15.82:0/4163044919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c10b1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0098a0 tx=0x7fc30c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7772dec8cf3703df server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.051+0000 7fc319400700 1 -- 172.21.15.82:0/4163044919 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30c004160 con 0x7fc31c10ada0 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.051+0000 7fc319400700 1 -- 172.21.15.82:0/4163044919 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc30c004300 con 0x7fc31c10ada0 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.051+0000 7fc319400700 1 -- 172.21.15.82:0/4163044919 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30c011960 con 0x7fc31c10ada0 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.052+0000 7fc320a00700 1 -- 172.21.15.82:0/4163044919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 msgr2=0x7fc31c10b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.052+0000 7fc320a00700 1 --2- 172.21.15.82:0/4163044919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c10b1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0098a0 tx=0x7fc30c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.052+0000 7fc320a00700 1 -- 172.21.15.82:0/4163044919 shutdown_connections 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.052+0000 7fc320a00700 1 --2- 172.21.15.82:0/4163044919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c10b1c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.052+0000 7fc320a00700 1 -- 172.21.15.82:0/4163044919 >> 172.21.15.82:0/4163044919 conn(0x7fc31c07e100 msgr2=0x7fc31c07e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.052+0000 7fc320a00700 1 -- 172.21.15.82:0/4163044919 shutdown_connections 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.052+0000 7fc320a00700 1 -- 172.21.15.82:0/4163044919 wait complete. 2024-05-03T22:02:47.087 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.053+0000 7fc320a00700 1 Processor -- start 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.053+0000 7fc320a00700 1 -- start start 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.054+0000 7fc320a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.054+0000 7fc320a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c10f180 con 0x7fc31c10ada0 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.054+0000 7fc31a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.054+0000 7fc31a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c19eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38040/0 (socket says 172.21.15.82:38040) 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.054+0000 7fc31a800700 1 -- 172.21.15.82:0/94819466 learned_addr learned my addr 172.21.15.82:0/94819466 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.054+0000 7fc31a800700 1 -- 172.21.15.82:0/94819466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c19f060 con 0x7fc31c10ada0 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.055+0000 7fc31a800700 1 --2- 172.21.15.82:0/94819466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c19eb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc30c011670 tx=0x7fc30c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.055+0000 7fc313400700 1 -- 172.21.15.82:0/94819466 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30c003a60 con 0x7fc31c10ada0 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.055+0000 7fc313400700 1 -- 172.21.15.82:0/94819466 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc30c01b8d0 con 0x7fc31c10ada0 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.055+0000 7fc313400700 1 -- 172.21.15.82:0/94819466 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30c023790 con 0x7fc31c10ada0 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.055+0000 7fc320a00700 1 -- 172.21.15.82:0/94819466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31c19f2f0 con 0x7fc31c10ada0 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.055+0000 7fc320a00700 1 -- 172.21.15.82:0/94819466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc31c1a1fe0 con 0x7fc31c10ada0 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.056+0000 7fc320a00700 1 -- 172.21.15.82:0/94819466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc31c064b00 con 0x7fc31c10ada0 2024-05-03T22:02:47.088 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.056+0000 7fc313400700 1 -- 172.21.15.82:0/94819466 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fc30c01b440 con 0x7fc31c10ada0 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.057+0000 7fc313400700 1 --2- 172.21.15.82:0/94819466 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc30003e560 0x7fc300040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.057+0000 7fc313400700 1 -- 172.21.15.82:0/94819466 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc30c054100 con 0x7fc31c10ada0 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.057+0000 7fc319e00700 1 --2- 172.21.15.82:0/94819466 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc30003e560 0x7fc300040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.058+0000 7fc319e00700 1 --2- 172.21.15.82:0/94819466 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc30003e560 0x7fc300040a20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc308006fd0 tx=0x7fc308006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.062+0000 7fc313400700 1 -- 172.21.15.82:0/94819466 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc30c01f030 con 0x7fc31c10ada0 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.292+0000 7fc320a00700 1 -- 172.21.15.82:0/94819466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fc31c1a2600 con 0x7fc31c10ada0 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.293+0000 7fc313400700 1 -- 172.21.15.82:0/94819466 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fc30c023a40 con 0x7fc31c10ada0 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.295+0000 7fc320a00700 1 -- 172.21.15.82:0/94819466 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc30003e560 msgr2=0x7fc300040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.295+0000 7fc320a00700 1 --2- 172.21.15.82:0/94819466 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc30003e560 0x7fc300040a20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc308006fd0 tx=0x7fc308006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.295+0000 7fc320a00700 1 -- 172.21.15.82:0/94819466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 msgr2=0x7fc31c19eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.295+0000 7fc320a00700 1 --2- 172.21.15.82:0/94819466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c19eb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc30c011670 tx=0x7fc30c011a30 comp rx=0 tx=0).stop 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.296+0000 7fc320a00700 1 -- 172.21.15.82:0/94819466 shutdown_connections 2024-05-03T22:02:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.296+0000 7fc320a00700 1 --2- 172.21.15.82:0/94819466 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc30003e560 0x7fc300040a20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:47.090 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.296+0000 7fc320a00700 1 --2- 172.21.15.82:0/94819466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc31c10ada0 0x7fc31c19eb20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:47.090 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.296+0000 7fc320a00700 1 -- 172.21.15.82:0/94819466 >> 172.21.15.82:0/94819466 conn(0x7fc31c07e100 msgr2=0x7fc31c1083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:47.090 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.296+0000 7fc320a00700 1 -- 172.21.15.82:0/94819466 shutdown_connections 2024-05-03T22:02:47.090 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:46.296+0000 7fc320a00700 1 -- 172.21.15.82:0/94819466 wait complete. 2024-05-03T22:02:48.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.752+0000 7f1418a00700 1 Processor -- start 2024-05-03T22:02:48.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.753+0000 7f1418a00700 1 -- start start 2024-05-03T22:02:48.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.753+0000 7f1418a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f1414108f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:48.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.753+0000 7f1418a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1414109540 con 0x7f1414108b50 2024-05-03T22:02:48.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.753+0000 7f1413400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f1414108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:48.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.753+0000 7f1413400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f1414108f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38052/0 (socket says 172.21.15.82:38052) 2024-05-03T22:02:48.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.754+0000 7f1413400700 1 -- 172.21.15.82:0/2367865735 learned_addr learned my addr 172.21.15.82:0/2367865735 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:48.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.754+0000 7f1413400700 1 -- 172.21.15.82:0/2367865735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1414109d50 con 0x7f1414108b50 2024-05-03T22:02:48.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.754+0000 7f1413400700 1 --2- 172.21.15.82:0/2367865735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f1414108f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14040098a0 tx=0x7f1404009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ebbf06c6e88fb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:48.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.754+0000 7f1412a00700 1 -- 172.21.15.82:0/2367865735 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404004160 con 0x7f1414108b50 2024-05-03T22:02:48.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.755+0000 7f1412a00700 1 -- 172.21.15.82:0/2367865735 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1404004300 con 0x7f1414108b50 2024-05-03T22:02:48.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.755+0000 7f1412a00700 1 -- 172.21.15.82:0/2367865735 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404011960 con 0x7f1414108b50 2024-05-03T22:02:48.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.755+0000 7f1418a00700 1 -- 172.21.15.82:0/2367865735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 msgr2=0x7f1414108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:48.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.755+0000 7f1418a00700 1 --2- 172.21.15.82:0/2367865735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f1414108f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14040098a0 tx=0x7f1404009bb0 comp rx=0 tx=0).stop 2024-05-03T22:02:48.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.755+0000 7f1418a00700 1 -- 172.21.15.82:0/2367865735 shutdown_connections 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.755+0000 7f1418a00700 1 --2- 172.21.15.82:0/2367865735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f1414108f70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.755+0000 7f1418a00700 1 -- 172.21.15.82:0/2367865735 >> 172.21.15.82:0/2367865735 conn(0x7f14141040f0 msgr2=0x7f1414106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.755+0000 7f1418a00700 1 -- 172.21.15.82:0/2367865735 shutdown_connections 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.755+0000 7f1418a00700 1 -- 172.21.15.82:0/2367865735 wait complete. 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.756+0000 7f1418a00700 1 Processor -- start 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.757+0000 7f1418a00700 1 -- start start 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.757+0000 7f1418a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f141407eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.757+0000 7f1418a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f141410cf80 con 0x7f1414108b50 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.757+0000 7f1413400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f141407eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.757+0000 7f1413400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f141407eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38056/0 (socket says 172.21.15.82:38056) 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.757+0000 7f1413400700 1 -- 172.21.15.82:0/735380447 learned_addr learned my addr 172.21.15.82:0/735380447 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.758+0000 7f1413400700 1 -- 172.21.15.82:0/735380447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141407f0c0 con 0x7f1414108b50 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.758+0000 7f1413400700 1 --2- 172.21.15.82:0/735380447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f141407eb80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1404011670 tx=0x7f1404011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:48.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.758+0000 7f1410c00700 1 -- 172.21.15.82:0/735380447 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404003a60 con 0x7f1414108b50 2024-05-03T22:02:48.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.758+0000 7f1410c00700 1 -- 172.21.15.82:0/735380447 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f140401b8d0 con 0x7f1414108b50 2024-05-03T22:02:48.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.758+0000 7f1410c00700 1 -- 172.21.15.82:0/735380447 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404023790 con 0x7f1414108b50 2024-05-03T22:02:48.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.758+0000 7f1418a00700 1 -- 172.21.15.82:0/735380447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141407d2b0 con 0x7f1414108b50 2024-05-03T22:02:48.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.758+0000 7f1418a00700 1 -- 172.21.15.82:0/735380447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141407d7f0 con 0x7f1414108b50 2024-05-03T22:02:48.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.759+0000 7f1418a00700 1 -- 172.21.15.82:0/735380447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1414064b00 con 0x7f1414108b50 2024-05-03T22:02:48.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.760+0000 7f1410c00700 1 -- 172.21.15.82:0/735380447 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f140401b440 con 0x7f1414108b50 2024-05-03T22:02:48.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.760+0000 7f1410c00700 1 --2- 172.21.15.82:0/735380447 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13f803e5c0 0x7f13f8040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:48.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.760+0000 7f1410c00700 1 -- 172.21.15.82:0/735380447 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1404054170 con 0x7f1414108b50 2024-05-03T22:02:48.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.760+0000 7f140aa00700 1 --2- 172.21.15.82:0/735380447 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13f803e5c0 0x7f13f8040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:48.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.761+0000 7f140aa00700 1 --2- 172.21.15.82:0/735380447 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13f803e5c0 0x7f13f8040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00ad30 tx=0x7f13fc0093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:48.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:47.766+0000 7f1410c00700 1 -- 172.21.15.82:0/735380447 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f140401f030 con 0x7f1414108b50 2024-05-03T22:02:48.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.111+0000 7f1418a00700 1 -- 172.21.15.82:0/735380447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f141407db30 con 0x7f1414108b50 2024-05-03T22:02:48.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.117+0000 7f1410c00700 1 -- 172.21.15.82:0/735380447 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f141407db30 con 0x7f1414108b50 2024-05-03T22:02:48.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.120+0000 7f1418a00700 1 -- 172.21.15.82:0/735380447 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13f803e5c0 msgr2=0x7f13f8040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:48.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.120+0000 7f1418a00700 1 --2- 172.21.15.82:0/735380447 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13f803e5c0 0x7f13f8040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00ad30 tx=0x7f13fc0093f0 comp rx=0 tx=0).stop 2024-05-03T22:02:48.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.120+0000 7f1418a00700 1 -- 172.21.15.82:0/735380447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 msgr2=0x7f141407eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:48.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.120+0000 7f1418a00700 1 --2- 172.21.15.82:0/735380447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f141407eb80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1404011670 tx=0x7f1404011a30 comp rx=0 tx=0).stop 2024-05-03T22:02:48.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.120+0000 7f1418a00700 1 -- 172.21.15.82:0/735380447 shutdown_connections 2024-05-03T22:02:48.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.120+0000 7f1418a00700 1 --2- 172.21.15.82:0/735380447 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13f803e5c0 0x7f13f8040a80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:48.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.120+0000 7f1418a00700 1 --2- 172.21.15.82:0/735380447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1414108b50 0x7f141407eb80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:48.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.120+0000 7f1418a00700 1 -- 172.21.15.82:0/735380447 >> 172.21.15.82:0/735380447 conn(0x7f14141040f0 msgr2=0x7f1414104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:48.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.121+0000 7f1418a00700 1 -- 172.21.15.82:0/735380447 shutdown_connections 2024-05-03T22:02:48.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-03T22:02:48.121+0000 7f1418a00700 1 -- 172.21.15.82:0/735380447 wait complete. 2024-05-03T22:02:48.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-03T22:02:48.873 INFO:teuthology.orchestra.run.smithi082.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-03T22:02:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:02:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:02:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:02:48.873 INFO:teuthology.orchestra.run.smithi082.stdout:Or, if you are only running a single cluster on this host: 2024-05-03T22:02:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:02:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-03T22:02:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:02:48.874 INFO:teuthology.orchestra.run.smithi082.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-03T22:02:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:02:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: ceph telemetry on 2024-05-03T22:02:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:02:48.874 INFO:teuthology.orchestra.run.smithi082.stdout:For more information see: 2024-05-03T22:02:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:02:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-03T22:02:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:02:48.874 INFO:teuthology.orchestra.run.smithi082.stdout:Bootstrap complete. 2024-05-03T22:02:48.953 INFO:tasks.cephadm:Fetching config... 2024-05-03T22:02:48.954 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:02:48.954 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-03T22:02:48.999 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-03T22:02:48.999 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:02:48.999 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-03T22:02:49.082 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-03T22:02:49.082 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:02:49.083 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-03T22:02:49.190 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-03T22:02:49.191 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:02:49.191 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-03T22:02:49.283 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-03T22:02:49.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs6FxIs7qd7EhxYr0FpgR5C/FFotbTk3SujeCisoXr8vZ4+Zwd1gITKCWN7mmxSHU/bxl6ib3w24xnxzJR0/J+Jad57JT45kLc9TFOiJN9q1LWTdVCd1vFxoCWNsHV+VJFUid/AZpM7W7wU5XiKJhNY2YVrWrwQz8EGjvdbl1eKSjhiR8uffpYu+E4/BiG7Qpa1Jka0NrwjV77/EGIOHvvYzal/hntkiKihzxc4Cqbx8g1BHDqSYCIliky3OXqIvDXOYDGZGn8D8AbLLuoN0OvrsefaDublOq2k44Y6Rjr88aKnMvbMiUtQHIB8qFm9GcSJxccKrU9VybNfvPdzbBxlkQzKGHjXZBK00Z5FtN7iwpnk/7WtnIgWB5+W9BXTqU4eBoEqdrKHg6DlGQb0uFendtqzWRmKu9+GtiK4nJOEraiYvF9u6s1/XSxAxff03k5iFqlQYhUttb9Qcnur/rWZbWIjlotYrudopzcLF+TQnwazeCJI+m9/3o1eeEbpcM= ceph-81cd0262-0998-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-03T22:02:49.380 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:49 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/735380447' entity='client.admin' 2024-05-03T22:02:49.387 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs6FxIs7qd7EhxYr0FpgR5C/FFotbTk3SujeCisoXr8vZ4+Zwd1gITKCWN7mmxSHU/bxl6ib3w24xnxzJR0/J+Jad57JT45kLc9TFOiJN9q1LWTdVCd1vFxoCWNsHV+VJFUid/AZpM7W7wU5XiKJhNY2YVrWrwQz8EGjvdbl1eKSjhiR8uffpYu+E4/BiG7Qpa1Jka0NrwjV77/EGIOHvvYzal/hntkiKihzxc4Cqbx8g1BHDqSYCIliky3OXqIvDXOYDGZGn8D8AbLLuoN0OvrsefaDublOq2k44Y6Rjr88aKnMvbMiUtQHIB8qFm9GcSJxccKrU9VybNfvPdzbBxlkQzKGHjXZBK00Z5FtN7iwpnk/7WtnIgWB5+W9BXTqU4eBoEqdrKHg6DlGQb0uFendtqzWRmKu9+GtiK4nJOEraiYvF9u6s1/XSxAxff03k5iFqlQYhUttb9Qcnur/rWZbWIjlotYrudopzcLF+TQnwazeCJI+m9/3o1eeEbpcM= ceph-81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:02:49.435 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs6FxIs7qd7EhxYr0FpgR5C/FFotbTk3SujeCisoXr8vZ4+Zwd1gITKCWN7mmxSHU/bxl6ib3w24xnxzJR0/J+Jad57JT45kLc9TFOiJN9q1LWTdVCd1vFxoCWNsHV+VJFUid/AZpM7W7wU5XiKJhNY2YVrWrwQz8EGjvdbl1eKSjhiR8uffpYu+E4/BiG7Qpa1Jka0NrwjV77/EGIOHvvYzal/hntkiKihzxc4Cqbx8g1BHDqSYCIliky3OXqIvDXOYDGZGn8D8AbLLuoN0OvrsefaDublOq2k44Y6Rjr88aKnMvbMiUtQHIB8qFm9GcSJxccKrU9VybNfvPdzbBxlkQzKGHjXZBK00Z5FtN7iwpnk/7WtnIgWB5+W9BXTqU4eBoEqdrKHg6DlGQb0uFendtqzWRmKu9+GtiK4nJOEraiYvF9u6s1/XSxAxff03k5iFqlQYhUttb9Qcnur/rWZbWIjlotYrudopzcLF+TQnwazeCJI+m9/3o1eeEbpcM= ceph-81cd0262-0998-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-03T22:02:49.548 INFO:teuthology.orchestra.run.smithi116.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs6FxIs7qd7EhxYr0FpgR5C/FFotbTk3SujeCisoXr8vZ4+Zwd1gITKCWN7mmxSHU/bxl6ib3w24xnxzJR0/J+Jad57JT45kLc9TFOiJN9q1LWTdVCd1vFxoCWNsHV+VJFUid/AZpM7W7wU5XiKJhNY2YVrWrwQz8EGjvdbl1eKSjhiR8uffpYu+E4/BiG7Qpa1Jka0NrwjV77/EGIOHvvYzal/hntkiKihzxc4Cqbx8g1BHDqSYCIliky3OXqIvDXOYDGZGn8D8AbLLuoN0OvrsefaDublOq2k44Y6Rjr88aKnMvbMiUtQHIB8qFm9GcSJxccKrU9VybNfvPdzbBxlkQzKGHjXZBK00Z5FtN7iwpnk/7WtnIgWB5+W9BXTqU4eBoEqdrKHg6DlGQb0uFendtqzWRmKu9+GtiK4nJOEraiYvF9u6s1/XSxAxff03k5iFqlQYhUttb9Qcnur/rWZbWIjlotYrudopzcLF+TQnwazeCJI+m9/3o1eeEbpcM= ceph-81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:02:49.587 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs6FxIs7qd7EhxYr0FpgR5C/FFotbTk3SujeCisoXr8vZ4+Zwd1gITKCWN7mmxSHU/bxl6ib3w24xnxzJR0/J+Jad57JT45kLc9TFOiJN9q1LWTdVCd1vFxoCWNsHV+VJFUid/AZpM7W7wU5XiKJhNY2YVrWrwQz8EGjvdbl1eKSjhiR8uffpYu+E4/BiG7Qpa1Jka0NrwjV77/EGIOHvvYzal/hntkiKihzxc4Cqbx8g1BHDqSYCIliky3OXqIvDXOYDGZGn8D8AbLLuoN0OvrsefaDublOq2k44Y6Rjr88aKnMvbMiUtQHIB8qFm9GcSJxccKrU9VybNfvPdzbBxlkQzKGHjXZBK00Z5FtN7iwpnk/7WtnIgWB5+W9BXTqU4eBoEqdrKHg6DlGQb0uFendtqzWRmKu9+GtiK4nJOEraiYvF9u6s1/XSxAxff03k5iFqlQYhUttb9Qcnur/rWZbWIjlotYrudopzcLF+TQnwazeCJI+m9/3o1eeEbpcM= ceph-81cd0262-0998-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-03T22:02:49.708 INFO:teuthology.orchestra.run.smithi130.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs6FxIs7qd7EhxYr0FpgR5C/FFotbTk3SujeCisoXr8vZ4+Zwd1gITKCWN7mmxSHU/bxl6ib3w24xnxzJR0/J+Jad57JT45kLc9TFOiJN9q1LWTdVCd1vFxoCWNsHV+VJFUid/AZpM7W7wU5XiKJhNY2YVrWrwQz8EGjvdbl1eKSjhiR8uffpYu+E4/BiG7Qpa1Jka0NrwjV77/EGIOHvvYzal/hntkiKihzxc4Cqbx8g1BHDqSYCIliky3OXqIvDXOYDGZGn8D8AbLLuoN0OvrsefaDublOq2k44Y6Rjr88aKnMvbMiUtQHIB8qFm9GcSJxccKrU9VybNfvPdzbBxlkQzKGHjXZBK00Z5FtN7iwpnk/7WtnIgWB5+W9BXTqU4eBoEqdrKHg6DlGQb0uFendtqzWRmKu9+GtiK4nJOEraiYvF9u6s1/XSxAxff03k5iFqlQYhUttb9Qcnur/rWZbWIjlotYrudopzcLF+TQnwazeCJI+m9/3o1eeEbpcM= ceph-81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:02:49.758 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-03T22:02:50.173 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:02:52.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.833+0000 7f0e56000700 1 -- 172.21.15.82:0/700713945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e50075930 msgr2=0x7f0e50075d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:52.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.833+0000 7f0e56000700 1 --2- 172.21.15.82:0/700713945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e50075930 0x7f0e50075d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009910 tx=0x7f0e40009c20 comp rx=0 tx=0).stop 2024-05-03T22:02:52.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.833+0000 7f0e56000700 1 -- 172.21.15.82:0/700713945 shutdown_connections 2024-05-03T22:02:52.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.833+0000 7f0e56000700 1 --2- 172.21.15.82:0/700713945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e50075930 0x7f0e50075d50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:52.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.833+0000 7f0e56000700 1 -- 172.21.15.82:0/700713945 >> 172.21.15.82:0/700713945 conn(0x7f0e500fe4f0 msgr2=0x7f0e50100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:52.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.833+0000 7f0e56000700 1 -- 172.21.15.82:0/700713945 shutdown_connections 2024-05-03T22:02:52.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.833+0000 7f0e56000700 1 -- 172.21.15.82:0/700713945 wait complete. 2024-05-03T22:02:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.834+0000 7f0e56000700 1 Processor -- start 2024-05-03T22:02:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.835+0000 7f0e56000700 1 -- start start 2024-05-03T22:02:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.835+0000 7f0e56000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e50075930 0x7f0e5019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.835+0000 7f0e56000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5010f510 con 0x7f0e50075930 2024-05-03T22:02:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.835+0000 7f0e4f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e50075930 0x7f0e5019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.835+0000 7f0e4f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e50075930 0x7f0e5019eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38082/0 (socket says 172.21.15.82:38082) 2024-05-03T22:02:52.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.835+0000 7f0e4f400700 1 -- 172.21.15.82:0/3796447448 learned_addr learned my addr 172.21.15.82:0/3796447448 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.836+0000 7f0e4f400700 1 -- 172.21.15.82:0/3796447448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5019f0c0 con 0x7f0e50075930 2024-05-03T22:02:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.836+0000 7f0e4f400700 1 --2- 172.21.15.82:0/3796447448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e50075930 0x7f0e5019eb80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0e40000c00 tx=0x7f0e40005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.836+0000 7f0e4cc00700 1 -- 172.21.15.82:0/3796447448 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e40027070 con 0x7f0e50075930 2024-05-03T22:02:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.836+0000 7f0e4cc00700 1 -- 172.21.15.82:0/3796447448 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e4000f460 con 0x7f0e50075930 2024-05-03T22:02:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.836+0000 7f0e56000700 1 -- 172.21.15.82:0/3796447448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5019f350 con 0x7f0e50075930 2024-05-03T22:02:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.836+0000 7f0e4cc00700 1 -- 172.21.15.82:0/3796447448 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e40017440 con 0x7f0e50075930 2024-05-03T22:02:52.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.837+0000 7f0e56000700 1 -- 172.21.15.82:0/3796447448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e501a2040 con 0x7f0e50075930 2024-05-03T22:02:52.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.838+0000 7f0e56000700 1 -- 172.21.15.82:0/3796447448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5010fba0 con 0x7f0e50075930 2024-05-03T22:02:52.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.838+0000 7f0e4cc00700 1 -- 172.21.15.82:0/3796447448 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f0e4002a070 con 0x7f0e50075930 2024-05-03T22:02:52.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.838+0000 7f0e4cc00700 1 --2- 172.21.15.82:0/3796447448 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0e3403e570 0x7f0e34040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:52.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.838+0000 7f0e4cc00700 1 -- 172.21.15.82:0/3796447448 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0e400538e0 con 0x7f0e50075930 2024-05-03T22:02:52.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.839+0000 7f0e46a00700 1 --2- 172.21.15.82:0/3796447448 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0e3403e570 0x7f0e34040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:52.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.839+0000 7f0e46a00700 1 --2- 172.21.15.82:0/3796447448 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0e3403e570 0x7f0e34040a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e38006fd0 tx=0x7f0e38006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:52.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:52.844+0000 7f0e4cc00700 1 -- 172.21.15.82:0/3796447448 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0e40013070 con 0x7f0e50075930 2024-05-03T22:02:53.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.071+0000 7f0e56000700 1 -- 172.21.15.82:0/3796447448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f0e5002e510 con 0x7f0e50075930 2024-05-03T22:02:53.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.075+0000 7f0e4cc00700 1 -- 172.21.15.82:0/3796447448 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f0e400310c0 con 0x7f0e50075930 2024-05-03T22:02:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.078+0000 7f0e56000700 1 -- 172.21.15.82:0/3796447448 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0e3403e570 msgr2=0x7f0e34040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.078+0000 7f0e56000700 1 --2- 172.21.15.82:0/3796447448 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0e3403e570 0x7f0e34040a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e38006fd0 tx=0x7f0e38006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.078+0000 7f0e56000700 1 -- 172.21.15.82:0/3796447448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e50075930 msgr2=0x7f0e5019eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.078+0000 7f0e56000700 1 --2- 172.21.15.82:0/3796447448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e50075930 0x7f0e5019eb80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0e40000c00 tx=0x7f0e40005810 comp rx=0 tx=0).stop 2024-05-03T22:02:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.079+0000 7f0e56000700 1 -- 172.21.15.82:0/3796447448 shutdown_connections 2024-05-03T22:02:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.079+0000 7f0e56000700 1 --2- 172.21.15.82:0/3796447448 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0e3403e570 0x7f0e34040a30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.079+0000 7f0e56000700 1 --2- 172.21.15.82:0/3796447448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e50075930 0x7f0e5019eb80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.079+0000 7f0e56000700 1 -- 172.21.15.82:0/3796447448 >> 172.21.15.82:0/3796447448 conn(0x7f0e500fe4f0 msgr2=0x7f0e500ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.079+0000 7f0e56000700 1 -- 172.21.15.82:0/3796447448 shutdown_connections 2024-05-03T22:02:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:53.079+0000 7f0e56000700 1 -- 172.21.15.82:0/3796447448 wait complete. 2024-05-03T22:02:53.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:53.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:53.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:02:53.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:53.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:02:53.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:53.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:53 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3796447448' entity='client.admin' 2024-05-03T22:02:53.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:02:53.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:53.835 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-03T22:02:53.835 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-03T22:02:54.267 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:02:56.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.449+0000 7f6555000700 1 -- 172.21.15.82:0/1068769328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6550104f00 msgr2=0x7f6550105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.449+0000 7f6555000700 1 --2- 172.21.15.82:0/1068769328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6550104f00 0x7f6550105340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6540009910 tx=0x7f6540009c20 comp rx=0 tx=0).stop 2024-05-03T22:02:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.449+0000 7f6555000700 1 -- 172.21.15.82:0/1068769328 shutdown_connections 2024-05-03T22:02:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.449+0000 7f6555000700 1 --2- 172.21.15.82:0/1068769328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6550104f00 0x7f6550105340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.449+0000 7f6555000700 1 -- 172.21.15.82:0/1068769328 >> 172.21.15.82:0/1068769328 conn(0x7f65501004d0 msgr2=0x7f6550102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.449+0000 7f6555000700 1 -- 172.21.15.82:0/1068769328 shutdown_connections 2024-05-03T22:02:56.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.449+0000 7f6555000700 1 -- 172.21.15.82:0/1068769328 wait complete. 2024-05-03T22:02:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.451+0000 7f6555000700 1 Processor -- start 2024-05-03T22:02:56.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.452+0000 7f6555000700 1 -- start start 2024-05-03T22:02:56.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.452+0000 7f6555000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6550104f00 0x7f655019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:56.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.452+0000 7f6555000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f655010aca0 con 0x7f6550104f00 2024-05-03T22:02:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.452+0000 7f654f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6550104f00 0x7f655019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.452+0000 7f654f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6550104f00 0x7f655019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39800/0 (socket says 172.21.15.82:39800) 2024-05-03T22:02:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.452+0000 7f654f400700 1 -- 172.21.15.82:0/3559631402 learned_addr learned my addr 172.21.15.82:0/3559631402 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:02:56.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.453+0000 7f654f400700 1 -- 172.21.15.82:0/3559631402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655019a9e0 con 0x7f6550104f00 2024-05-03T22:02:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.453+0000 7f654f400700 1 --2- 172.21.15.82:0/3559631402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6550104f00 0x7f655019a4a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6540005120 tx=0x7f6540005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.453+0000 7f6547e00700 1 -- 172.21.15.82:0/3559631402 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6540027070 con 0x7f6550104f00 2024-05-03T22:02:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.453+0000 7f6547e00700 1 -- 172.21.15.82:0/3559631402 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f654000f460 con 0x7f6550104f00 2024-05-03T22:02:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.453+0000 7f6547e00700 1 -- 172.21.15.82:0/3559631402 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6540017440 con 0x7f6550104f00 2024-05-03T22:02:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.453+0000 7f6555000700 1 -- 172.21.15.82:0/3559631402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f655019ac70 con 0x7f6550104f00 2024-05-03T22:02:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.454+0000 7f6555000700 1 -- 172.21.15.82:0/3559631402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f655019d960 con 0x7f6550104f00 2024-05-03T22:02:56.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.455+0000 7f6547e00700 1 -- 172.21.15.82:0/3559631402 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f654002a070 con 0x7f6550104f00 2024-05-03T22:02:56.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.455+0000 7f6555000700 1 -- 172.21.15.82:0/3559631402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f655010b420 con 0x7f6550104f00 2024-05-03T22:02:56.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.455+0000 7f6547e00700 1 --2- 172.21.15.82:0/3559631402 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f653403e570 0x7f6534040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:02:56.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.455+0000 7f6547e00700 1 -- 172.21.15.82:0/3559631402 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6540053870 con 0x7f6550104f00 2024-05-03T22:02:56.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.456+0000 7f654ea00700 1 --2- 172.21.15.82:0/3559631402 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f653403e570 0x7f6534040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:02:56.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.456+0000 7f654ea00700 1 --2- 172.21.15.82:0/3559631402 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f653403e570 0x7f6534040a30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f653c006fd0 tx=0x7f653c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:02:56.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.462+0000 7f6547e00700 1 -- 172.21.15.82:0/3559631402 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6540013070 con 0x7f6550104f00 2024-05-03T22:02:56.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.700+0000 7f6555000700 1 -- 172.21.15.82:0/3559631402 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f655002e620 con 0x7f653403e570 2024-05-03T22:02:56.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.709+0000 7f6547e00700 1 -- 172.21.15.82:0/3559631402 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f655002e620 con 0x7f653403e570 2024-05-03T22:02:56.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.712+0000 7f6555000700 1 -- 172.21.15.82:0/3559631402 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f653403e570 msgr2=0x7f6534040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:56.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.712+0000 7f6555000700 1 --2- 172.21.15.82:0/3559631402 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f653403e570 0x7f6534040a30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f653c006fd0 tx=0x7f653c006e40 comp rx=0 tx=0).stop 2024-05-03T22:02:56.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.712+0000 7f6555000700 1 -- 172.21.15.82:0/3559631402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6550104f00 msgr2=0x7f655019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:02:56.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.712+0000 7f6555000700 1 --2- 172.21.15.82:0/3559631402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6550104f00 0x7f655019a4a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6540005120 tx=0x7f6540005810 comp rx=0 tx=0).stop 2024-05-03T22:02:56.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.712+0000 7f6555000700 1 -- 172.21.15.82:0/3559631402 shutdown_connections 2024-05-03T22:02:56.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.712+0000 7f6555000700 1 --2- 172.21.15.82:0/3559631402 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f653403e570 0x7f6534040a30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:56.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.712+0000 7f6555000700 1 --2- 172.21.15.82:0/3559631402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6550104f00 0x7f655019a4a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:02:56.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.712+0000 7f6555000700 1 -- 172.21.15.82:0/3559631402 >> 172.21.15.82:0/3559631402 conn(0x7f65501004d0 msgr2=0x7f65501010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:02:56.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.712+0000 7f6555000700 1 -- 172.21.15.82:0/3559631402 shutdown_connections 2024-05-03T22:02:56.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:02:56.712+0000 7f6555000700 1 -- 172.21.15.82:0/3559631402 wait complete. 2024-05-03T22:02:57.608 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi116 2024-05-03T22:02:57.609 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-05-03T22:02:57.609 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.conf 2024-05-03T22:02:57.668 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-05-03T22:02:57.668 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:02:57.763 INFO:tasks.cephadm:Adding host smithi116 to orchestrator... 2024-05-03T22:02:57.764 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch host add smithi116 2024-05-03T22:02:57.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:57 smithi082 ceph-mon[28404]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:02:57.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:57 smithi082 ceph-mon[28404]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:02:57.827 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:57.827 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:02:57.827 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:02:57.827 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:02:57.827 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:57 smithi082 ceph-mon[28404]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-03T22:02:58.181 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:02:58.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:58 smithi082 ceph-mon[28404]: Updating smithi082:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:02:58.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:58 smithi082 ceph-mon[28404]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:02:59.900 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:59 smithi082 ceph-mon[28404]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:02:59.901 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:59 smithi082 ceph-mon[28404]: Updating smithi082:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:02:59.901 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:59.901 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:02:59.901 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:02:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.421+0000 7fa49f200700 1 -- 172.21.15.82:0/778649003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa498103110 msgr2=0x7fa4981034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.421+0000 7fa49f200700 1 --2- 172.21.15.82:0/778649003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa498103110 0x7fa4981034f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa488009910 tx=0x7fa488009c20 comp rx=0 tx=0).stop 2024-05-03T22:03:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.421+0000 7fa49f200700 1 -- 172.21.15.82:0/778649003 shutdown_connections 2024-05-03T22:03:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.421+0000 7fa49f200700 1 --2- 172.21.15.82:0/778649003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa498103110 0x7fa4981034f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.421+0000 7fa49f200700 1 -- 172.21.15.82:0/778649003 >> 172.21.15.82:0/778649003 conn(0x7fa4980fe9e0 msgr2=0x7fa498100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.421+0000 7fa49f200700 1 -- 172.21.15.82:0/778649003 shutdown_connections 2024-05-03T22:03:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.421+0000 7fa49f200700 1 -- 172.21.15.82:0/778649003 wait complete. 2024-05-03T22:03:00.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.422+0000 7fa49f200700 1 Processor -- start 2024-05-03T22:03:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.423+0000 7fa49f200700 1 -- start start 2024-05-03T22:03:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.423+0000 7fa49f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa498103110 0x7fa4981a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:00.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.423+0000 7fa49f200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa49810d240 con 0x7fa498103110 2024-05-03T22:03:00.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.423+0000 7fa497e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa498103110 0x7fa4981a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:00.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.423+0000 7fa497e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa498103110 0x7fa4981a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39816/0 (socket says 172.21.15.82:39816) 2024-05-03T22:03:00.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.423+0000 7fa497e00700 1 -- 172.21.15.82:0/1682142287 learned_addr learned my addr 172.21.15.82:0/1682142287 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:03:00.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.424+0000 7fa497e00700 1 -- 172.21.15.82:0/1682142287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4981a0bf0 con 0x7fa498103110 2024-05-03T22:03:00.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.424+0000 7fa497e00700 1 --2- 172.21.15.82:0/1682142287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa498103110 0x7fa4981a06b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa488005660 tx=0x7fa488005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:00.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.424+0000 7fa494c00700 1 -- 172.21.15.82:0/1682142287 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa488026070 con 0x7fa498103110 2024-05-03T22:03:00.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.424+0000 7fa494c00700 1 -- 172.21.15.82:0/1682142287 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa48800b6f0 con 0x7fa498103110 2024-05-03T22:03:00.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.424+0000 7fa49f200700 1 -- 172.21.15.82:0/1682142287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4981a0ee0 con 0x7fa498103110 2024-05-03T22:03:00.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.425+0000 7fa49f200700 1 -- 172.21.15.82:0/1682142287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49819a870 con 0x7fa498103110 2024-05-03T22:03:00.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.425+0000 7fa494c00700 1 -- 172.21.15.82:0/1682142287 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4880037b0 con 0x7fa498103110 2024-05-03T22:03:00.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.426+0000 7fa494c00700 1 -- 172.21.15.82:0/1682142287 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fa488029070 con 0x7fa498103110 2024-05-03T22:03:00.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.426+0000 7fa49f200700 1 -- 172.21.15.82:0/1682142287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa478005330 con 0x7fa498103110 2024-05-03T22:03:00.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.427+0000 7fa494c00700 1 --2- 172.21.15.82:0/1682142287 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa47c03e570 0x7fa47c040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:00.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.427+0000 7fa494c00700 1 -- 172.21.15.82:0/1682142287 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa48801e070 con 0x7fa498103110 2024-05-03T22:03:00.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.427+0000 7fa497400700 1 --2- 172.21.15.82:0/1682142287 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa47c03e570 0x7fa47c040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:00.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.428+0000 7fa497400700 1 --2- 172.21.15.82:0/1682142287 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa47c03e570 0x7fa47c040a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa484006fd0 tx=0x7fa484006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:00.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.433+0000 7fa494c00700 1 -- 172.21.15.82:0/1682142287 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa488013070 con 0x7fa498103110 2024-05-03T22:03:00.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:00.670+0000 7fa49f200700 1 -- 172.21.15.82:0/1682142287 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}) -- 0x7fa478000bc0 con 0x7fa47c03e570 2024-05-03T22:03:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:01 smithi082 ceph-mon[28404]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:01 smithi082 ceph-mon[28404]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:03:02.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:02 smithi082 ceph-mon[28404]: Deploying cephadm binary to smithi116 2024-05-03T22:03:03.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:03 smithi082 ceph-mon[28404]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:06.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:05 smithi082 ceph-mon[28404]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:06.688 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi116' with addr '172.21.15.116' 2024-05-03T22:03:06.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:06.685+0000 7fa494c00700 1 -- 172.21.15.82:0/1682142287 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fa478000bc0 con 0x7fa47c03e570 2024-05-03T22:03:06.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:06.690+0000 7fa49f200700 1 -- 172.21.15.82:0/1682142287 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa47c03e570 msgr2=0x7fa47c040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:06.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:06.690+0000 7fa49f200700 1 --2- 172.21.15.82:0/1682142287 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa47c03e570 0x7fa47c040a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa484006fd0 tx=0x7fa484006e40 comp rx=0 tx=0).stop 2024-05-03T22:03:06.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:06.690+0000 7fa49f200700 1 -- 172.21.15.82:0/1682142287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa498103110 msgr2=0x7fa4981a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:06.690+0000 7fa49f200700 1 --2- 172.21.15.82:0/1682142287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa498103110 0x7fa4981a06b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa488005660 tx=0x7fa488005740 comp rx=0 tx=0).stop 2024-05-03T22:03:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:06.690+0000 7fa49f200700 1 -- 172.21.15.82:0/1682142287 shutdown_connections 2024-05-03T22:03:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:06.690+0000 7fa49f200700 1 --2- 172.21.15.82:0/1682142287 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa47c03e570 0x7fa47c040a30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:06.690+0000 7fa49f200700 1 --2- 172.21.15.82:0/1682142287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa498103110 0x7fa4981a06b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:06.690+0000 7fa49f200700 1 -- 172.21.15.82:0/1682142287 >> 172.21.15.82:0/1682142287 conn(0x7fa4980fe9e0 msgr2=0x7fa4980756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:06.690+0000 7fa49f200700 1 -- 172.21.15.82:0/1682142287 shutdown_connections 2024-05-03T22:03:06.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:06.690+0000 7fa49f200700 1 -- 172.21.15.82:0/1682142287 wait complete. 2024-05-03T22:03:07.623 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-03T22:03:07.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:07 smithi082 ceph-mon[28404]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:07.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:07 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:07.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:07 smithi082 ceph-mon[28404]: Added host smithi116 2024-05-03T22:03:07.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:07 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:03:07.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:07 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:08.056 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:03:09.788 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:09 smithi082 ceph-mon[28404]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:09.788 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:09 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.345+0000 7f773d400700 1 -- 172.21.15.82:0/3794675205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f773810e4e0 msgr2=0x7f773810e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.345+0000 7f773d400700 1 --2- 172.21.15.82:0/3794675205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f773810e4e0 0x7f773810e8c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7728009910 tx=0x7f7728009c20 comp rx=0 tx=0).stop 2024-05-03T22:03:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.345+0000 7f773d400700 1 -- 172.21.15.82:0/3794675205 shutdown_connections 2024-05-03T22:03:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.345+0000 7f773d400700 1 --2- 172.21.15.82:0/3794675205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f773810e4e0 0x7f773810e8c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.345+0000 7f773d400700 1 -- 172.21.15.82:0/3794675205 >> 172.21.15.82:0/3794675205 conn(0x7f7738078c40 msgr2=0x7f773807b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.345+0000 7f773d400700 1 -- 172.21.15.82:0/3794675205 shutdown_connections 2024-05-03T22:03:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.345+0000 7f773d400700 1 -- 172.21.15.82:0/3794675205 wait complete. 2024-05-03T22:03:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.347+0000 7f773d400700 1 Processor -- start 2024-05-03T22:03:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.347+0000 7f773d400700 1 -- start start 2024-05-03T22:03:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.348+0000 7f773d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f773810e4e0 0x7f773819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.348+0000 7f773d400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77381138b0 con 0x7f773810e4e0 2024-05-03T22:03:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.348+0000 7f7736800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f773810e4e0 0x7f773819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.348+0000 7f7736800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f773810e4e0 0x7f773819edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34768/0 (socket says 172.21.15.82:34768) 2024-05-03T22:03:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.348+0000 7f7736800700 1 -- 172.21.15.82:0/833906812 learned_addr learned my addr 172.21.15.82:0/833906812 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:03:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.349+0000 7f7736800700 1 -- 172.21.15.82:0/833906812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773819f310 con 0x7f773810e4e0 2024-05-03T22:03:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.349+0000 7f7736800700 1 --2- 172.21.15.82:0/833906812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f773810e4e0 0x7f773819edd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77280092e0 tx=0x7f7728005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.349+0000 7f772f400700 1 -- 172.21.15.82:0/833906812 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7728026070 con 0x7f773810e4e0 2024-05-03T22:03:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.349+0000 7f772f400700 1 -- 172.21.15.82:0/833906812 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f772800b750 con 0x7f773810e4e0 2024-05-03T22:03:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.349+0000 7f772f400700 1 -- 172.21.15.82:0/833906812 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7728003810 con 0x7f773810e4e0 2024-05-03T22:03:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.349+0000 7f773d400700 1 -- 172.21.15.82:0/833906812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f773819f5a0 con 0x7f773810e4e0 2024-05-03T22:03:10.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.349+0000 7f773d400700 1 -- 172.21.15.82:0/833906812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77381a36a0 con 0x7f773810e4e0 2024-05-03T22:03:10.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.350+0000 7f773d400700 1 -- 172.21.15.82:0/833906812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f773810abe0 con 0x7f773810e4e0 2024-05-03T22:03:10.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.351+0000 7f772f400700 1 -- 172.21.15.82:0/833906812 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f7728029070 con 0x7f773810e4e0 2024-05-03T22:03:10.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.351+0000 7f772f400700 1 --2- 172.21.15.82:0/833906812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f771c03e570 0x7f771c040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:10.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.351+0000 7f772f400700 1 -- 172.21.15.82:0/833906812 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f772801e070 con 0x7f773810e4e0 2024-05-03T22:03:10.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.352+0000 7f772fe00700 1 --2- 172.21.15.82:0/833906812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f771c03e570 0x7f771c040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:10.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.352+0000 7f772fe00700 1 --2- 172.21.15.82:0/833906812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f771c03e570 0x7f771c040a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7720006fd0 tx=0x7f7720006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:10.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.357+0000 7f772f400700 1 -- 172.21.15.82:0/833906812 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7728013070 con 0x7f773810e4e0 2024-05-03T22:03:10.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.601+0000 7f773d400700 1 -- 172.21.15.82:0/833906812 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77381a0130 con 0x7f771c03e570 2024-05-03T22:03:10.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.604+0000 7f772f400700 1 -- 172.21.15.82:0/833906812 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f77381a0130 con 0x7f771c03e570 2024-05-03T22:03:10.605 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:03:10.605 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.116", "hostname": "smithi116", "labels": [], "status": ""}] 2024-05-03T22:03:10.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.607+0000 7f773d400700 1 -- 172.21.15.82:0/833906812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f771c03e570 msgr2=0x7f771c040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:10.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.607+0000 7f773d400700 1 --2- 172.21.15.82:0/833906812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f771c03e570 0x7f771c040a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7720006fd0 tx=0x7f7720006e40 comp rx=0 tx=0).stop 2024-05-03T22:03:10.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.607+0000 7f773d400700 1 -- 172.21.15.82:0/833906812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f773810e4e0 msgr2=0x7f773819edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:10.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.607+0000 7f773d400700 1 --2- 172.21.15.82:0/833906812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f773810e4e0 0x7f773819edd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77280092e0 tx=0x7f7728005710 comp rx=0 tx=0).stop 2024-05-03T22:03:10.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.607+0000 7f773d400700 1 -- 172.21.15.82:0/833906812 shutdown_connections 2024-05-03T22:03:10.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.607+0000 7f773d400700 1 --2- 172.21.15.82:0/833906812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f771c03e570 0x7f771c040a30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:10.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.607+0000 7f773d400700 1 --2- 172.21.15.82:0/833906812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f773810e4e0 0x7f773819edd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.607+0000 7f773d400700 1 -- 172.21.15.82:0/833906812 >> 172.21.15.82:0/833906812 conn(0x7f7738078c40 msgr2=0x7f77380799c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.607+0000 7f773d400700 1 -- 172.21.15.82:0/833906812 shutdown_connections 2024-05-03T22:03:10.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:10.607+0000 7f773d400700 1 -- 172.21.15.82:0/833906812 wait complete. 2024-05-03T22:03:11.375 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi130 2024-05-03T22:03:11.375 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-03T22:03:11.375 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/etc/ceph/ceph.conf 2024-05-03T22:03:11.435 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-03T22:03:11.435 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:03:11.531 INFO:tasks.cephadm:Adding host smithi130 to orchestrator... 2024-05-03T22:03:11.532 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch host add smithi130 2024-05-03T22:03:11.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:11 smithi082 ceph-mon[28404]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:11.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:11 smithi082 ceph-mon[28404]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:03:11.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:11 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:11.978 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:03:13.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:13 smithi082 ceph-mon[28404]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.138+0000 7f2976000700 1 -- 172.21.15.82:0/831336868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2970105170 msgr2=0x7f2970105550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.138+0000 7f2976000700 1 --2- 172.21.15.82:0/831336868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2970105170 0x7f2970105550 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2964009910 tx=0x7f2964009c20 comp rx=0 tx=0).stop 2024-05-03T22:03:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.139+0000 7f2976000700 1 -- 172.21.15.82:0/831336868 shutdown_connections 2024-05-03T22:03:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.139+0000 7f2976000700 1 --2- 172.21.15.82:0/831336868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2970105170 0x7f2970105550 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.139+0000 7f2976000700 1 -- 172.21.15.82:0/831336868 >> 172.21.15.82:0/831336868 conn(0x7f2970100a20 msgr2=0x7f2970102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.139+0000 7f2976000700 1 -- 172.21.15.82:0/831336868 shutdown_connections 2024-05-03T22:03:14.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.139+0000 7f2976000700 1 -- 172.21.15.82:0/831336868 wait complete. 2024-05-03T22:03:14.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.141+0000 7f2976000700 1 Processor -- start 2024-05-03T22:03:14.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.141+0000 7f2976000700 1 -- start start 2024-05-03T22:03:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.142+0000 7f2976000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2970105170 0x7f29701a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:14.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.142+0000 7f2976000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f297010f2a0 con 0x7f2970105170 2024-05-03T22:03:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.142+0000 7f2974c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2970105170 0x7f29701a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.142+0000 7f2974c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2970105170 0x7f29701a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52106/0 (socket says 172.21.15.82:52106) 2024-05-03T22:03:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.142+0000 7f2974c00700 1 -- 172.21.15.82:0/1521519135 learned_addr learned my addr 172.21.15.82:0/1521519135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:03:14.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.142+0000 7f2974c00700 1 -- 172.21.15.82:0/1521519135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29701a0b70 con 0x7f2970105170 2024-05-03T22:03:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.143+0000 7f2974c00700 1 --2- 172.21.15.82:0/1521519135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2970105170 0x7f29701a0630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2964006010 tx=0x7f2964005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.143+0000 7f296d600700 1 -- 172.21.15.82:0/1521519135 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2964026070 con 0x7f2970105170 2024-05-03T22:03:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.143+0000 7f296d600700 1 -- 172.21.15.82:0/1521519135 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f296400b6f0 con 0x7f2970105170 2024-05-03T22:03:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.143+0000 7f296d600700 1 -- 172.21.15.82:0/1521519135 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2964003810 con 0x7f2970105170 2024-05-03T22:03:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.143+0000 7f2976000700 1 -- 172.21.15.82:0/1521519135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29701a0e60 con 0x7f2970105170 2024-05-03T22:03:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.143+0000 7f2976000700 1 -- 172.21.15.82:0/1521519135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f297019a8d0 con 0x7f2970105170 2024-05-03T22:03:14.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.144+0000 7f2976000700 1 -- 172.21.15.82:0/1521519135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2970106650 con 0x7f2970105170 2024-05-03T22:03:14.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.144+0000 7f296d600700 1 -- 172.21.15.82:0/1521519135 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f2964029070 con 0x7f2970105170 2024-05-03T22:03:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.145+0000 7f296d600700 1 --2- 172.21.15.82:0/1521519135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f295803e570 0x7f2958040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.145+0000 7f296d600700 1 -- 172.21.15.82:0/1521519135 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f296401e070 con 0x7f2970105170 2024-05-03T22:03:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.145+0000 7f296fe00700 1 --2- 172.21.15.82:0/1521519135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f295803e570 0x7f2958040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.146+0000 7f296fe00700 1 --2- 172.21.15.82:0/1521519135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f295803e570 0x7f2958040a30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f295c006fd0 tx=0x7f295c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.151+0000 7f296d600700 1 -- 172.21.15.82:0/1521519135 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2964013070 con 0x7f2970105170 2024-05-03T22:03:14.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:14.390+0000 7f2976000700 1 -- 172.21.15.82:0/1521519135 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi130", "target": ["mon-mgr", ""]}) -- 0x7f297019bc30 con 0x7f295803e570 2024-05-03T22:03:15.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:15 smithi082 ceph-mon[28404]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi130", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:03:15.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:15 smithi082 ceph-mon[28404]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:15.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:15.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:15.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:15.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:15.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:03:15.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:15.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:03:16.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:16 smithi082 ceph-mon[28404]: Updating smithi116:/etc/ceph/ceph.conf 2024-05-03T22:03:16.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:16 smithi082 ceph-mon[28404]: Deploying cephadm binary to smithi130 2024-05-03T22:03:17.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:17 smithi082 ceph-mon[28404]: Updating smithi116:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:03:17.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:17 smithi082 ceph-mon[28404]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:19.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:19 smithi082 ceph-mon[28404]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:20.510+0000 7f296d600700 1 -- 172.21.15.82:0/1521519135 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f297019bc30 con 0x7f295803e570 2024-05-03T22:03:20.513 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi130' with addr '172.21.15.130' 2024-05-03T22:03:20.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:20.514+0000 7f2976000700 1 -- 172.21.15.82:0/1521519135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f295803e570 msgr2=0x7f2958040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:20.514+0000 7f2976000700 1 --2- 172.21.15.82:0/1521519135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f295803e570 0x7f2958040a30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f295c006fd0 tx=0x7f295c006e40 comp rx=0 tx=0).stop 2024-05-03T22:03:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:20.514+0000 7f2976000700 1 -- 172.21.15.82:0/1521519135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2970105170 msgr2=0x7f29701a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:20.514+0000 7f2976000700 1 --2- 172.21.15.82:0/1521519135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2970105170 0x7f29701a0630 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2964006010 tx=0x7f2964005710 comp rx=0 tx=0).stop 2024-05-03T22:03:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:20.514+0000 7f2976000700 1 -- 172.21.15.82:0/1521519135 shutdown_connections 2024-05-03T22:03:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:20.514+0000 7f2976000700 1 --2- 172.21.15.82:0/1521519135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f295803e570 0x7f2958040a30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:20.514+0000 7f2976000700 1 --2- 172.21.15.82:0/1521519135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2970105170 0x7f29701a0630 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:20.514+0000 7f2976000700 1 -- 172.21.15.82:0/1521519135 >> 172.21.15.82:0/1521519135 conn(0x7f2970100a20 msgr2=0x7f2970106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:20.515+0000 7f2976000700 1 -- 172.21.15.82:0/1521519135 shutdown_connections 2024-05-03T22:03:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:20.515+0000 7f2976000700 1 -- 172.21.15.82:0/1521519135 wait complete. 2024-05-03T22:03:20.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:20 smithi082 ceph-mon[28404]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:03:20.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:21.566 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-03T22:03:21.976 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:03:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:22 smithi082 ceph-mon[28404]: Updating smithi116:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:03:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:22 smithi082 ceph-mon[28404]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:22 smithi082 ceph-mon[28404]: Added host smithi130 2024-05-03T22:03:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:22.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:22.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:03:23.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:23 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:23.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:23 smithi082 ceph-mon[28404]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:23.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:23 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.206+0000 7fb24ae00700 1 -- 172.21.15.82:0/2669264835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb244102f70 msgr2=0x7fb244103350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.206+0000 7fb24ae00700 1 --2- 172.21.15.82:0/2669264835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb244102f70 0x7fb244103350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb238009910 tx=0x7fb238009c20 comp rx=0 tx=0).stop 2024-05-03T22:03:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.206+0000 7fb24ae00700 1 -- 172.21.15.82:0/2669264835 shutdown_connections 2024-05-03T22:03:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.206+0000 7fb24ae00700 1 --2- 172.21.15.82:0/2669264835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb244102f70 0x7fb244103350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.206+0000 7fb24ae00700 1 -- 172.21.15.82:0/2669264835 >> 172.21.15.82:0/2669264835 conn(0x7fb2440fe840 msgr2=0x7fb244100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.206+0000 7fb24ae00700 1 -- 172.21.15.82:0/2669264835 shutdown_connections 2024-05-03T22:03:24.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.206+0000 7fb24ae00700 1 -- 172.21.15.82:0/2669264835 wait complete. 2024-05-03T22:03:24.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.207+0000 7fb24ae00700 1 Processor -- start 2024-05-03T22:03:24.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.207+0000 7fb24ae00700 1 -- start start 2024-05-03T22:03:24.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.208+0000 7fb24ae00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb244102f70 0x7fb2441a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:24.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.208+0000 7fb24ae00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb24410d0a0 con 0x7fb244102f70 2024-05-03T22:03:24.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.208+0000 7fb249a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb244102f70 0x7fb2441a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:24.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.208+0000 7fb249a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb244102f70 0x7fb2441a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42088/0 (socket says 172.21.15.82:42088) 2024-05-03T22:03:24.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.208+0000 7fb249a00700 1 -- 172.21.15.82:0/253390158 learned_addr learned my addr 172.21.15.82:0/253390158 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:03:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.209+0000 7fb249a00700 1 -- 172.21.15.82:0/253390158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2441a0b10 con 0x7fb244102f70 2024-05-03T22:03:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.209+0000 7fb249a00700 1 --2- 172.21.15.82:0/253390158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb244102f70 0x7fb2441a05d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb238005660 tx=0x7fb238005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.209+0000 7fb242000700 1 -- 172.21.15.82:0/253390158 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb238026070 con 0x7fb244102f70 2024-05-03T22:03:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.209+0000 7fb242000700 1 -- 172.21.15.82:0/253390158 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb23800b6f0 con 0x7fb244102f70 2024-05-03T22:03:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.209+0000 7fb242000700 1 -- 172.21.15.82:0/253390158 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2380037b0 con 0x7fb244102f70 2024-05-03T22:03:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.209+0000 7fb24ae00700 1 -- 172.21.15.82:0/253390158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2441a0e00 con 0x7fb244102f70 2024-05-03T22:03:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.209+0000 7fb24ae00700 1 -- 172.21.15.82:0/253390158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24419a870 con 0x7fb244102f70 2024-05-03T22:03:24.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.210+0000 7fb24ae00700 1 -- 172.21.15.82:0/253390158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb244104450 con 0x7fb244102f70 2024-05-03T22:03:24.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.211+0000 7fb242000700 1 -- 172.21.15.82:0/253390158 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fb238029070 con 0x7fb244102f70 2024-05-03T22:03:24.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.211+0000 7fb242000700 1 --2- 172.21.15.82:0/253390158 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb22c03e570 0x7fb22c040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:24.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.211+0000 7fb242000700 1 -- 172.21.15.82:0/253390158 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb23801e070 con 0x7fb244102f70 2024-05-03T22:03:24.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.212+0000 7fb249000700 1 --2- 172.21.15.82:0/253390158 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb22c03e570 0x7fb22c040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:24.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.213+0000 7fb249000700 1 --2- 172.21.15.82:0/253390158 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb22c03e570 0x7fb22c040a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb230006fd0 tx=0x7fb230006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:24.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.217+0000 7fb242000700 1 -- 172.21.15.82:0/253390158 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb238013070 con 0x7fb244102f70 2024-05-03T22:03:24.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.456+0000 7fb24ae00700 1 -- 172.21.15.82:0/253390158 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb24419bbd0 con 0x7fb22c03e570 2024-05-03T22:03:24.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.461+0000 7fb242000700 1 -- 172.21.15.82:0/253390158 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7fb24419bbd0 con 0x7fb22c03e570 2024-05-03T22:03:24.463 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:03:24.463 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.116", "hostname": "smithi116", "labels": [], "status": ""}, {"addr": "172.21.15.130", "hostname": "smithi130", "labels": [], "status": ""}] 2024-05-03T22:03:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.464+0000 7fb24ae00700 1 -- 172.21.15.82:0/253390158 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb22c03e570 msgr2=0x7fb22c040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.464+0000 7fb24ae00700 1 --2- 172.21.15.82:0/253390158 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb22c03e570 0x7fb22c040a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb230006fd0 tx=0x7fb230006e40 comp rx=0 tx=0).stop 2024-05-03T22:03:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.464+0000 7fb24ae00700 1 -- 172.21.15.82:0/253390158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb244102f70 msgr2=0x7fb2441a05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.464+0000 7fb24ae00700 1 --2- 172.21.15.82:0/253390158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb244102f70 0x7fb2441a05d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb238005660 tx=0x7fb238005740 comp rx=0 tx=0).stop 2024-05-03T22:03:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.464+0000 7fb24ae00700 1 -- 172.21.15.82:0/253390158 shutdown_connections 2024-05-03T22:03:24.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.464+0000 7fb24ae00700 1 --2- 172.21.15.82:0/253390158 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb22c03e570 0x7fb22c040a30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:24.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.464+0000 7fb24ae00700 1 --2- 172.21.15.82:0/253390158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb244102f70 0x7fb2441a05d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:24.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.464+0000 7fb24ae00700 1 -- 172.21.15.82:0/253390158 >> 172.21.15.82:0/253390158 conn(0x7fb2440fe840 msgr2=0x7fb2440756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:24.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.465+0000 7fb24ae00700 1 -- 172.21.15.82:0/253390158 shutdown_connections 2024-05-03T22:03:24.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:24.465+0000 7fb24ae00700 1 -- 172.21.15.82:0/253390158 wait complete. 2024-05-03T22:03:25.318 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-03T22:03:25.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-03T22:03:25.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:25 smithi082 ceph-mon[28404]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:25.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:25 smithi082 ceph-mon[28404]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:03:25.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:25.741 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:03:27.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:27 smithi082 ceph-mon[28404]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:27.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.893+0000 7f9347400700 1 -- 172.21.15.82:0/1305095937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9340108f40 msgr2=0x7f9340109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:27.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.893+0000 7f9347400700 1 --2- 172.21.15.82:0/1305095937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9340108f40 0x7f9340109320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9334009910 tx=0x7f9334009c20 comp rx=0 tx=0).stop 2024-05-03T22:03:27.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.893+0000 7f9347400700 1 -- 172.21.15.82:0/1305095937 shutdown_connections 2024-05-03T22:03:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.893+0000 7f9347400700 1 --2- 172.21.15.82:0/1305095937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9340108f40 0x7f9340109320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.893+0000 7f9347400700 1 -- 172.21.15.82:0/1305095937 >> 172.21.15.82:0/1305095937 conn(0x7f9340077900 msgr2=0x7f9340077d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.893+0000 7f9347400700 1 -- 172.21.15.82:0/1305095937 shutdown_connections 2024-05-03T22:03:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.893+0000 7f9347400700 1 -- 172.21.15.82:0/1305095937 wait complete. 2024-05-03T22:03:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.895+0000 7f9347400700 1 Processor -- start 2024-05-03T22:03:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.895+0000 7f9347400700 1 -- start start 2024-05-03T22:03:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.895+0000 7f9347400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9340108f40 0x7f934019e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.895+0000 7f9347400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f934010d230 con 0x7f9340108f40 2024-05-03T22:03:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.896+0000 7f9344a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9340108f40 0x7f934019e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.896+0000 7f9344a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9340108f40 0x7f934019e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42112/0 (socket says 172.21.15.82:42112) 2024-05-03T22:03:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.896+0000 7f9344a00700 1 -- 172.21.15.82:0/3089545763 learned_addr learned my addr 172.21.15.82:0/3089545763 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:03:27.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.896+0000 7f9344a00700 1 -- 172.21.15.82:0/3089545763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934019eb40 con 0x7f9340108f40 2024-05-03T22:03:27.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.896+0000 7f9344a00700 1 --2- 172.21.15.82:0/3089545763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9340108f40 0x7f934019e600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9334006010 tx=0x7f9334005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:27.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.897+0000 7f933d600700 1 -- 172.21.15.82:0/3089545763 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9334026070 con 0x7f9340108f40 2024-05-03T22:03:27.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.897+0000 7f933d600700 1 -- 172.21.15.82:0/3089545763 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f933400b6f0 con 0x7f9340108f40 2024-05-03T22:03:27.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.897+0000 7f9347400700 1 -- 172.21.15.82:0/3089545763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934019ee30 con 0x7f9340108f40 2024-05-03T22:03:27.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.897+0000 7f933d600700 1 -- 172.21.15.82:0/3089545763 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9334003810 con 0x7f9340108f40 2024-05-03T22:03:27.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.897+0000 7f9347400700 1 -- 172.21.15.82:0/3089545763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93401988a0 con 0x7f9340108f40 2024-05-03T22:03:27.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.898+0000 7f9347400700 1 -- 172.21.15.82:0/3089545763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93401045f0 con 0x7f9340108f40 2024-05-03T22:03:27.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.898+0000 7f933d600700 1 -- 172.21.15.82:0/3089545763 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f9334029070 con 0x7f9340108f40 2024-05-03T22:03:27.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.899+0000 7f933d600700 1 --2- 172.21.15.82:0/3089545763 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f932803e510 0x7f93280409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:27.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.899+0000 7f933d600700 1 -- 172.21.15.82:0/3089545763 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f933401e070 con 0x7f9340108f40 2024-05-03T22:03:27.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.899+0000 7f933fe00700 1 --2- 172.21.15.82:0/3089545763 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f932803e510 0x7f93280409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.900+0000 7f933fe00700 1 --2- 172.21.15.82:0/3089545763 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f932803e510 0x7f93280409d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f932c006fd0 tx=0x7f932c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:27.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:27.904+0000 7f933d600700 1 -- 172.21.15.82:0/3089545763 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9334013070 con 0x7f9340108f40 2024-05-03T22:03:28.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.144+0000 7f9347400700 1 -- 172.21.15.82:0/3089545763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f93400008d0 con 0x7f9340108f40 2024-05-03T22:03:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.505+0000 7f933d600700 1 -- 172.21.15.82:0/3089545763 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f933400b8a0 con 0x7f9340108f40 2024-05-03T22:03:28.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.509+0000 7f9347400700 1 -- 172.21.15.82:0/3089545763 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f932803e510 msgr2=0x7f93280409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:28.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.509+0000 7f9347400700 1 --2- 172.21.15.82:0/3089545763 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f932803e510 0x7f93280409d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f932c006fd0 tx=0x7f932c006e40 comp rx=0 tx=0).stop 2024-05-03T22:03:28.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.509+0000 7f9347400700 1 -- 172.21.15.82:0/3089545763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9340108f40 msgr2=0x7f934019e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:28.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.509+0000 7f9347400700 1 --2- 172.21.15.82:0/3089545763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9340108f40 0x7f934019e600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9334006010 tx=0x7f9334005710 comp rx=0 tx=0).stop 2024-05-03T22:03:28.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.509+0000 7f9347400700 1 -- 172.21.15.82:0/3089545763 shutdown_connections 2024-05-03T22:03:28.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.509+0000 7f9347400700 1 --2- 172.21.15.82:0/3089545763 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f932803e510 0x7f93280409d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:28.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.509+0000 7f9347400700 1 --2- 172.21.15.82:0/3089545763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9340108f40 0x7f934019e600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:28.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.509+0000 7f9347400700 1 -- 172.21.15.82:0/3089545763 >> 172.21.15.82:0/3089545763 conn(0x7f9340077900 msgr2=0x7f93400ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:28.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.510+0000 7f9347400700 1 -- 172.21.15.82:0/3089545763 shutdown_connections 2024-05-03T22:03:28.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:03:28.510+0000 7f9347400700 1 -- 172.21.15.82:0/3089545763 wait complete. 2024-05-03T22:03:28.513 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2024-05-03T22:03:28.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:28 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3089545763' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-03T22:03:29.376 INFO:tasks.cephadm:Adding mon.a on smithi082 2024-05-03T22:03:29.376 INFO:tasks.cephadm:Adding mon.b on smithi116 2024-05-03T22:03:29.376 INFO:tasks.cephadm:Adding mon.c on smithi130 2024-05-03T22:03:29.376 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi082:172.21.15.82=a;smithi116:172.21.15.116=b;smithi130:172.21.15.130=c' 2024-05-03T22:03:29.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:29 smithi082 ceph-mon[28404]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:29.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:29 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3089545763' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-03T22:03:29.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:29 smithi082 ceph-mon[28404]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:03:30.321 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-03T22:03:30.424 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-03T22:03:31.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:31.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:31.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:03:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:03:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:31 smithi082 ceph-mon[28404]: Updating smithi130:/etc/ceph/ceph.conf 2024-05-03T22:03:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:31 smithi082 ceph-mon[28404]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:31 smithi082 ceph-mon[28404]: Updating smithi130:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:03:32.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.398+0000 7f59a4e00700 1 -- 172.21.15.130:0/1297591228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a00774d0 msgr2=0x7f59a0075930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:32.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.398+0000 7f59a4e00700 1 --2- 172.21.15.130:0/1297591228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a00774d0 0x7f59a0075930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5990009910 tx=0x7f5990009c20 comp rx=0 tx=0).stop 2024-05-03T22:03:32.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.398+0000 7f59a4e00700 1 -- 172.21.15.130:0/1297591228 shutdown_connections 2024-05-03T22:03:32.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.398+0000 7f59a4e00700 1 --2- 172.21.15.130:0/1297591228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a00774d0 0x7f59a0075930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:32.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.398+0000 7f59a4e00700 1 -- 172.21.15.130:0/1297591228 >> 172.21.15.130:0/1297591228 conn(0x7f59a00fe4a0 msgr2=0x7f59a01008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:32.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.399+0000 7f59a4e00700 1 -- 172.21.15.130:0/1297591228 shutdown_connections 2024-05-03T22:03:32.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.399+0000 7f59a4e00700 1 -- 172.21.15.130:0/1297591228 wait complete. 2024-05-03T22:03:32.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.400+0000 7f59a4e00700 1 Processor -- start 2024-05-03T22:03:32.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.400+0000 7f59a4e00700 1 -- start start 2024-05-03T22:03:32.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.400+0000 7f59a4e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a00774d0 0x7f59a019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:32.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.400+0000 7f59a4e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f59a010aef0 con 0x7f59a00774d0 2024-05-03T22:03:32.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.401+0000 7f599de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a00774d0 0x7f59a019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:32.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.401+0000 7f599de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a00774d0 0x7f59a019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.130:38052/0 (socket says 172.21.15.130:38052) 2024-05-03T22:03:32.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.401+0000 7f599de00700 1 -- 172.21.15.130:0/236096343 learned_addr learned my addr 172.21.15.130:0/236096343 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-05-03T22:03:32.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.401+0000 7f599de00700 1 -- 172.21.15.130:0/236096343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a019ac50 con 0x7f59a00774d0 2024-05-03T22:03:32.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.402+0000 7f599de00700 1 --2- 172.21.15.130:0/236096343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a00774d0 0x7f59a019a710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5990005120 tx=0x7f5990005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:32.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.402+0000 7f5996a00700 1 -- 172.21.15.130:0/236096343 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5990027070 con 0x7f59a00774d0 2024-05-03T22:03:32.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.402+0000 7f59a4e00700 1 -- 172.21.15.130:0/236096343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a019aee0 con 0x7f59a00774d0 2024-05-03T22:03:32.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.402+0000 7f59a4e00700 1 -- 172.21.15.130:0/236096343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a019dbd0 con 0x7f59a00774d0 2024-05-03T22:03:32.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.402+0000 7f5996a00700 1 -- 172.21.15.130:0/236096343 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f599000bdf0 con 0x7f59a00774d0 2024-05-03T22:03:32.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.402+0000 7f5996a00700 1 -- 172.21.15.130:0/236096343 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f599000fd00 con 0x7f59a00774d0 2024-05-03T22:03:32.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.403+0000 7f59a4e00700 1 -- 172.21.15.130:0/236096343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a010b670 con 0x7f59a00774d0 2024-05-03T22:03:32.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.404+0000 7f5996a00700 1 -- 172.21.15.130:0/236096343 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f599002a070 con 0x7f59a00774d0 2024-05-03T22:03:32.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.404+0000 7f5996a00700 1 --2- 172.21.15.130:0/236096343 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f598403e510 0x7f59840409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:32.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.404+0000 7f5996a00700 1 -- 172.21.15.130:0/236096343 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5990053850 con 0x7f59a00774d0 2024-05-03T22:03:32.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.405+0000 7f599d400700 1 --2- 172.21.15.130:0/236096343 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f598403e510 0x7f59840409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:32.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.406+0000 7f599d400700 1 --2- 172.21.15.130:0/236096343 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f598403e510 0x7f59840409d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f598c006fd0 tx=0x7f598c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:32.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.420+0000 7f5996a00700 1 -- 172.21.15.130:0/236096343 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5990013070 con 0x7f59a00774d0 2024-05-03T22:03:32.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.668+0000 7f59a4e00700 1 -- 172.21.15.130:0/236096343 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi116:172.21.15.116=b;smithi130:172.21.15.130=c", "target": ["mon-mgr", ""]}) -- 0x7f59a002e640 con 0x7f598403e510 2024-05-03T22:03:32.685 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.684+0000 7f5996a00700 1 -- 172.21.15.130:0/236096343 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f59a002e640 con 0x7f598403e510 2024-05-03T22:03:32.685 INFO:teuthology.orchestra.run.smithi130.stdout:Scheduled mon update... 2024-05-03T22:03:32.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.687+0000 7f59a4e00700 1 -- 172.21.15.130:0/236096343 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f598403e510 msgr2=0x7f59840409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:32.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.687+0000 7f59a4e00700 1 --2- 172.21.15.130:0/236096343 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f598403e510 0x7f59840409d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f598c006fd0 tx=0x7f598c006e40 comp rx=0 tx=0).stop 2024-05-03T22:03:32.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.687+0000 7f59a4e00700 1 -- 172.21.15.130:0/236096343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a00774d0 msgr2=0x7f59a019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:32.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.687+0000 7f59a4e00700 1 --2- 172.21.15.130:0/236096343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a00774d0 0x7f59a019a710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5990005120 tx=0x7f5990005810 comp rx=0 tx=0).stop 2024-05-03T22:03:32.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.687+0000 7f59a4e00700 1 -- 172.21.15.130:0/236096343 shutdown_connections 2024-05-03T22:03:32.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.687+0000 7f59a4e00700 1 --2- 172.21.15.130:0/236096343 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f598403e510 0x7f59840409d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:32.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.687+0000 7f59a4e00700 1 --2- 172.21.15.130:0/236096343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59a00774d0 0x7f59a019a710 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:32.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.687+0000 7f59a4e00700 1 -- 172.21.15.130:0/236096343 >> 172.21.15.130:0/236096343 conn(0x7f59a00fe4a0 msgr2=0x7f59a00ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:32.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.687+0000 7f59a4e00700 1 -- 172.21.15.130:0/236096343 shutdown_connections 2024-05-03T22:03:32.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:32.687+0000 7f59a4e00700 1 -- 172.21.15.130:0/236096343 wait complete. 2024-05-03T22:03:32.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:32 smithi082 ceph-mon[28404]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:03:33.343 DEBUG:teuthology.orchestra.run.smithi116:mon.b> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.b.service 2024-05-03T22:03:33.351 DEBUG:teuthology.orchestra.run.smithi130:mon.c> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.c.service 2024-05-03T22:03:33.356 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-03T22:03:33.357 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-03T22:03:33.794 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:03:33.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:33 smithi082 ceph-mon[28404]: Updating smithi130:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:03:33.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:33 smithi082 ceph-mon[28404]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:33.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:33 smithi082 ceph-mon[28404]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi116:172.21.15.116=b;smithi130:172.21.15.130=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:03:33.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:33 smithi082 ceph-mon[28404]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi116:172.21.15.116=b;smithi130:172.21.15.130=c;count:3 2024-05-03T22:03:33.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:33.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:33.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:33.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:33.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:03:33.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:33.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:33 smithi082 ceph-mon[28404]: Deploying daemon mon.c on smithi130 2024-05-03T22:03:35.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:35 smithi082 ceph-mon[28404]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:36.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.741+0000 7f8eaa800700 1 -- 172.21.15.130:0/2410406616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ea4101340 msgr2=0x7f8ea4101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:36.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.741+0000 7f8eaa800700 1 --2- 172.21.15.130:0/2410406616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ea4101340 0x7f8ea4101720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009910 tx=0x7f8e94009c20 comp rx=0 tx=0).stop 2024-05-03T22:03:36.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.741+0000 7f8eaa800700 1 -- 172.21.15.130:0/2410406616 shutdown_connections 2024-05-03T22:03:36.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.741+0000 7f8eaa800700 1 --2- 172.21.15.130:0/2410406616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ea4101340 0x7f8ea4101720 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:36.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.741+0000 7f8eaa800700 1 -- 172.21.15.130:0/2410406616 >> 172.21.15.130:0/2410406616 conn(0x7f8ea40fcc10 msgr2=0x7f8ea40ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:36.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.741+0000 7f8eaa800700 1 -- 172.21.15.130:0/2410406616 shutdown_connections 2024-05-03T22:03:36.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.741+0000 7f8eaa800700 1 -- 172.21.15.130:0/2410406616 wait complete. 2024-05-03T22:03:36.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.742+0000 7f8eaa800700 1 Processor -- start 2024-05-03T22:03:36.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.743+0000 7f8eaa800700 1 -- start start 2024-05-03T22:03:36.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.743+0000 7f8eaa800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ea4101340 0x7f8ea41a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:36.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.743+0000 7f8eaa800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea410c0d0 con 0x7f8ea4101340 2024-05-03T22:03:36.745 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.744+0000 7f8ea3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ea4101340 0x7f8ea41a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:36.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.744+0000 7f8ea3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ea4101340 0x7f8ea41a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.130:38074/0 (socket says 172.21.15.130:38074) 2024-05-03T22:03:36.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.744+0000 7f8ea3400700 1 -- 172.21.15.130:0/2989428650 learned_addr learned my addr 172.21.15.130:0/2989428650 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-05-03T22:03:36.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.745+0000 7f8ea3400700 1 -- 172.21.15.130:0/2989428650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea41a0ba0 con 0x7f8ea4101340 2024-05-03T22:03:36.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.745+0000 7f8ea3400700 1 --2- 172.21.15.130:0/2989428650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ea4101340 0x7f8ea41a0660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8e94006010 tx=0x7f8e94005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:36.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.746+0000 7f8ea0c00700 1 -- 172.21.15.130:0/2989428650 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e94026070 con 0x7f8ea4101340 2024-05-03T22:03:36.748 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.746+0000 7f8eaa800700 1 -- 172.21.15.130:0/2989428650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea41a0e90 con 0x7f8ea4101340 2024-05-03T22:03:36.748 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.746+0000 7f8ea0c00700 1 -- 172.21.15.130:0/2989428650 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e9400b750 con 0x7f8ea4101340 2024-05-03T22:03:36.748 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.746+0000 7f8ea0c00700 1 -- 172.21.15.130:0/2989428650 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e94003810 con 0x7f8ea4101340 2024-05-03T22:03:36.748 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.746+0000 7f8eaa800700 1 -- 172.21.15.130:0/2989428650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea419a7e0 con 0x7f8ea4101340 2024-05-03T22:03:36.749 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.747+0000 7f8eaa800700 1 -- 172.21.15.130:0/2989428650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea4102820 con 0x7f8ea4101340 2024-05-03T22:03:36.749 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.748+0000 7f8ea0c00700 1 -- 172.21.15.130:0/2989428650 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f8e94029070 con 0x7f8ea4101340 2024-05-03T22:03:36.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.748+0000 7f8ea0c00700 1 --2- 172.21.15.130:0/2989428650 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8e8803e570 0x7f8e88040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:36.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.748+0000 7f8ea0c00700 1 -- 172.21.15.130:0/2989428650 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8e9401e070 con 0x7f8ea4101340 2024-05-03T22:03:36.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.749+0000 7f8e9be00700 1 --2- 172.21.15.130:0/2989428650 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8e8803e570 0x7f8e88040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:36.752 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.750+0000 7f8e9be00700 1 --2- 172.21.15.130:0/2989428650 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8e8803e570 0x7f8e88040a30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c006fd0 tx=0x7f8e8c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:36.765 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:36.764+0000 7f8ea0c00700 1 -- 172.21.15.130:0/2989428650 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8e94013070 con 0x7f8ea4101340 2024-05-03T22:03:37.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.086+0000 7f8eaa800700 1 -- 172.21.15.130:0/2989428650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8ea419bd10 con 0x7f8ea4101340 2024-05-03T22:03:37.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.088+0000 7f8ea0c00700 1 -- 172.21.15.130:0/2989428650 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f8e94030020 con 0x7f8ea4101340 2024-05-03T22:03:37.090 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T22:03:37.090 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":1,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","modified":"2024-05-03T22:01:21.829502Z","created":"2024-05-03T22:01:21.829502Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-03T22:03:37.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.090+0000 7f8eaa800700 1 -- 172.21.15.130:0/2989428650 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8e8803e570 msgr2=0x7f8e88040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:37.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.090+0000 7f8eaa800700 1 --2- 172.21.15.130:0/2989428650 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8e8803e570 0x7f8e88040a30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c006fd0 tx=0x7f8e8c006e40 comp rx=0 tx=0).stop 2024-05-03T22:03:37.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.090+0000 7f8eaa800700 1 -- 172.21.15.130:0/2989428650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ea4101340 msgr2=0x7f8ea41a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:37.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.090+0000 7f8eaa800700 1 --2- 172.21.15.130:0/2989428650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ea4101340 0x7f8ea41a0660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8e94006010 tx=0x7f8e94005710 comp rx=0 tx=0).stop 2024-05-03T22:03:37.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.091+0000 7f8eaa800700 1 -- 172.21.15.130:0/2989428650 shutdown_connections 2024-05-03T22:03:37.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.091+0000 7f8eaa800700 1 --2- 172.21.15.130:0/2989428650 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8e8803e570 0x7f8e88040a30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:37.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.091+0000 7f8eaa800700 1 --2- 172.21.15.130:0/2989428650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ea4101340 0x7f8ea41a0660 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:37.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.091+0000 7f8eaa800700 1 -- 172.21.15.130:0/2989428650 >> 172.21.15.130:0/2989428650 conn(0x7f8ea40fcc10 msgr2=0x7f8ea4107fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:37.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.091+0000 7f8eaa800700 1 -- 172.21.15.130:0/2989428650 shutdown_connections 2024-05-03T22:03:37.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:37.091+0000 7f8eaa800700 1 -- 172.21.15.130:0/2989428650 wait complete. 2024-05-03T22:03:37.094 INFO:teuthology.orchestra.run.smithi130.stderr:dumped monmap epoch 1 2024-05-03T22:03:37.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:37 smithi082 ceph-mon[28404]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:37.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:37 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/2989428650' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:39.155 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-03T22:03:39.155 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-03T22:03:39.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 podman[32371]: 2024-05-03 22:03:39.418126225 +0000 UTC m=+0.047305573 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:03:39.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:39 smithi082 ceph-mon[28404]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:39.996 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:03:40.142 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 podman[32371]: 2024-05-03 22:03:39.82494735 +0000 UTC m=+0.454126767 container init 66ca09a37d548889181a4c8390eb59a507d0954542aa2209452f7f4db2bbbd9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD) 2024-05-03T22:03:40.142 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 podman[32371]: 2024-05-03 22:03:39.836472414 +0000 UTC m=+0.465651794 container start 66ca09a37d548889181a4c8390eb59a507d0954542aa2209452f7f4db2bbbd9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430) 2024-05-03T22:03:40.142 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: set uid:gid to 167:167 (ceph:ceph) 2024-05-03T22:03:40.142 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev), process ceph-mon, pid 2 2024-05-03T22:03:40.142 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pidfile_write: ignore empty --pid-file 2024-05-03T22:03:40.142 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: load: jerasure load: lrc 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: RocksDB version: 7.9.2 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Git sha 0 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Compile date 2024-05-01 21:12:03 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: DB SUMMARY 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: DB Session ID: 6C9CEUJ18ICFN8XR5QBI 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: CURRENT file: CURRENT 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: IDENTITY file: IDENTITY 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.error_if_exists: 0 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.create_if_missing: 0 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.paranoid_checks: 1 2024-05-03T22:03:40.143 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-03T22:03:40.144 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-03T22:03:40.144 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-03T22:03:40.144 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.env: 0x55b808c27cc0 2024-05-03T22:03:40.144 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.fs: PosixFileSystem 2024-05-03T22:03:40.144 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.info_log: 0x55b830fd9de0 2024-05-03T22:03:40.144 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_file_opening_threads: 16 2024-05-03T22:03:40.144 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.statistics: (nil) 2024-05-03T22:03:40.144 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.use_fsync: 0 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_log_file_size: 0 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.keep_log_file_num: 1000 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.recycle_log_file_num: 0 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.allow_fallocate: 1 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.allow_mmap_reads: 0 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.allow_mmap_writes: 0 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.use_direct_reads: 0 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.create_missing_column_families: 0 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.db_log_dir: 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.wal_dir: 2024-05-03T22:03:40.145 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.advise_random_on_open: 1 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.db_write_buffer_size: 0 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.write_buffer_manager: 0x55b830fab0e0 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.rate_limiter: (nil) 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-03T22:03:40.146 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.wal_recovery_mode: 2 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.enable_thread_tracking: 0 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.enable_pipelined_write: 0 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.unordered_write: 0 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.row_cache: None 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.wal_filter: None 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.allow_ingest_behind: 0 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.two_write_queues: 0 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.manual_wal_flush: 0 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.wal_compression: 0 2024-05-03T22:03:40.147 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.atomic_flush: 0 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.log_readahead_size: 0 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.best_efforts_recovery: 0 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.allow_data_in_errors: 0 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.db_host_id: __hostname__ 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_background_jobs: 2 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_background_compactions: -1 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_subcompactions: 1 2024-05-03T22:03:40.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_total_wal_size: 0 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_open_files: -1 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bytes_per_sync: 0 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_readahead_size: 0 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_background_flushes: -1 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Compression algorithms supported: 2024-05-03T22:03:40.149 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-03T22:03:40.150 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: kZSTD supported: 0 2024-05-03T22:03:40.150 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: kXpressCompression supported: 0 2024-05-03T22:03:40.150 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: kLZ4HCCompression supported: 1 2024-05-03T22:03:40.150 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: kZlibCompression supported: 1 2024-05-03T22:03:40.150 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: kSnappyCompression supported: 1 2024-05-03T22:03:40.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: kLZ4Compression supported: 1 2024-05-03T22:03:40.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: kBZip2Compression supported: 0 2024-05-03T22:03:40.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-03T22:03:40.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-03T22:03:40.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-03T22:03:40.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-03T22:03:40.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.merge_operator: 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_filter: None 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_filter_factory: None 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.sst_partitioner_factory: None 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b830fd9fa0) 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout: cache_index_and_filter_blocks: 1 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout: pin_top_level_index_and_filter: 1 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout: index_type: 0 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout: data_block_index_type: 0 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout: index_shortening: 1 2024-05-03T22:03:40.152 INFO:journalctl@ceph.mon.c.smithi130.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: checksum: 4 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: no_block_cache: 0 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: block_cache: 0x55b830fdd1f0 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: block_cache_name: BinnedLRUCache 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: block_cache_options: 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: capacity : 536870912 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: num_shard_bits : 4 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: strict_capacity_limit : 0 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: high_pri_pool_ratio: 0.000 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: block_cache_compressed: (nil) 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: persistent_cache: (nil) 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: block_size: 4096 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: block_size_deviation: 10 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: block_restart_interval: 16 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: index_block_restart_interval: 1 2024-05-03T22:03:40.153 INFO:journalctl@ceph.mon.c.smithi130.stdout: metadata_block_size: 4096 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: partition_filters: 0 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: use_delta_encoding: 1 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: filter_policy: bloomfilter 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: whole_key_filtering: 1 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: verify_compression: 0 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: read_amp_bytes_per_bit: 0 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: format_version: 5 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: enable_index_compression: 1 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: block_align: 0 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: max_auto_readahead_size: 262144 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: prepopulate_block_cache: 0 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: initial_auto_readahead_size: 8192 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout: num_file_reads_for_auto_readahead: 2 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.write_buffer_size: 33554432 2024-05-03T22:03:40.154 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_write_buffer_number: 2 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compression: NoCompression 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bottommost_compression: Disabled 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.prefix_extractor: nullptr 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.num_levels: 7 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:03:40.155 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compression_opts.level: 32767 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compression_opts.strategy: 0 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compression_opts.enabled: false 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.target_file_size_base: 67108864 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-03T22:03:40.156 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.arena_block_size: 1048576 2024-05-03T22:03:40.157 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.disable_auto_compactions: 0 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-03T22:03:40.158 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.inplace_update_support: 0 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.bloom_locality: 0 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.max_successive_merges: 0 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.paranoid_file_checks: 0 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.force_consistency_checks: 1 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.report_bg_io_stats: 0 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.ttl: 2592000 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-03T22:03:40.159 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.enable_blob_files: false 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.min_blob_size: 0 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.blob_file_size: 268435456 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.blob_file_starting_level: 0 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 58b72c79-c96f-42e2-b6ff-e8dd8908e897 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714773819895227, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-03T22:03:40.160 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714773819896097, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714773819, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "58b72c79-c96f-42e2-b6ff-e8dd8908e897", "db_session_id": "6C9CEUJ18ICFN8XR5QBI", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714773819896382, "job": 1, "event": "recovery_finished"} 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b8310fa000 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: DB pointer 0x55b8310e6000 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout: ** DB Stats ** 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:03:40.161 INFO:journalctl@ceph.mon.c.smithi130.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: ** Compaction Stats [default] ** 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: ** Compaction Stats [default] ** 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:03:40.162 INFO:journalctl@ceph.mon.c.smithi130.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: Cumulative compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: Interval compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: Block cache BinnedLRUCache@0x55b830fdd1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-03T22:03:40.163 INFO:journalctl@ceph.mon.c.smithi130.stdout: 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: using public_addr v2:172.21.15.130:0/0 -> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: starting mon.c rank -1 at public addrs [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] at bind addrs [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(???) e0 preinit fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 bash[32371]: 66ca09a37d548889181a4c8390eb59a507d0954542aa2209452f7f4db2bbbd9d 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 systemd[1]: Started Ceph mon.c for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).mds e1 new map 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout: e1 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout: legacy client fscid: -1 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout: 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout: No filesystems configured 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-03T22:03:40.164 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Added host smithi116 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.165 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi130", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:40.166 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Updating smithi116:/etc/ceph/ceph.conf 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Deploying cephadm binary to smithi130 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Updating smithi116:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Updating smithi116:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Added host smithi130 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:03:40.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.168 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.168 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.168 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.168 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:03:40.168 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.168 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.168 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3089545763' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-03T22:03:40.168 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.168 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3089545763' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Updating smithi130:/etc/ceph/ceph.conf 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Updating smithi130:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Updating smithi130:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi116:172.21.15.116=b;smithi130:172.21.15.130=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:03:40.169 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi116:172.21.15.116=b;smithi130:172.21.15.130=c;count:3 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: Deploying daemon mon.c on smithi130 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/2989428650' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:40.170 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:39 smithi130 ceph-mon[32417]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-03T22:03:45.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.051+0000 7fce47800700 1 -- 172.21.15.130:0/1867845495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce40105420 msgr2=0x7fce28005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.051+0000 7fce47800700 1 --2- 172.21.15.130:0/1867845495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce40105420 0x7fce28005610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce34005fa0 tx=0x7fce3400ffc0 comp rx=0 tx=0).stop 2024-05-03T22:03:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.052+0000 7fce47800700 1 -- 172.21.15.130:0/1867845495 shutdown_connections 2024-05-03T22:03:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.052+0000 7fce47800700 1 --2- 172.21.15.130:0/1867845495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce40105420 0x7fce28005610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.052+0000 7fce47800700 1 -- 172.21.15.130:0/1867845495 >> 172.21.15.130:0/1867845495 conn(0x7fce40100cd0 msgr2=0x7fce401030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.052+0000 7fce47800700 1 -- 172.21.15.130:0/1867845495 shutdown_connections 2024-05-03T22:03:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.052+0000 7fce47800700 1 -- 172.21.15.130:0/1867845495 wait complete. 2024-05-03T22:03:45.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.054+0000 7fce47800700 1 Processor -- start 2024-05-03T22:03:45.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.054+0000 7fce47800700 1 -- start start 2024-05-03T22:03:45.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.054+0000 7fce47800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce40105420 0x7fce401a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:45.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.054+0000 7fce47800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce401a0cd0 0x7fce4019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:45.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.055+0000 7fce47800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fce4010cfc0 con 0x7fce401a0cd0 2024-05-03T22:03:45.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.055+0000 7fce47800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce4010ce40 con 0x7fce40105420 2024-05-03T22:03:45.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.055+0000 7fce3fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce401a0cd0 0x7fce4019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:45.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.055+0000 7fce3fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce401a0cd0 0x7fce4019a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.130:33038/0 (socket says 172.21.15.130:33038) 2024-05-03T22:03:45.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.056+0000 7fce3fe00700 1 -- 172.21.15.130:0/4201000643 learned_addr learned my addr 172.21.15.130:0/4201000643 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-05-03T22:03:45.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.056+0000 7fce44e00700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce40105420 0x7fce401a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:45.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.056+0000 7fce44e00700 1 -- 172.21.15.130:0/4201000643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce40105420 msgr2=0x7fce401a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-03T22:03:45.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.056+0000 7fce44e00700 1 -- 172.21.15.130:0/4201000643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce40105420 msgr2=0x7fce401a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-03T22:03:45.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.056+0000 7fce44e00700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce40105420 0x7fce401a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-03T22:03:45.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.056+0000 7fce44e00700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce40105420 0x7fce401a0790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:03:45.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.056+0000 7fce3fe00700 1 -- 172.21.15.130:0/4201000643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce40105420 msgr2=0x7fce401a0790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:03:45.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.056+0000 7fce3fe00700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce40105420 0x7fce401a0790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:45.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.056+0000 7fce3fe00700 1 -- 172.21.15.130:0/4201000643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce401a1310 con 0x7fce401a0cd0 2024-05-03T22:03:45.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.057+0000 7fce3fe00700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce401a0cd0 0x7fce4019a950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00b700 tx=0x7fce2c00bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:45.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.057+0000 7fce3d600700 1 -- 172.21.15.130:0/4201000643 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fce2c011630 con 0x7fce401a0cd0 2024-05-03T22:03:45.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.057+0000 7fce47800700 1 -- 172.21.15.130:0/4201000643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4019ae90 con 0x7fce401a0cd0 2024-05-03T22:03:45.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.057+0000 7fce3d600700 1 -- 172.21.15.130:0/4201000643 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce2c011c60 con 0x7fce401a0cd0 2024-05-03T22:03:45.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.057+0000 7fce3d600700 1 -- 172.21.15.130:0/4201000643 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fce2c010c90 con 0x7fce401a0cd0 2024-05-03T22:03:45.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.057+0000 7fce47800700 1 -- 172.21.15.130:0/4201000643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4019b420 con 0x7fce401a0cd0 2024-05-03T22:03:45.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.059+0000 7fce3d600700 1 -- 172.21.15.130:0/4201000643 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fce2c018020 con 0x7fce401a0cd0 2024-05-03T22:03:45.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.059+0000 7fce47800700 1 -- 172.21.15.130:0/4201000643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce40106900 con 0x7fce401a0cd0 2024-05-03T22:03:45.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.060+0000 7fce3d600700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce2003e2d0 0x7fce20040790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:45.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.061+0000 7fce3d600700 1 -- 172.21.15.130:0/4201000643 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fce2c0522e0 con 0x7fce401a0cd0 2024-05-03T22:03:45.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.061+0000 7fce44e00700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce2003e2d0 0x7fce20040790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:45.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.063+0000 7fce44e00700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce2003e2d0 0x7fce20040790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce340059d0 tx=0x7fce34005920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:45.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.078+0000 7fce3d600700 1 -- 172.21.15.130:0/4201000643 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fce2c01f020 con 0x7fce401a0cd0 2024-05-03T22:03:45.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.413+0000 7fce47800700 1 -- 172.21.15.130:0/4201000643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fce4019be80 con 0x7fce401a0cd0 2024-05-03T22:03:45.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.414+0000 7fce3d600700 1 -- 172.21.15.130:0/4201000643 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fce2c0187b0 con 0x7fce401a0cd0 2024-05-03T22:03:45.416 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:03:45.416 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: mon.a calling monitor election 2024-05-03T22:03:45.416 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.416 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:45.416 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: mon.c calling monitor election 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: monmap epoch 2 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: last_changed 2024-05-03T22:03:39.955681+0000 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: created 2024-05-03T22:01:21.829502+0000 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: min_mon_release 19 (squid) 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: election_strategy: 1 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-03T22:03:45.417 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: 1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.c 2024-05-03T22:03:45.418 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: fsmap 2024-05-03T22:03:45.418 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:03:45.418 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: mgrmap e13: x(active, since 68s) 2024-05-03T22:03:45.418 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: overall HEALTH_OK 2024-05-03T22:03:45.418 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:45.418 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:45.418 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T22:03:45.418 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":2,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","modified":"2024-05-03T22:03:39.955681Z","created":"2024-05-03T22:01:21.829502Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3300","nonce":0},{"type":"v1","addr":"172.21.15.130:6789","nonce":0}]},"addr":"172.21.15.130:6789/0","public_addr":"172.21.15.130:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-03T22:03:45.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.418+0000 7fce47800700 1 -- 172.21.15.130:0/4201000643 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce2003e2d0 msgr2=0x7fce20040790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:45.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.418+0000 7fce47800700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce2003e2d0 0x7fce20040790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce340059d0 tx=0x7fce34005920 comp rx=0 tx=0).stop 2024-05-03T22:03:45.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.418+0000 7fce47800700 1 -- 172.21.15.130:0/4201000643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce401a0cd0 msgr2=0x7fce4019a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:45.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.418+0000 7fce47800700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce401a0cd0 0x7fce4019a950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00b700 tx=0x7fce2c00bac0 comp rx=0 tx=0).stop 2024-05-03T22:03:45.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.418+0000 7fce47800700 1 -- 172.21.15.130:0/4201000643 shutdown_connections 2024-05-03T22:03:45.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.418+0000 7fce47800700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce2003e2d0 0x7fce20040790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:45.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.418+0000 7fce47800700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce40105420 0x7fce401a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:45.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.418+0000 7fce47800700 1 --2- 172.21.15.130:0/4201000643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce401a0cd0 0x7fce4019a950 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:45.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.418+0000 7fce47800700 1 -- 172.21.15.130:0/4201000643 >> 172.21.15.130:0/4201000643 conn(0x7fce40100cd0 msgr2=0x7fce40102050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:45.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.419+0000 7fce47800700 1 -- 172.21.15.130:0/4201000643 shutdown_connections 2024-05-03T22:03:45.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:45.419+0000 7fce47800700 1 -- 172.21.15.130:0/4201000643 wait complete. 2024-05-03T22:03:45.422 INFO:teuthology.orchestra.run.smithi130.stderr:dumped monmap epoch 2 2024-05-03T22:03:45.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:03:45.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: mon.a calling monitor election 2024-05-03T22:03:45.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:45.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: mon.c calling monitor election 2024-05-03T22:03:45.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:45.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: monmap epoch 2 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: last_changed 2024-05-03T22:03:39.955681+0000 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: created 2024-05-03T22:01:21.829502+0000 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: min_mon_release 19 (squid) 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: election_strategy: 1 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: 1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.c 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: fsmap 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: mgrmap e13: x(active, since 68s) 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: overall HEALTH_OK 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:45.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:46 smithi082 ceph-mon[28404]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:03:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:46 smithi082 ceph-mon[28404]: Deploying daemon mon.b on smithi116 2024-05-03T22:03:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:46 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/4201000643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:46.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:46 smithi130 ceph-mon[32417]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:03:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:46 smithi130 ceph-mon[32417]: Deploying daemon mon.b on smithi116 2024-05-03T22:03:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:46 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/4201000643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:47.127 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-03T22:03:47.127 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-03T22:03:47.566 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:03:48.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:48 smithi130 ceph-mon[32417]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:48 smithi082 ceph-mon[28404]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:49.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.525+0000 7fc381000700 1 -- 172.21.15.130:0/2335243243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c10f690 msgr2=0x7fc37c10fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:49.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.525+0000 7fc381000700 1 --2- 172.21.15.130:0/2335243243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c10f690 0x7fc37c10fa70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009910 tx=0x7fc36c009c20 comp rx=0 tx=0).stop 2024-05-03T22:03:49.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.526+0000 7fc381000700 1 -- 172.21.15.130:0/2335243243 shutdown_connections 2024-05-03T22:03:49.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.526+0000 7fc381000700 1 --2- 172.21.15.130:0/2335243243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c10f690 0x7fc37c10fa70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:49.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.526+0000 7fc381000700 1 -- 172.21.15.130:0/2335243243 >> 172.21.15.130:0/2335243243 conn(0x7fc37c078e20 msgr2=0x7fc37c07b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:49.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.526+0000 7fc381000700 1 -- 172.21.15.130:0/2335243243 shutdown_connections 2024-05-03T22:03:49.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.526+0000 7fc381000700 1 -- 172.21.15.130:0/2335243243 wait complete. 2024-05-03T22:03:49.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.527+0000 7fc381000700 1 Processor -- start 2024-05-03T22:03:49.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.527+0000 7fc381000700 1 -- start start 2024-05-03T22:03:49.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.528+0000 7fc381000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c10f690 0x7fc37c19f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:49.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.528+0000 7fc381000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc37c19f690 0x7fc37c1a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:49.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.528+0000 7fc381000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c113980 con 0x7fc37c10f690 2024-05-03T22:03:49.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.528+0000 7fc381000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c113800 con 0x7fc37c19f690 2024-05-03T22:03:49.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.528+0000 7fc373e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc37c19f690 0x7fc37c1a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:49.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.528+0000 7fc379e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c10f690 0x7fc37c19f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:49.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.528+0000 7fc373e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc37c19f690 0x7fc37c1a3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:35126/0 (socket says 172.21.15.130:35126) 2024-05-03T22:03:49.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.528+0000 7fc373e00700 1 -- 172.21.15.130:0/1544321481 learned_addr learned my addr 172.21.15.130:0/1544321481 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-05-03T22:03:49.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.528+0000 7fc373e00700 1 -- 172.21.15.130:0/1544321481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc37c19f690 msgr2=0x7fc37c1a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-03T22:03:49.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.528+0000 7fc373e00700 1 -- 172.21.15.130:0/1544321481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc37c19f690 msgr2=0x7fc37c1a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-03T22:03:49.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.528+0000 7fc373e00700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc37c19f690 0x7fc37c1a3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-03T22:03:49.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.529+0000 7fc373e00700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc37c19f690 0x7fc37c1a3a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:03:49.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.529+0000 7fc379e00700 1 -- 172.21.15.130:0/1544321481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc37c19f690 msgr2=0x7fc37c1a3a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:03:49.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.529+0000 7fc379e00700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc37c19f690 0x7fc37c1a3a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:49.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.529+0000 7fc379e00700 1 -- 172.21.15.130:0/1544321481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c19fcd0 con 0x7fc37c10f690 2024-05-03T22:03:49.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.529+0000 7fc379e00700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c10f690 0x7fc37c19f150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009910 tx=0x7fc36c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:49.534 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.530+0000 7fc372a00700 1 -- 172.21.15.130:0/1544321481 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc36c005dc0 con 0x7fc37c10f690 2024-05-03T22:03:49.534 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.530+0000 7fc381000700 1 -- 172.21.15.130:0/1544321481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37c1a3f60 con 0x7fc37c10f690 2024-05-03T22:03:49.534 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.530+0000 7fc372a00700 1 -- 172.21.15.130:0/1544321481 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc36c00bdf0 con 0x7fc37c10f690 2024-05-03T22:03:49.535 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.530+0000 7fc372a00700 1 -- 172.21.15.130:0/1544321481 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc36c022d30 con 0x7fc37c10f690 2024-05-03T22:03:49.535 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.530+0000 7fc381000700 1 -- 172.21.15.130:0/1544321481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37c1a44c0 con 0x7fc37c10f690 2024-05-03T22:03:49.535 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.531+0000 7fc381000700 1 -- 172.21.15.130:0/1544321481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37c10ad30 con 0x7fc37c10f690 2024-05-03T22:03:49.535 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.531+0000 7fc372a00700 1 -- 172.21.15.130:0/1544321481 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fc36c02a070 con 0x7fc37c10f690 2024-05-03T22:03:49.535 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.532+0000 7fc372a00700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc36003e2b0 0x7fc360040770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:49.535 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.532+0000 7fc372a00700 1 -- 172.21.15.130:0/1544321481 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc36c01e030 con 0x7fc37c10f690 2024-05-03T22:03:49.535 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.533+0000 7fc373e00700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc36003e2b0 0x7fc360040770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:49.536 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.534+0000 7fc373e00700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc36003e2b0 0x7fc360040770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc364009180 tx=0x7fc364008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:49.551 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.549+0000 7fc372a00700 1 -- 172.21.15.130:0/1544321481 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc36c013070 con 0x7fc37c10f690 2024-05-03T22:03:49.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.873+0000 7fc381000700 1 -- 172.21.15.130:0/1544321481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc37c1a0550 con 0x7fc37c10f690 2024-05-03T22:03:49.876 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.874+0000 7fc372a00700 1 -- 172.21.15.130:0/1544321481 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fc36c031020 con 0x7fc37c10f690 2024-05-03T22:03:49.876 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T22:03:49.877 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":2,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","modified":"2024-05-03T22:03:39.955681Z","created":"2024-05-03T22:01:21.829502Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3300","nonce":0},{"type":"v1","addr":"172.21.15.130:6789","nonce":0}]},"addr":"172.21.15.130:6789/0","public_addr":"172.21.15.130:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-03T22:03:49.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.877+0000 7fc381000700 1 -- 172.21.15.130:0/1544321481 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc36003e2b0 msgr2=0x7fc360040770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:49.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.877+0000 7fc381000700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc36003e2b0 0x7fc360040770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc364009180 tx=0x7fc364008040 comp rx=0 tx=0).stop 2024-05-03T22:03:49.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.877+0000 7fc381000700 1 -- 172.21.15.130:0/1544321481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c10f690 msgr2=0x7fc37c19f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:49.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.877+0000 7fc381000700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c10f690 0x7fc37c19f150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009910 tx=0x7fc36c005780 comp rx=0 tx=0).stop 2024-05-03T22:03:49.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.877+0000 7fc381000700 1 -- 172.21.15.130:0/1544321481 shutdown_connections 2024-05-03T22:03:49.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.877+0000 7fc381000700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc36003e2b0 0x7fc360040770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:49.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.877+0000 7fc381000700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc37c10f690 0x7fc37c19f150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:49.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.877+0000 7fc381000700 1 --2- 172.21.15.130:0/1544321481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc37c19f690 0x7fc37c1a3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:49.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.877+0000 7fc381000700 1 -- 172.21.15.130:0/1544321481 >> 172.21.15.130:0/1544321481 conn(0x7fc37c078e20 msgr2=0x7fc37c079200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:49.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.878+0000 7fc381000700 1 -- 172.21.15.130:0/1544321481 shutdown_connections 2024-05-03T22:03:49.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:49.878+0000 7fc381000700 1 -- 172.21.15.130:0/1544321481 wait complete. 2024-05-03T22:03:49.881 INFO:teuthology.orchestra.run.smithi130.stderr:dumped monmap epoch 2 2024-05-03T22:03:50.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:50 smithi130 ceph-mon[32417]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:50 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/1544321481' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:50 smithi082 ceph-mon[28404]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:50 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/1544321481' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:50.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 podman[31809]: 2024-05-03 22:03:50.238372591 +0000 UTC m=+0.036171101 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:03:50.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 podman[31809]: 2024-05-03 22:03:50.611558582 +0000 UTC m=+0.409357114 container init 284277348d57b674c6e88182a605eb421c0ea66e4adc736e249c19e97c78b494 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-b, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2) 2024-05-03T22:03:50.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 podman[31809]: 2024-05-03 22:03:50.622084411 +0000 UTC m=+0.419882906 container start 284277348d57b674c6e88182a605eb421c0ea66e4adc736e249c19e97c78b494 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-b, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-03T22:03:50.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: set uid:gid to 167:167 (ceph:ceph) 2024-05-03T22:03:50.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev), process ceph-mon, pid 2 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pidfile_write: ignore empty --pid-file 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: load: jerasure load: lrc 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: RocksDB version: 7.9.2 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Git sha 0 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Compile date 2024-05-01 21:12:03 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: DB SUMMARY 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: DB Session ID: 79MOPLSSDWCWBQSUPE85 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: CURRENT file: CURRENT 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: IDENTITY file: IDENTITY 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.error_if_exists: 0 2024-05-03T22:03:50.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.create_if_missing: 0 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.paranoid_checks: 1 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.env: 0x55dfb5123cc0 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.fs: PosixFileSystem 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.info_log: 0x55dfe2bd9de0 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_file_opening_threads: 16 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.statistics: (nil) 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.use_fsync: 0 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_log_file_size: 0 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-03T22:03:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.keep_log_file_num: 1000 2024-05-03T22:03:50.940 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.recycle_log_file_num: 0 2024-05-03T22:03:50.940 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.allow_fallocate: 1 2024-05-03T22:03:50.940 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.allow_mmap_reads: 0 2024-05-03T22:03:50.940 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.allow_mmap_writes: 0 2024-05-03T22:03:50.940 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.use_direct_reads: 0 2024-05-03T22:03:50.940 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-03T22:03:50.940 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.create_missing_column_families: 0 2024-05-03T22:03:50.940 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.db_log_dir: 2024-05-03T22:03:50.940 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.wal_dir: 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.advise_random_on_open: 1 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.db_write_buffer_size: 0 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.write_buffer_manager: 0x55dfe2bab0e0 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.rate_limiter: (nil) 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-03T22:03:50.941 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.wal_recovery_mode: 2 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.enable_thread_tracking: 0 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.enable_pipelined_write: 0 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.unordered_write: 0 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.row_cache: None 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.wal_filter: None 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.allow_ingest_behind: 0 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.two_write_queues: 0 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.manual_wal_flush: 0 2024-05-03T22:03:50.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.wal_compression: 0 2024-05-03T22:03:50.943 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.atomic_flush: 0 2024-05-03T22:03:50.943 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-03T22:03:50.943 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-03T22:03:50.943 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-03T22:03:50.943 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.log_readahead_size: 0 2024-05-03T22:03:50.943 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-03T22:03:50.943 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.best_efforts_recovery: 0 2024-05-03T22:03:50.943 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-03T22:03:50.943 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.allow_data_in_errors: 0 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.db_host_id: __hostname__ 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_background_jobs: 2 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_background_compactions: -1 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_subcompactions: 1 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_total_wal_size: 0 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-03T22:03:50.944 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_open_files: -1 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bytes_per_sync: 0 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_readahead_size: 0 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_background_flushes: -1 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Compression algorithms supported: 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: kZSTD supported: 0 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: kXpressCompression supported: 0 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: kLZ4HCCompression supported: 1 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: kZlibCompression supported: 1 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: kSnappyCompression supported: 1 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: kLZ4Compression supported: 1 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: kBZip2Compression supported: 0 2024-05-03T22:03:50.945 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-03T22:03:50.946 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-03T22:03:50.946 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-05-03T22:03:50.946 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-03T22:03:50.946 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-03T22:03:50.946 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.merge_operator: 2024-05-03T22:03:50.946 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_filter: None 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_filter_factory: None 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.sst_partitioner_factory: None 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55dfe2bd9fa0) 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout: cache_index_and_filter_blocks: 1 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout: pin_top_level_index_and_filter: 1 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout: index_type: 0 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout: data_block_index_type: 0 2024-05-03T22:03:50.947 INFO:journalctl@ceph.mon.b.smithi116.stdout: index_shortening: 1 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: checksum: 4 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: no_block_cache: 0 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_cache: 0x55dfe2bdd1f0 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_cache_name: BinnedLRUCache 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_cache_options: 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: capacity : 536870912 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: num_shard_bits : 4 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: strict_capacity_limit : 0 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: high_pri_pool_ratio: 0.000 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_cache_compressed: (nil) 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: persistent_cache: (nil) 2024-05-03T22:03:50.948 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_size: 4096 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_size_deviation: 10 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_restart_interval: 16 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: index_block_restart_interval: 1 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: metadata_block_size: 4096 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: partition_filters: 0 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: use_delta_encoding: 1 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: filter_policy: bloomfilter 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: whole_key_filtering: 1 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: verify_compression: 0 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: read_amp_bytes_per_bit: 0 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: format_version: 5 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: enable_index_compression: 1 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_align: 0 2024-05-03T22:03:50.949 INFO:journalctl@ceph.mon.b.smithi116.stdout: max_auto_readahead_size: 262144 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout: prepopulate_block_cache: 0 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout: initial_auto_readahead_size: 8192 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout: num_file_reads_for_auto_readahead: 2 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.write_buffer_size: 33554432 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_write_buffer_number: 2 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compression: NoCompression 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bottommost_compression: Disabled 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.prefix_extractor: nullptr 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.num_levels: 7 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-03T22:03:50.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compression_opts.level: 32767 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compression_opts.strategy: 0 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:03:50.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compression_opts.enabled: false 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.target_file_size_base: 67108864 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-03T22:03:50.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-03T22:03:50.953 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-03T22:03:50.953 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-03T22:03:50.953 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-03T22:03:50.953 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-03T22:03:50.953 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-03T22:03:50.953 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.arena_block_size: 1048576 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.disable_auto_compactions: 0 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-03T22:03:50.954 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.inplace_update_support: 0 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.bloom_locality: 0 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.max_successive_merges: 0 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.paranoid_file_checks: 0 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.force_consistency_checks: 1 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.report_bg_io_stats: 0 2024-05-03T22:03:50.955 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.ttl: 2592000 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.enable_blob_files: false 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.min_blob_size: 0 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.blob_file_size: 268435456 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.blob_file_starting_level: 0 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-03T22:03:50.956 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b49ccd86-8ad8-48c1-bdbf-9ee981ecacba 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714773830680607, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714773830681814, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714773830, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b49ccd86-8ad8-48c1-bdbf-9ee981ecacba", "db_session_id": "79MOPLSSDWCWBQSUPE85", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714773830682083, "job": 1, "event": "recovery_finished"} 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55dfe2cfa000 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: DB pointer 0x55dfe2ce6000 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout: ** DB Stats ** 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:03:50.957 INFO:journalctl@ceph.mon.b.smithi116.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: ** Compaction Stats [default] ** 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-05-03T22:03:50.958 INFO:journalctl@ceph.mon.b.smithi116.stdout: ** Compaction Stats [default] ** 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-03T22:03:50.959 INFO:journalctl@ceph.mon.b.smithi116.stdout: Cumulative compaction: 0.00 GB write, 0.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout: Interval compaction: 0.00 GB write, 0.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout: Block cache BinnedLRUCache@0x55dfe2bdd1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: using public_addr v2:172.21.15.116:0/0 -> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: starting mon.b rank -1 at public addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] at bind addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(???) e0 preinit fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 bash[31809]: 284277348d57b674c6e88182a605eb421c0ea66e4adc736e249c19e97c78b494 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 systemd[1]: Started Ceph mon.b for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).mds e1 new map 2024-05-03T22:03:50.960 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout: e1 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout: legacy client fscid: -1 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout: No filesystems configured 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-03T22:03:50.961 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:03:50.962 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:03:50.962 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:03:50.962 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.962 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.962 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.962 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.962 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Added host smithi116 2024-05-03T22:03:50.962 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:03:50.962 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.962 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.962 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.963 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.963 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:03:50.963 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.963 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.963 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi130", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:03:50.963 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.963 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.963 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Updating smithi116:/etc/ceph/ceph.conf 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Deploying cephadm binary to smithi130 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Updating smithi116:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Updating smithi116:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:03:50.964 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Added host smithi130 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.965 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3089545763' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3089545763' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Updating smithi130:/etc/ceph/ceph.conf 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Updating smithi130:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Updating smithi130:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi116:172.21.15.116=b;smithi130:172.21.15.130=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi116:172.21.15.116=b;smithi130:172.21.15.130=c;count:3 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Deploying daemon mon.c on smithi130 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/2989428650' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.a calling monitor election 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.c calling monitor election 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-03T22:03:50.968 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: monmap epoch 2 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: last_changed 2024-05-03T22:03:39.955681+0000 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: created 2024-05-03T22:01:21.829502+0000 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: min_mon_release 19 (squid) 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: election_strategy: 1 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: 1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.c 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: fsmap 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mgrmap e13: x(active, since 68s) 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: overall HEALTH_OK 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:50.969 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:03:50.970 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:50.970 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: Deploying daemon mon.b on smithi116 2024-05-03T22:03:50.970 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/4201000643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:50.970 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:50.970 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.970 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:50.970 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/1544321481' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:50.970 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:50 smithi116 ceph-mon[31828]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-05-03T22:03:51.618 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-03T22:03:51.618 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-03T22:03:52.048 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:03:56.187 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:56.187 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:03:56.187 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: mon.a calling monitor election 2024-05-03T22:03:56.187 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: mon.c calling monitor election 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: mon.b calling monitor election 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: monmap epoch 3 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: last_changed 2024-05-03T22:03:50.734856+0000 2024-05-03T22:03:56.188 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: created 2024-05-03T22:01:21.829502+0000 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: min_mon_release 19 (squid) 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: election_strategy: 1 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: 1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.c 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: fsmap 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: mgrmap e13: x(active, since 79s) 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: overall HEALTH_OK 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:56.189 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:56.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:56.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:03:56.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: mon.a calling monitor election 2024-05-03T22:03:56.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:56.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: mon.c calling monitor election 2024-05-03T22:03:56.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:56.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: mon.b calling monitor election 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: monmap epoch 3 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: last_changed 2024-05-03T22:03:50.734856+0000 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: created 2024-05-03T22:01:21.829502+0000 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: min_mon_release 19 (squid) 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: election_strategy: 1 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: 1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.c 2024-05-03T22:03:56.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-05-03T22:03:56.229 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: fsmap 2024-05-03T22:03:56.229 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:03:56.229 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: mgrmap e13: x(active, since 79s) 2024-05-03T22:03:56.229 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: overall HEALTH_OK 2024-05-03T22:03:56.229 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:56.229 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:56.229 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:56.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:56.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:03:56.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: mon.a calling monitor election 2024-05-03T22:03:56.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.279 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:03:56.279 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: mon.c calling monitor election 2024-05-03T22:03:56.279 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.279 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:56.279 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.279 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: mon.b calling monitor election 2024-05-03T22:03:56.279 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.279 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:56.279 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.279 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:56.280 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-03T22:03:56.280 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: monmap epoch 3 2024-05-03T22:03:56.280 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:03:56.280 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: last_changed 2024-05-03T22:03:50.734856+0000 2024-05-03T22:03:56.280 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: created 2024-05-03T22:01:21.829502+0000 2024-05-03T22:03:56.280 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: min_mon_release 19 (squid) 2024-05-03T22:03:56.280 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: election_strategy: 1 2024-05-03T22:03:56.280 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-03T22:03:56.280 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: 1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.c 2024-05-03T22:03:56.280 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-05-03T22:03:56.281 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: fsmap 2024-05-03T22:03:56.281 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:03:56.281 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: mgrmap e13: x(active, since 79s) 2024-05-03T22:03:56.281 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: overall HEALTH_OK 2024-05-03T22:03:56.281 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:56.281 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:56.281 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:56.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.872+0000 7f84d2000700 1 -- 172.21.15.130:0/4235791623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84b40035c0 msgr2=0x7f84b4005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:56.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.872+0000 7f84d2000700 1 --2- 172.21.15.130:0/4235791623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84b40035c0 0x7f84b4005a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f84cc109310 tx=0x7f84c000feb0 comp rx=0 tx=0).stop 2024-05-03T22:03:56.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.872+0000 7f84d2000700 1 -- 172.21.15.130:0/4235791623 shutdown_connections 2024-05-03T22:03:56.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.872+0000 7f84d2000700 1 --2- 172.21.15.130:0/4235791623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84b40035c0 0x7f84b4005a50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:56.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.872+0000 7f84d2000700 1 -- 172.21.15.130:0/4235791623 >> 172.21.15.130:0/4235791623 conn(0x7f84cc078bc0 msgr2=0x7f84cc07afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:56.876 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.872+0000 7f84d2000700 1 -- 172.21.15.130:0/4235791623 shutdown_connections 2024-05-03T22:03:56.876 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.872+0000 7f84d2000700 1 -- 172.21.15.130:0/4235791623 wait complete. 2024-05-03T22:03:56.877 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.875+0000 7f84d2000700 1 Processor -- start 2024-05-03T22:03:56.877 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.875+0000 7f84d2000700 1 -- start start 2024-05-03T22:03:56.878 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.876+0000 7f84d2000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84b40035c0 0x7f84cc19ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:56.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.876+0000 7f84d2000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84cc19f3c0 0x7f84cc1a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:56.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.876+0000 7f84d2000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84cc1a3c40 0x7f84cc1a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:56.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.876+0000 7f84d2000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc1111e0 con 0x7f84cc1a3c40 2024-05-03T22:03:56.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.876+0000 7f84d2000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc111060 con 0x7f84cc19f3c0 2024-05-03T22:03:56.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.876+0000 7f84d2000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc111360 con 0x7f84b40035c0 2024-05-03T22:03:56.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84d0c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84b40035c0 0x7f84cc19ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:56.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84d0c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84b40035c0 0x7f84cc19ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:44062/0 (socket says 172.21.15.130:44062) 2024-05-03T22:03:56.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84d0c00700 1 -- 172.21.15.130:0/3242588471 learned_addr learned my addr 172.21.15.130:0/3242588471 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-05-03T22:03:56.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84d1600700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84cc1a3c40 0x7f84cc1a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:56.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84cbe00700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84cc19f3c0 0x7f84cc1a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:56.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84cbe00700 1 -- 172.21.15.130:0/3242588471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84cc19f3c0 msgr2=0x7f84cc1a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-03T22:03:56.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84cbe00700 1 -- 172.21.15.130:0/3242588471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84cc19f3c0 msgr2=0x7f84cc1a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-03T22:03:56.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84cbe00700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84cc19f3c0 0x7f84cc1a3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-03T22:03:56.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84cbe00700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84cc19f3c0 0x7f84cc1a3700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:03:56.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84d0c00700 1 -- 172.21.15.130:0/3242588471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84cc19f3c0 msgr2=0x7f84cc1a3700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:03:56.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84d0c00700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84cc19f3c0 0x7f84cc1a3700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:56.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84d0c00700 1 -- 172.21.15.130:0/3242588471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84cc1a3c40 msgr2=0x7f84cc1a40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:56.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.877+0000 7f84d0c00700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84cc1a3c40 0x7f84cc1a40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:56.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.878+0000 7f84d0c00700 1 -- 172.21.15.130:0/3242588471 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc1ab9b0 con 0x7f84b40035c0 2024-05-03T22:03:56.881 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.878+0000 7f84d0c00700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84b40035c0 0x7f84cc19ee80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f84c0010010 tx=0x7f84c00139e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:56.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.878+0000 7f84c9600700 1 -- 172.21.15.130:0/3242588471 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0004900 con 0x7f84b40035c0 2024-05-03T22:03:56.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.878+0000 7f84d2000700 1 -- 172.21.15.130:0/3242588471 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84cc1abb80 con 0x7f84b40035c0 2024-05-03T22:03:56.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.878+0000 7f84c9600700 1 -- 172.21.15.130:0/3242588471 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84c0004030 con 0x7f84b40035c0 2024-05-03T22:03:56.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.878+0000 7f84c9600700 1 -- 172.21.15.130:0/3242588471 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0003d00 con 0x7f84b40035c0 2024-05-03T22:03:56.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.879+0000 7f84d2000700 1 -- 172.21.15.130:0/3242588471 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84cc1ac0c0 con 0x7f84b40035c0 2024-05-03T22:03:56.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.880+0000 7f84d2000700 1 -- 172.21.15.130:0/3242588471 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84cc10ab20 con 0x7f84b40035c0 2024-05-03T22:03:56.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.880+0000 7f84c9600700 1 -- 172.21.15.130:0/3242588471 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f84c0023070 con 0x7f84b40035c0 2024-05-03T22:03:56.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.880+0000 7f84c9600700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f84ac03e9a0 0x7f84ac040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:03:56.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.880+0000 7f84c9600700 1 -- 172.21.15.130:0/3242588471 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f84c0054d70 con 0x7f84b40035c0 2024-05-03T22:03:56.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.881+0000 7f84cbe00700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f84ac03e9a0 0x7f84ac040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:03:56.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.882+0000 7f84cbe00700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f84ac03e9a0 0x7f84ac040e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009850 tx=0x7f84b8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:03:56.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:56.888+0000 7f84c9600700 1 -- 172.21.15.130:0/3242588471 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f84c0031020 con 0x7f84b40035c0 2024-05-03T22:03:57.031 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:56 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:57.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:56 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:03:57.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:56 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:57.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:56 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:57.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:56 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:57.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:56 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:03:57.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:56 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:57.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:56 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:57.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.250+0000 7f84d2000700 1 -- 172.21.15.130:0/3242588471 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f84cc1ac350 con 0x7f84b40035c0 2024-05-03T22:03:57.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:56 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:57.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:56 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:03:57.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:56 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:57.253 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:56 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:03:57.253 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.251+0000 7f84c9600700 1 -- 172.21.15.130:0/3242588471 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7f84c0028020 con 0x7f84b40035c0 2024-05-03T22:03:57.253 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-05-03T22:03:57.254 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":3,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","modified":"2024-05-03T22:03:50.734856Z","created":"2024-05-03T22:01:21.829502Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3300","nonce":0},{"type":"v1","addr":"172.21.15.130:6789","nonce":0}]},"addr":"172.21.15.130:6789/0","public_addr":"172.21.15.130:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-03T22:03:57.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 -- 172.21.15.130:0/3242588471 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f84ac03e9a0 msgr2=0x7f84ac040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:57.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f84ac03e9a0 0x7f84ac040e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009850 tx=0x7f84b8008040 comp rx=0 tx=0).stop 2024-05-03T22:03:57.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 -- 172.21.15.130:0/3242588471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84b40035c0 msgr2=0x7f84cc19ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:03:57.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84b40035c0 0x7f84cc19ee80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f84c0010010 tx=0x7f84c00139e0 comp rx=0 tx=0).stop 2024-05-03T22:03:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 -- 172.21.15.130:0/3242588471 shutdown_connections 2024-05-03T22:03:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f84ac03e9a0 0x7f84ac040e60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84cc1a3c40 0x7f84cc1a40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84b40035c0 0x7f84cc19ee80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 --2- 172.21.15.130:0/3242588471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84cc19f3c0 0x7f84cc1a3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:03:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 -- 172.21.15.130:0/3242588471 >> 172.21.15.130:0/3242588471 conn(0x7f84cc078bc0 msgr2=0x7f84cc10af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:03:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 -- 172.21.15.130:0/3242588471 shutdown_connections 2024-05-03T22:03:57.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:03:57.254+0000 7f84d2000700 1 -- 172.21.15.130:0/3242588471 wait complete. 2024-05-03T22:03:57.258 INFO:teuthology.orchestra.run.smithi130.stderr:dumped monmap epoch 3 2024-05-03T22:03:58.097 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:57 smithi130 ceph-mon[32417]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:58.097 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:57 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/3242588471' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:58.144 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-03T22:03:58.147 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-03T22:03:58.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:57 smithi116 ceph-mon[31828]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:58.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:57 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/3242588471' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:58.218 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:57 smithi082 ceph-mon[28404]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:03:58.219 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:57 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/3242588471' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:03:58.579 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:03:59.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:59.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:03:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:03:59.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:59.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:03:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:03:59.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:03:59.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:03:59.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:03:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:00.337 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:00 smithi082 ceph-mon[28404]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:00.338 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:00 smithi082 ceph-mon[28404]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-03T22:04:00.338 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:00 smithi082 ceph-mon[28404]: Updating smithi116:/etc/ceph/ceph.conf 2024-05-03T22:04:00.338 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:00 smithi082 ceph-mon[28404]: Updating smithi130:/etc/ceph/ceph.conf 2024-05-03T22:04:00.338 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:00 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:00.338 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:00 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:00 smithi116 ceph-mon[31828]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:00 smithi116 ceph-mon[31828]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-03T22:04:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:00 smithi116 ceph-mon[31828]: Updating smithi116:/etc/ceph/ceph.conf 2024-05-03T22:04:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:00 smithi116 ceph-mon[31828]: Updating smithi130:/etc/ceph/ceph.conf 2024-05-03T22:04:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:00 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:00 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:00.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:00 smithi130 ceph-mon[32417]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:00 smithi130 ceph-mon[32417]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-03T22:04:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:00 smithi130 ceph-mon[32417]: Updating smithi116:/etc/ceph/ceph.conf 2024-05-03T22:04:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:00 smithi130 ceph-mon[32417]: Updating smithi130:/etc/ceph/ceph.conf 2024-05-03T22:04:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:00 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:00 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:00.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.862+0000 7f5b91800700 1 -- 172.21.15.82:0/3059001624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b8c103110 msgr2=0x7f5b8c1034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:00.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.862+0000 7f5b91800700 1 --2- 172.21.15.82:0/3059001624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b8c103110 0x7f5b8c1034f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009910 tx=0x7f5b7c009c20 comp rx=0 tx=0).stop 2024-05-03T22:04:00.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.863+0000 7f5b91800700 1 -- 172.21.15.82:0/3059001624 shutdown_connections 2024-05-03T22:04:00.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.863+0000 7f5b91800700 1 --2- 172.21.15.82:0/3059001624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b8c103110 0x7f5b8c1034f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:00.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.863+0000 7f5b91800700 1 -- 172.21.15.82:0/3059001624 >> 172.21.15.82:0/3059001624 conn(0x7f5b8c0fe9e0 msgr2=0x7f5b8c100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:04:00.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.863+0000 7f5b91800700 1 -- 172.21.15.82:0/3059001624 shutdown_connections 2024-05-03T22:04:00.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.863+0000 7f5b91800700 1 -- 172.21.15.82:0/3059001624 wait complete. 2024-05-03T22:04:00.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.864+0000 7f5b91800700 1 Processor -- start 2024-05-03T22:04:00.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.864+0000 7f5b91800700 1 -- start start 2024-05-03T22:04:00.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.864+0000 7f5b91800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b8c103110 0x7f5b8c0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:00.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.864+0000 7f5b91800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b8c075ce0 0x7f5b8c076160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.865+0000 7f5b91800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b8c1a4cb0 0x7f5b8c1a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.865+0000 7f5b91800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c10d200 con 0x7f5b8c075ce0 2024-05-03T22:04:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.865+0000 7f5b91800700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c10d080 con 0x7f5b8c103110 2024-05-03T22:04:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.865+0000 7f5b91800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c10d380 con 0x7f5b8c1a4cb0 2024-05-03T22:04:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.865+0000 7f5b8a000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b8c075ce0 0x7f5b8c076160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.865+0000 7f5b8a000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b8c075ce0 0x7f5b8c076160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52176/0 (socket says 172.21.15.82:52176) 2024-05-03T22:04:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.865+0000 7f5b8a000700 1 -- 172.21.15.82:0/925208807 learned_addr learned my addr 172.21.15.82:0/925208807 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:04:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.865+0000 7f5b8aa00700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b8c103110 0x7f5b8c0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.865+0000 7f5b8b400700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b8c1a4cb0 0x7f5b8c1a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.866+0000 7f5b8a000700 1 -- 172.21.15.82:0/925208807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b8c1a4cb0 msgr2=0x7f5b8c1a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.866+0000 7f5b8a000700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b8c1a4cb0 0x7f5b8c1a70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.866+0000 7f5b8a000700 1 -- 172.21.15.82:0/925208807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b8c103110 msgr2=0x7f5b8c0757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.866+0000 7f5b8a000700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b8c103110 0x7f5b8c0757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.866+0000 7f5b8a000700 1 -- 172.21.15.82:0/925208807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c1a77d0 con 0x7f5b8c075ce0 2024-05-03T22:04:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.866+0000 7f5b8aa00700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b8c103110 0x7f5b8c0757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:04:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.866+0000 7f5b8a000700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b8c075ce0 0x7f5b8c076160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800b780 tx=0x7f5b7800bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:04:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.866+0000 7f5b83400700 1 -- 172.21.15.82:0/925208807 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78004230 con 0x7f5b8c075ce0 2024-05-03T22:04:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.866+0000 7f5b83400700 1 -- 172.21.15.82:0/925208807 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b780043d0 con 0x7f5b8c075ce0 2024-05-03T22:04:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.866+0000 7f5b83400700 1 -- 172.21.15.82:0/925208807 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78011ac0 con 0x7f5b8c075ce0 2024-05-03T22:04:00.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.866+0000 7f5b91800700 1 -- 172.21.15.82:0/925208807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8c1a7ac0 con 0x7f5b8c075ce0 2024-05-03T22:04:00.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.867+0000 7f5b91800700 1 -- 172.21.15.82:0/925208807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b8c1a7fb0 con 0x7f5b8c075ce0 2024-05-03T22:04:00.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.868+0000 7f5b91800700 1 -- 172.21.15.82:0/925208807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8c064b00 con 0x7f5b8c075ce0 2024-05-03T22:04:00.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.868+0000 7f5b83400700 1 -- 172.21.15.82:0/925208807 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5b780036a0 con 0x7f5b8c075ce0 2024-05-03T22:04:00.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.869+0000 7f5b83400700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5b7003e9a0 0x7f5b70040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:00.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.869+0000 7f5b83400700 1 -- 172.21.15.82:0/925208807 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5b78052340 con 0x7f5b8c075ce0 2024-05-03T22:04:00.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.869+0000 7f5b8aa00700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5b7003e9a0 0x7f5b70040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:00.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.870+0000 7f5b8aa00700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5b7003e9a0 0x7f5b70040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00b5c0 tx=0x7f5b7c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:04:00.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:00.875+0000 7f5b83400700 1 -- 172.21.15.82:0/925208807 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5b78020740 con 0x7f5b8c075ce0 2024-05-03T22:04:01.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.114+0000 7f5b91800700 1 -- 172.21.15.82:0/925208807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f5b8c1a83c0 con 0x7f5b8c075ce0 2024-05-03T22:04:01.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.115+0000 7f5b83400700 1 -- 172.21.15.82:0/925208807 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f5b78003990 con 0x7f5b8c075ce0 2024-05-03T22:04:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:# minimal ceph.conf for 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:04:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-05-03T22:04:01.118 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:04:01.118 INFO:teuthology.orchestra.run.smithi082.stdout: mon_host = [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-05-03T22:04:01.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.118+0000 7f5b91800700 1 -- 172.21.15.82:0/925208807 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5b7003e9a0 msgr2=0x7f5b70040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.118+0000 7f5b91800700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5b7003e9a0 0x7f5b70040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00b5c0 tx=0x7f5b7c01a040 comp rx=0 tx=0).stop 2024-05-03T22:04:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.118+0000 7f5b91800700 1 -- 172.21.15.82:0/925208807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b8c075ce0 msgr2=0x7f5b8c076160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.118+0000 7f5b91800700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b8c075ce0 0x7f5b8c076160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800b780 tx=0x7f5b7800bb40 comp rx=0 tx=0).stop 2024-05-03T22:04:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.119+0000 7f5b91800700 1 -- 172.21.15.82:0/925208807 shutdown_connections 2024-05-03T22:04:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.119+0000 7f5b91800700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5b7003e9a0 0x7f5b70040e60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.119+0000 7f5b91800700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b8c1a4cb0 0x7f5b8c1a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.119+0000 7f5b91800700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b8c103110 0x7f5b8c0757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.119+0000 7f5b91800700 1 --2- 172.21.15.82:0/925208807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b8c075ce0 0x7f5b8c076160 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.119+0000 7f5b91800700 1 -- 172.21.15.82:0/925208807 >> 172.21.15.82:0/925208807 conn(0x7f5b8c0fe9e0 msgr2=0x7f5b8c104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:04:01.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.119+0000 7f5b91800700 1 -- 172.21.15.82:0/925208807 shutdown_connections 2024-05-03T22:04:01.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:01.119+0000 7f5b91800700 1 -- 172.21.15.82:0/925208807 wait complete. 2024-05-03T22:04:01.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: Updating smithi082:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:04:01.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: Updating smithi130:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:04:01.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: Updating smithi116:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:04:01.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:04:01.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:04:01.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:01.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:01 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/925208807' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:01.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: Updating smithi082:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:04:01.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: Updating smithi130:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:04:01.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: Updating smithi116:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:04:01.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:04:01.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:04:01.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:01.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:01 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/925208807' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:01.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: Updating smithi082:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:04:01.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: Updating smithi130:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:04:01.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: Updating smithi116:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:04:01.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:01.529 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:04:01.529 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:04:01.529 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:01.529 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:01 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/925208807' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:01.918 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-03T22:04:01.919 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:04:01.919 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-05-03T22:04:01.987 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:04:01.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:04:02.098 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-05-03T22:04:02.099 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.conf 2024-05-03T22:04:02.191 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-05-03T22:04:02.192 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:04:02.316 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-03T22:04:02.316 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.conf 2024-05-03T22:04:02.356 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:02 smithi082 ceph-mon[28404]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:02.356 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:02 smithi082 ceph-mon[28404]: Reconfiguring mon.a (unknown last config time)... 2024-05-03T22:04:02.356 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:02 smithi082 ceph-mon[28404]: Reconfiguring daemon mon.a on smithi082 2024-05-03T22:04:02.410 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-03T22:04:02.410 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:04:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:02 smithi116 ceph-mon[31828]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:02 smithi116 ceph-mon[31828]: Reconfiguring mon.a (unknown last config time)... 2024-05-03T22:04:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:02 smithi116 ceph-mon[31828]: Reconfiguring daemon mon.a on smithi082 2024-05-03T22:04:02.524 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:02 smithi130 ceph-mon[32417]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:02.524 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:02 smithi130 ceph-mon[32417]: Reconfiguring mon.a (unknown last config time)... 2024-05-03T22:04:02.524 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:02 smithi130 ceph-mon[32417]: Reconfiguring daemon mon.a on smithi082 2024-05-03T22:04:02.536 INFO:tasks.cephadm:Adding mgr.x on smithi082 2024-05-03T22:04:02.536 INFO:tasks.cephadm:Adding mgr.y on smithi116 2024-05-03T22:04:02.536 INFO:tasks.cephadm:Adding mgr.z on smithi130 2024-05-03T22:04:02.537 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch apply mgr '3;smithi082=x;smithi116=y;smithi130=z' 2024-05-03T22:04:02.990 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:04:04.220 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:04 smithi130 ceph-mon[32417]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:04.220 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:04.220 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:04.220 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:04:04.220 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:04:04.220 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:04.464 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:04 smithi116 ceph-mon[31828]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:04.465 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:04.465 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:04.465 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:04:04.465 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:04:04.465 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:04 smithi082 ceph-mon[28404]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:04:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:04:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:04.990 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.988+0000 7f5c50a00700 1 -- 172.21.15.130:0/3296180998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c105070 msgr2=0x7f5c4c105490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:04.990 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.988+0000 7f5c50a00700 1 --2- 172.21.15.130:0/3296180998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c105070 0x7f5c4c105490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009910 tx=0x7f5c3c009c20 comp rx=0 tx=0).stop 2024-05-03T22:04:04.990 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.988+0000 7f5c50a00700 1 -- 172.21.15.130:0/3296180998 shutdown_connections 2024-05-03T22:04:04.990 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.988+0000 7f5c50a00700 1 --2- 172.21.15.130:0/3296180998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c105070 0x7f5c4c105490 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:04.991 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.988+0000 7f5c50a00700 1 -- 172.21.15.130:0/3296180998 >> 172.21.15.130:0/3296180998 conn(0x7f5c4c100610 msgr2=0x7f5c4c102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:04:04.991 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.988+0000 7f5c50a00700 1 -- 172.21.15.130:0/3296180998 shutdown_connections 2024-05-03T22:04:04.991 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.988+0000 7f5c50a00700 1 -- 172.21.15.130:0/3296180998 wait complete. 2024-05-03T22:04:04.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.989+0000 7f5c50a00700 1 Processor -- start 2024-05-03T22:04:04.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.990+0000 7f5c50a00700 1 -- start start 2024-05-03T22:04:04.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.990+0000 7f5c50a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c105070 0x7f5c4c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:04.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.990+0000 7f5c50a00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4c19ac40 0x7f5c4c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:04.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.990+0000 7f5c50a00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c4c19b0c0 0x7f5c4c1a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:04.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.990+0000 7f5c50a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c10ae60 con 0x7f5c4c105070 2024-05-03T22:04:04.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.990+0000 7f5c50a00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c10ace0 con 0x7f5c4c19b0c0 2024-05-03T22:04:04.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.990+0000 7f5c50a00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c10afe0 con 0x7f5c4c19ac40 2024-05-03T22:04:04.994 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.990+0000 7f5c43e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4c19ac40 0x7f5c4c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:04.995 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.990+0000 7f5c43e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4c19ac40 0x7f5c4c19fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51662/0 (socket says 172.21.15.130:51662) 2024-05-03T22:04:04.995 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.990+0000 7f5c43e00700 1 -- 172.21.15.130:0/1016413127 learned_addr learned my addr 172.21.15.130:0/1016413127 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-05-03T22:04:04.995 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.991+0000 7f5c4a800700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c105070 0x7f5c4c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:04.995 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.991+0000 7f5c43e00700 1 -- 172.21.15.130:0/1016413127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c4c19b0c0 msgr2=0x7f5c4c1a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:04.995 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.991+0000 7f5c43e00700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c4c19b0c0 0x7f5c4c1a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:04.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.991+0000 7f5c43e00700 1 -- 172.21.15.130:0/1016413127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c105070 msgr2=0x7f5c4c19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:04.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.991+0000 7f5c43e00700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c105070 0x7f5c4c19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:04.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.991+0000 7f5c43e00700 1 -- 172.21.15.130:0/1016413127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c1a2b10 con 0x7f5c4c19ac40 2024-05-03T22:04:04.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.991+0000 7f5c43e00700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4c19ac40 0x7f5c4c19fcb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400b780 tx=0x7f5c3400ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:04:04.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.992+0000 7f5c43400700 1 -- 172.21.15.130:0/1016413127 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34004230 con 0x7f5c4c19ac40 2024-05-03T22:04:04.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.992+0000 7f5c43400700 1 -- 172.21.15.130:0/1016413127 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c340043d0 con 0x7f5c4c19ac40 2024-05-03T22:04:04.997 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.992+0000 7f5c50a00700 1 -- 172.21.15.130:0/1016413127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c1a2e00 con 0x7f5c4c19ac40 2024-05-03T22:04:04.997 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.992+0000 7f5c43400700 1 -- 172.21.15.130:0/1016413127 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34011a60 con 0x7f5c4c19ac40 2024-05-03T22:04:04.997 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.992+0000 7f5c50a00700 1 -- 172.21.15.130:0/1016413127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c1a33e0 con 0x7f5c4c19ac40 2024-05-03T22:04:04.998 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.993+0000 7f5c50a00700 1 -- 172.21.15.130:0/1016413127 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4c064b00 con 0x7f5c4c19ac40 2024-05-03T22:04:04.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.993+0000 7f5c43400700 1 -- 172.21.15.130:0/1016413127 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5c340036a0 con 0x7f5c4c19ac40 2024-05-03T22:04:04.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.994+0000 7f5c43400700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5c3003e9a0 0x7f5c30040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:04.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.994+0000 7f5c43400700 1 -- 172.21.15.130:0/1016413127 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5c340522e0 con 0x7f5c4c19ac40 2024-05-03T22:04:04.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.995+0000 7f5c4a800700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5c3003e9a0 0x7f5c30040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:04.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:04.996+0000 7f5c4a800700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5c3003e9a0 0x7f5c30040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0098e0 tx=0x7f5c3c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:04:05.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.000+0000 7f5c43400700 1 -- 172.21.15.130:0/1016413127 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5c34020740 con 0x7f5c4c19ac40 2024-05-03T22:04:05.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.245+0000 7f5c50a00700 1 -- 172.21.15.130:0/1016413127 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi116=y;smithi130=z", "target": ["mon-mgr", ""]}) -- 0x7f5c4c102580 con 0x7f5c3003e9a0 2024-05-03T22:04:05.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.259+0000 7f5c43400700 1 -- 172.21.15.130:0/1016413127 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5c4c102580 con 0x7f5c3003e9a0 2024-05-03T22:04:05.261 INFO:teuthology.orchestra.run.smithi130.stdout:Scheduled mgr update... 2024-05-03T22:04:05.264 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 -- 172.21.15.130:0/1016413127 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5c3003e9a0 msgr2=0x7f5c30040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:05.264 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5c3003e9a0 0x7f5c30040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0098e0 tx=0x7f5c3c005fb0 comp rx=0 tx=0).stop 2024-05-03T22:04:05.264 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 -- 172.21.15.130:0/1016413127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4c19ac40 msgr2=0x7f5c4c19fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4c19ac40 0x7f5c4c19fcb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400b780 tx=0x7f5c3400ba90 comp rx=0 tx=0).stop 2024-05-03T22:04:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 -- 172.21.15.130:0/1016413127 shutdown_connections 2024-05-03T22:04:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5c3003e9a0 0x7f5c30040e60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c105070 0x7f5c4c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c4c19b0c0 0x7f5c4c1a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 --2- 172.21.15.130:0/1016413127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c4c19ac40 0x7f5c4c19fcb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 -- 172.21.15.130:0/1016413127 >> 172.21.15.130:0/1016413127 conn(0x7f5c4c100610 msgr2=0x7f5c4c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:04:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 -- 172.21.15.130:0/1016413127 shutdown_connections 2024-05-03T22:04:05.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:04:05.262+0000 7f5c50a00700 1 -- 172.21.15.130:0/1016413127 wait complete. 2024-05-03T22:04:05.340 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:05 smithi116 ceph-mon[31828]: Reconfiguring mon.b (monmap changed)... 2024-05-03T22:04:05.341 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:05 smithi116 ceph-mon[31828]: Reconfiguring daemon mon.b on smithi116 2024-05-03T22:04:05.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:05 smithi082 ceph-mon[28404]: Reconfiguring mon.b (monmap changed)... 2024-05-03T22:04:05.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:05 smithi082 ceph-mon[28404]: Reconfiguring daemon mon.b on smithi116 2024-05-03T22:04:05.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:05 smithi130 ceph-mon[32417]: Reconfiguring mon.b (monmap changed)... 2024-05-03T22:04:05.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:05 smithi130 ceph-mon[32417]: Reconfiguring daemon mon.b on smithi116 2024-05-03T22:04:05.968 DEBUG:teuthology.orchestra.run.smithi116:mgr.y> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.y.service 2024-05-03T22:04:05.975 DEBUG:teuthology.orchestra.run.smithi130:mgr.z> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.z.service 2024-05-03T22:04:05.980 INFO:tasks.cephadm:Deploying OSDs... 2024-05-03T22:04:05.980 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:04:05.980 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-05-03T22:04:06.040 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-03T22:04:06.041 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-05-03T22:04:06.093 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-03T22:04:06.094 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:06.094 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-05-03T22:04:06.094 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:06.094 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:06.094 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-03 22:02:50.656475702 +0000 2024-05-03T22:04:06.094 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-03 21:57:35.033042772 +0000 2024-05-03T22:04:06.094 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-03 21:57:35.033042772 +0000 2024-05-03T22:04:06.094 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-03 21:57:35.033042772 +0000 2024-05-03T22:04:06.094 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-03T22:04:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-03T22:04:06.180 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-03T22:04:06.180 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000546378 s, 937 kB/s 2024-05-03T22:04:06.184 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-03T22:04:06.241 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-05-03T22:04:06.294 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-03T22:04:06.294 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:06.294 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-03T22:04:06.294 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:06.294 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:06.294 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-03 22:02:50.725474372 +0000 2024-05-03T22:04:06.294 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-03 21:57:35.646030911 +0000 2024-05-03T22:04:06.295 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-03 21:57:35.646030911 +0000 2024-05-03T22:04:06.295 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-03 21:57:35.646030911 +0000 2024-05-03T22:04:06.295 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-03T22:04:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-03T22:04:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-03T22:04:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000389693 s, 1.3 MB/s 2024-05-03T22:04:06.374 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-03T22:04:06.429 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-05-03T22:04:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:06 smithi116 ceph-mon[31828]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:04:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:04:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:06 smithi082 ceph-mon[28404]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:04:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:04:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:06.479 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-03T22:04:06.479 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:06.479 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-05-03T22:04:06.479 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:06.479 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:06.479 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-03 22:02:50.797472985 +0000 2024-05-03T22:04:06.480 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-03 21:57:36.250019224 +0000 2024-05-03T22:04:06.480 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-03 21:57:36.250019224 +0000 2024-05-03T22:04:06.480 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-03 21:57:36.250019224 +0000 2024-05-03T22:04:06.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-03T22:04:06.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:06 smithi130 ceph-mon[32417]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:06.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:06.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:06.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:06.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:04:06.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:04:06.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:06.557 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-03T22:04:06.557 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-03T22:04:06.557 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000316545 s, 1.6 MB/s 2024-05-03T22:04:06.561 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-03T22:04:06.616 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-05-03T22:04:06.667 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-03T22:04:06.667 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:06.667 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-05-03T22:04:06.667 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:06.667 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:06.667 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-03 22:02:50.853471906 +0000 2024-05-03T22:04:06.667 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-03 21:57:36.867007286 +0000 2024-05-03T22:04:06.667 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-03 21:57:36.867007286 +0000 2024-05-03T22:04:06.667 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-03 21:57:36.867007286 +0000 2024-05-03T22:04:06.668 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-03T22:04:06.745 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-03T22:04:06.745 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-03T22:04:06.745 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000394173 s, 1.3 MB/s 2024-05-03T22:04:06.749 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-03T22:04:06.806 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-05-03T22:04:06.806 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-05-03T22:04:06.864 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-03T22:04:06.864 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-05-03T22:04:06.914 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-03T22:04:06.914 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:06.914 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-05-03T22:04:06.915 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:06.915 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:06.915 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-05-03 22:03:49.823654750 +0000 2024-05-03T22:04:06.915 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-05-03 21:57:35.890226148 +0000 2024-05-03T22:04:06.915 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-05-03 21:57:35.890226148 +0000 2024-05-03T22:04:06.915 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-05-03 21:57:35.890226148 +0000 2024-05-03T22:04:06.915 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-03T22:04:06.990 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-05-03T22:04:06.991 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-05-03T22:04:06.991 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000332514 s, 1.5 MB/s 2024-05-03T22:04:06.994 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-03T22:04:07.049 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-05-03T22:04:07.096 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-03T22:04:07.096 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:07.096 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-03T22:04:07.097 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:07.097 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:07.097 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-05-03 22:03:49.823654750 +0000 2024-05-03T22:04:07.097 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-05-03 21:57:36.479216311 +0000 2024-05-03T22:04:07.097 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-05-03 21:57:36.479216311 +0000 2024-05-03T22:04:07.097 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-05-03 21:57:36.479216311 +0000 2024-05-03T22:04:07.097 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-03T22:04:07.213 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-05-03T22:04:07.213 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-05-03T22:04:07.213 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000393248 s, 1.3 MB/s 2024-05-03T22:04:07.217 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-03T22:04:07.275 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-05-03T22:04:07.324 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-03T22:04:07.324 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:07.324 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-05-03T22:04:07.324 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:07.324 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:07.325 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-05-03 22:03:49.824654734 +0000 2024-05-03T22:04:07.325 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-05-03 21:57:37.091206090 +0000 2024-05-03T22:04:07.325 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-05-03 21:57:37.091206090 +0000 2024-05-03T22:04:07.325 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-05-03 21:57:37.091206090 +0000 2024-05-03T22:04:07.325 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-03T22:04:07.387 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:07 smithi116 ceph-mon[31828]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi116=y;smithi130=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:04:07.388 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:07 smithi116 ceph-mon[31828]: Saving service mgr spec with placement smithi082=x;smithi116=y;smithi130=z;count:3 2024-05-03T22:04:07.388 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:07 smithi116 ceph-mon[31828]: Reconfiguring mon.c (monmap changed)... 2024-05-03T22:04:07.388 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:07 smithi116 ceph-mon[31828]: Reconfiguring daemon mon.c on smithi130 2024-05-03T22:04:07.402 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-05-03T22:04:07.402 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-05-03T22:04:07.403 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000330428 s, 1.5 MB/s 2024-05-03T22:04:07.406 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-03T22:04:07.428 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:07 smithi130 ceph-mon[32417]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi116=y;smithi130=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:04:07.428 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:07 smithi130 ceph-mon[32417]: Saving service mgr spec with placement smithi082=x;smithi116=y;smithi130=z;count:3 2024-05-03T22:04:07.428 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:07 smithi130 ceph-mon[32417]: Reconfiguring mon.c (monmap changed)... 2024-05-03T22:04:07.428 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:07 smithi130 ceph-mon[32417]: Reconfiguring daemon mon.c on smithi130 2024-05-03T22:04:07.459 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-05-03T22:04:07.506 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-03T22:04:07.506 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:07.506 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-05-03T22:04:07.506 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:07.506 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:07.506 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-05-03 22:03:49.825654718 +0000 2024-05-03T22:04:07.506 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-05-03 21:57:37.706195819 +0000 2024-05-03T22:04:07.506 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-05-03 21:57:37.706195819 +0000 2024-05-03T22:04:07.506 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-05-03 21:57:37.706195819 +0000 2024-05-03T22:04:07.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-03T22:04:07.576 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-05-03T22:04:07.576 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-05-03T22:04:07.576 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000424649 s, 1.2 MB/s 2024-05-03T22:04:07.579 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-03T22:04:07.634 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-05-03T22:04:07.634 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-05-03T22:04:07.690 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-03T22:04:07.690 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-05-03T22:04:07.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:07 smithi082 ceph-mon[28404]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi116=y;smithi130=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:04:07.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:07 smithi082 ceph-mon[28404]: Saving service mgr spec with placement smithi082=x;smithi116=y;smithi130=z;count:3 2024-05-03T22:04:07.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:07 smithi082 ceph-mon[28404]: Reconfiguring mon.c (monmap changed)... 2024-05-03T22:04:07.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:07 smithi082 ceph-mon[28404]: Reconfiguring daemon mon.c on smithi130 2024-05-03T22:04:07.731 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-03T22:04:07.731 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:07.731 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 625 Links: 1 2024-05-03T22:04:07.731 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:07.731 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:07.731 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-05-03 22:03:38.953909549 +0000 2024-05-03T22:04:07.732 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-05-03 21:57:36.034951097 +0000 2024-05-03T22:04:07.732 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-05-03 21:57:36.034951097 +0000 2024-05-03T22:04:07.732 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-05-03 21:57:36.034951097 +0000 2024-05-03T22:04:07.732 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-03T22:04:07.834 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-05-03T22:04:07.835 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-05-03T22:04:07.835 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000307736 s, 1.7 MB/s 2024-05-03T22:04:07.837 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-03T22:04:07.882 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-05-03T22:04:07.972 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-03T22:04:07.972 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:07.972 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 647 Links: 1 2024-05-03T22:04:07.973 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:07.973 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:07.973 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-05-03 22:03:38.954909531 +0000 2024-05-03T22:04:07.973 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-05-03 21:57:36.628940341 +0000 2024-05-03T22:04:07.973 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-05-03 21:57:36.628940341 +0000 2024-05-03T22:04:07.973 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-05-03 21:57:36.628940341 +0000 2024-05-03T22:04:07.973 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-03T22:04:08.045 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-05-03T22:04:08.045 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-05-03T22:04:08.045 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000343458 s, 1.5 MB/s 2024-05-03T22:04:08.049 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-03T22:04:08.098 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-05-03T22:04:08.140 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-03T22:04:08.140 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:08.140 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 664 Links: 1 2024-05-03T22:04:08.140 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:08.140 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:08.140 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-05-03 22:03:38.955909513 +0000 2024-05-03T22:04:08.140 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-05-03 21:57:37.203929930 +0000 2024-05-03T22:04:08.141 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-05-03 21:57:37.203929930 +0000 2024-05-03T22:04:08.141 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-05-03 21:57:37.203929930 +0000 2024-05-03T22:04:08.141 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-03T22:04:08.252 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-05-03T22:04:08.252 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-05-03T22:04:08.252 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000360894 s, 1.4 MB/s 2024-05-03T22:04:08.255 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-03T22:04:08.298 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-05-03T22:04:08.383 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-03T22:04:08.383 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:04:08.383 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 684 Links: 1 2024-05-03T22:04:08.383 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:04:08.383 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:04:08.383 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-05-03 22:03:38.955909513 +0000 2024-05-03T22:04:08.383 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-05-03 21:57:37.799919138 +0000 2024-05-03T22:04:08.383 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-05-03 21:57:37.799919138 +0000 2024-05-03T22:04:08.384 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-05-03 21:57:37.799919138 +0000 2024-05-03T22:04:08.384 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-03T22:04:08.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:08 smithi116 ceph-mon[31828]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:08.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:08.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:08.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:08.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:08.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:08.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:08.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:04:08.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:04:08.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:04:08.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:08.485 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:08 smithi130 ceph-mon[32417]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:08.485 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:08.486 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:08.486 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:08.486 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:08.486 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:08.486 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:08.486 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:04:08.486 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:04:08.486 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:04:08.486 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:08.491 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-05-03T22:04:08.491 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-05-03T22:04:08.491 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000272595 s, 1.9 MB/s 2024-05-03T22:04:08.494 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-03T22:04:08.539 INFO:tasks.cephadm:Deploying osd.0 on smithi082 with /dev/vg_nvme/lv_4... 2024-05-03T22:04:08.539 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-03T22:04:08.617 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:08 smithi082 ceph-mon[28404]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:08.617 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:08.617 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:08.617 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:08.617 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:08.617 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:08.617 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:08.618 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:04:08.618 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:04:08.618 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:04:08.618 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:08.969 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:04:09.409 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:09 smithi082 ceph-mon[28404]: Deploying daemon mgr.z on smithi130 2024-05-03T22:04:09.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:09 smithi130 ceph-mon[32417]: Deploying daemon mgr.z on smithi130 2024-05-03T22:04:09.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:09 smithi116 ceph-mon[31828]: Deploying daemon mgr.z on smithi130 2024-05-03T22:04:10.395 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:10 smithi130 ceph-mon[32417]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:10.542 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:10 smithi082 ceph-mon[28404]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:10 smithi116 ceph-mon[31828]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:10.760 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:10 smithi130 systemd[1]: Starting Ceph mgr.z for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:04:11.027 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:10 smithi130 podman[34365]: 2024-05-03 22:04:10.663730612 +0000 UTC m=+0.033312407 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:04:11.028 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:10 smithi130 podman[34365]: 2024-05-03 22:04:10.766754269 +0000 UTC m=+0.136336081 container create 18724542bbbdec7c7c32b4ac3099c4dc2ec630b97350e26d3d6f2859bc945d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:04:11.028 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:10 smithi130 podman[34365]: 2024-05-03 22:04:10.996778779 +0000 UTC m=+0.366360665 container init 18724542bbbdec7c7c32b4ac3099c4dc2ec630b97350e26d3d6f2859bc945d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:04:11.028 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:11 smithi130 podman[34365]: 2024-05-03 22:04:11.007949053 +0000 UTC m=+0.377530895 container start 18724542bbbdec7c7c32b4ac3099c4dc2ec630b97350e26d3d6f2859bc945d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-05-03T22:04:11.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:11 smithi082 ceph-mon[28404]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:11.512 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:11 smithi130 ceph-mon[32417]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:11.513 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:11 smithi130 ceph-mgr[34384]: -- 172.21.15.130:0/3953117401 <== mon.1 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a061a745a0 con 0x55a061a49000 2024-05-03T22:04:11.513 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:11 smithi130 bash[34365]: 18724542bbbdec7c7c32b4ac3099c4dc2ec630b97350e26d3d6f2859bc945d9b 2024-05-03T22:04:11.513 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:11 smithi130 systemd[1]: Started Ceph mgr.z for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:04:11.513 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:11 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:11.257+0000 7f496831a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T22:04:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:11 smithi116 ceph-mon[31828]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:11.777 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:11 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:11.510+0000 7f496831a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:04:11.777 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:11 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:11.641+0000 7f496831a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T22:04:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-03T22:04:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-03T22:04:11.859 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-03T22:04:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-03T22:04:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0341483 s, 307 MB/s 2024-05-03T22:04:11.859 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-03T22:04:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:12 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:12 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:12.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:12 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:12.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:12 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:04:12.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:12 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:04:12.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:12 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:04:12.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:12 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:12.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:12 smithi082 ceph-mon[28404]: Deploying daemon mgr.y on smithi116 2024-05-03T22:04:12.527 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:12 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:12.041+0000 7f496831a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T22:04:12.527 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:12 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:12.150+0000 7f496831a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T22:04:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:12 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:12 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:12 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:12.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:12 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:04:12.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:12 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:04:12.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:12 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:04:12.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:12 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:12.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:12 smithi130 ceph-mon[32417]: Deploying daemon mgr.y on smithi116 2024-05-03T22:04:12.604 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:12 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:12.604 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:12 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:12.604 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:12 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:12.604 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:12 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:04:12.604 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:12 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:04:12.604 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:12 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:04:12.604 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:12 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:12.604 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:12 smithi116 ceph-mon[31828]: Deploying daemon mgr.y on smithi116 2024-05-03T22:04:12.755 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-05-03T22:04:13.190 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:04:13.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:13 smithi082 ceph-mon[28404]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:13.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:13 smithi116 ceph-mon[31828]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:13.714 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:13 smithi130 ceph-mon[32417]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:14.026 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:13 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:13.713+0000 7f496831a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T22:04:14.027 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:13 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:13.934+0000 7f496831a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T22:04:14.435 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:14 smithi116 systemd[1]: Starting Ceph mgr.y for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:04:14.521 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:14 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:14.147+0000 7f496831a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T22:04:14.749 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:14 smithi116 podman[33197]: 2024-05-03 22:04:14.46014401 +0000 UTC m=+0.135964491 container create 13c49b309a19b8f7a5b17af6c166188677e95c1d00e39900283baaceedd254a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-03T22:04:14.749 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:14 smithi116 podman[33197]: 2024-05-03 22:04:14.366121279 +0000 UTC m=+0.041941740 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:04:14.749 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:14 smithi116 podman[33197]: 2024-05-03 22:04:14.746914292 +0000 UTC m=+0.422734833 container init 13c49b309a19b8f7a5b17af6c166188677e95c1d00e39900283baaceedd254a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:04:14.776 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:14 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:14.520+0000 7f496831a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T22:04:14.777 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:14 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:14.640+0000 7f496831a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T22:04:15.016 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:14 smithi116 podman[33197]: 2024-05-03 22:04:14.759162342 +0000 UTC m=+0.434982833 container start 13c49b309a19b8f7a5b17af6c166188677e95c1d00e39900283baaceedd254a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:04:15.016 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:14 smithi116 ceph-mgr[33215]: -- 172.21.15.116:0/2686093266 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d0563665a0 con 0x55d05633ac00 2024-05-03T22:04:15.016 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:14 smithi116 bash[33197]: 13c49b309a19b8f7a5b17af6c166188677e95c1d00e39900283baaceedd254a8 2024-05-03T22:04:15.016 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:14 smithi116 systemd[1]: Started Ceph mgr.y for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:04:15.276 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:14 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:14.890+0000 7f496831a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T22:04:15.277 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:15 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:15.140+0000 7f496831a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:04:15.386 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:15.013+0000 7f54b9bbe200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T22:04:15.386 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:15.256+0000 7f54b9bbe200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:04:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.420+0000 7fce65000700 1 -- 172.21.15.82:0/3641566135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce6010ac30 msgr2=0x7fce6010b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.420+0000 7fce65000700 1 --2- 172.21.15.82:0/3641566135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce6010ac30 0x7fce6010b090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0099c0 tx=0x7fce4c009cd0 comp rx=0 tx=0).stop 2024-05-03T22:04:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.421+0000 7fce65000700 1 -- 172.21.15.82:0/3641566135 shutdown_connections 2024-05-03T22:04:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.421+0000 7fce65000700 1 --2- 172.21.15.82:0/3641566135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce6010b5d0 0x7fce60111e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.421+0000 7fce65000700 1 --2- 172.21.15.82:0/3641566135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce60109a30 0x7fce60109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.421+0000 7fce65000700 1 --2- 172.21.15.82:0/3641566135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce6010ac30 0x7fce6010b090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.421+0000 7fce65000700 1 -- 172.21.15.82:0/3641566135 >> 172.21.15.82:0/3641566135 conn(0x7fce60078a00 msgr2=0x7fce6007ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:04:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.421+0000 7fce65000700 1 -- 172.21.15.82:0/3641566135 shutdown_connections 2024-05-03T22:04:15.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.421+0000 7fce65000700 1 -- 172.21.15.82:0/3641566135 wait complete. 2024-05-03T22:04:15.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.422+0000 7fce65000700 1 Processor -- start 2024-05-03T22:04:15.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.422+0000 7fce65000700 1 -- start start 2024-05-03T22:04:15.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.422+0000 7fce65000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce60109a30 0x7fce6019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.422+0000 7fce65000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce6010ac30 0x7fce601a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.422+0000 7fce65000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce6010b5d0 0x7fce601a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.422+0000 7fce65000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fce60115460 con 0x7fce6010ac30 2024-05-03T22:04:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.422+0000 7fce65000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fce601152e0 con 0x7fce60109a30 2024-05-03T22:04:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.422+0000 7fce65000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fce601155e0 con 0x7fce6010b5d0 2024-05-03T22:04:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.423+0000 7fce5f400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce60109a30 0x7fce6019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.423+0000 7fce5ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce6010ac30 0x7fce601a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.423+0000 7fce5f400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce60109a30 0x7fce6019fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.82:57840/0 (socket says 172.21.15.82:57840) 2024-05-03T22:04:15.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.423+0000 7fce5f400700 1 -- 172.21.15.82:0/4293590241 learned_addr learned my addr 172.21.15.82:0/4293590241 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:04:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.423+0000 7fce5ea00700 1 -- 172.21.15.82:0/4293590241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce6010b5d0 msgr2=0x7fce601a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.423+0000 7fce5ea00700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce6010b5d0 0x7fce601a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.423+0000 7fce5ea00700 1 -- 172.21.15.82:0/4293590241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce60109a30 msgr2=0x7fce6019fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.423+0000 7fce5ea00700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce60109a30 0x7fce6019fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.423+0000 7fce5ea00700 1 -- 172.21.15.82:0/4293590241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce601a7740 con 0x7fce6010ac30 2024-05-03T22:04:15.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.424+0000 7fce5ea00700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce6010ac30 0x7fce601a0020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0036f0 tx=0x7fce4c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:04:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.424+0000 7fce57e00700 1 -- 172.21.15.82:0/4293590241 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c027070 con 0x7fce6010ac30 2024-05-03T22:04:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.424+0000 7fce57e00700 1 -- 172.21.15.82:0/4293590241 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce4c00fe30 con 0x7fce6010ac30 2024-05-03T22:04:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.424+0000 7fce65000700 1 -- 172.21.15.82:0/4293590241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce601a79d0 con 0x7fce6010ac30 2024-05-03T22:04:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.424+0000 7fce57e00700 1 -- 172.21.15.82:0/4293590241 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0173f0 con 0x7fce6010ac30 2024-05-03T22:04:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.424+0000 7fce65000700 1 -- 172.21.15.82:0/4293590241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce601a7f00 con 0x7fce6010ac30 2024-05-03T22:04:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.425+0000 7fce65000700 1 -- 172.21.15.82:0/4293590241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce6006a190 con 0x7fce6010ac30 2024-05-03T22:04:15.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.425+0000 7fce57e00700 1 -- 172.21.15.82:0/4293590241 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fce4c02a070 con 0x7fce6010ac30 2024-05-03T22:04:15.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.426+0000 7fce57e00700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce4403e750 0x7fce44040c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:15.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.426+0000 7fce57e00700 1 -- 172.21.15.82:0/4293590241 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fce4c0537e0 con 0x7fce6010ac30 2024-05-03T22:04:15.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.426+0000 7fce5f400700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce4403e750 0x7fce44040c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:15.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.427+0000 7fce5f400700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce4403e750 0x7fce44040c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fce50009aa0 tx=0x7fce50009240 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:04:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.432+0000 7fce57e00700 1 -- 172.21.15.82:0/4293590241 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fce4c013070 con 0x7fce6010ac30 2024-05-03T22:04:15.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:15.672+0000 7fce65000700 1 -- 172.21.15.82:0/4293590241 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fce600638e0 con 0x7fce4403e750 2024-05-03T22:04:15.684 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:15.384+0000 7f54b9bbe200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T22:04:16.185 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:15.802+0000 7f54b9bbe200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T22:04:16.185 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:15.916+0000 7f54b9bbe200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T22:04:16.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:15 smithi116 ceph-mon[31828]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:16.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:16.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:04:16.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:04:16.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:16.251 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:15 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:15.950+0000 7f496831a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T22:04:16.251 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:16 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:16.250+0000 7f496831a200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T22:04:16.251 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:15 smithi130 ceph-mon[32417]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:16.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:16.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:04:16.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:04:16.252 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:15 smithi082 ceph-mon[28404]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:04:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:04:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:16.952 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:16 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:16.824+0000 7f496831a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T22:04:17.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:16 smithi082 ceph-mon[28404]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:04:17.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:16 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:17.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:16 smithi130 ceph-mon[32417]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:04:17.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:16 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:17.277 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:16 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:16.950+0000 7f496831a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T22:04:17.434 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:16 smithi116 ceph-mon[31828]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:04:17.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:16 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:17.776 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:17 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:17.431+0000 7f496831a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T22:04:17.934 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:17 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:17.562+0000 7f54b9bbe200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T22:04:17.934 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:17 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:17.797+0000 7f54b9bbe200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T22:04:18.219 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:17 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:17.879+0000 7f496831a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T22:04:18.219 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:18 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:17.999+0000 7f496831a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T22:04:18.411 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:18 smithi116 ceph-mon[31828]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:18.411 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.411 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.412 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.412 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.412 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:18 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:18.023+0000 7f54b9bbe200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T22:04:18.412 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:18 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:18.409+0000 7f54b9bbe200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T22:04:18.435 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:18 smithi082 ceph-mon[28404]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:18.435 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.499 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:18 smithi130 ceph-mon[32417]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:18.499 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.499 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.499 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.499 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:18.499 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:18 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:18.319+0000 7f496831a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T22:04:18.499 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:18 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:18.497+0000 7f496831a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T22:04:18.684 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:18 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:18.531+0000 7f54b9bbe200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T22:04:19.059 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:18 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:18.792+0000 7f54b9bbe200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T22:04:19.154 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:18 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:18.879+0000 7f496831a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T22:04:19.154 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:19 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:19.030+0000 7f496831a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T22:04:19.435 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:19 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:19.057+0000 7f54b9bbe200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:04:19.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:19 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:19.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:19 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:19.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:19 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:19.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:19 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:04:19.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:19 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:04:19.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:19 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:19 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:19 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:19 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:19 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:04:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:19 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:04:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:19 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:19.527 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:19 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:19.152+0000 7f496831a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T22:04:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:19 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:19.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:19 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:19.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:19 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:19.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:19 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:04:19.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:19 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:04:19.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:19 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:20.113 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:19 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:19.832+0000 7f54b9bbe200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T22:04:20.195 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:19 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:19.908+0000 7f496831a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T22:04:20.435 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:20 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:20.111+0000 7f54b9bbe200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T22:04:20.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:20.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: Reconfiguring mgr.x (unknown last config time)... 2024-05-03T22:04:20.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: Reconfiguring daemon mgr.x on smithi082 2024-05-03T22:04:20.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3731899554' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "636c5286-4826-4d3b-a79c-cf7abe97433f"}]: dispatch 2024-05-03T22:04:20.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3731899554' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "636c5286-4826-4d3b-a79c-cf7abe97433f"}]': finished 2024-05-03T22:04:20.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: osdmap e5: 1 total, 0 up, 1 in 2024-05-03T22:04:20.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:20.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: Standby manager daemon z started 2024-05-03T22:04:20.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-03T22:04:20.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:04:20.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-03T22:04:20.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:20 smithi116 ceph-mon[31828]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:04:20.526 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:04:20 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z[34380]: 2024-05-03T22:04:20.194+0000 7f496831a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T22:04:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: Reconfiguring mgr.x (unknown last config time)... 2024-05-03T22:04:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: Reconfiguring daemon mgr.x on smithi082 2024-05-03T22:04:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3731899554' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "636c5286-4826-4d3b-a79c-cf7abe97433f"}]: dispatch 2024-05-03T22:04:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3731899554' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "636c5286-4826-4d3b-a79c-cf7abe97433f"}]': finished 2024-05-03T22:04:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: osdmap e5: 1 total, 0 up, 1 in 2024-05-03T22:04:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:20.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: Standby manager daemon z started 2024-05-03T22:04:20.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-03T22:04:20.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:04:20.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-03T22:04:20.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:20 smithi130 ceph-mon[32417]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:04:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: Reconfiguring mgr.x (unknown last config time)... 2024-05-03T22:04:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: Reconfiguring daemon mgr.x on smithi082 2024-05-03T22:04:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3731899554' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "636c5286-4826-4d3b-a79c-cf7abe97433f"}]: dispatch 2024-05-03T22:04:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3731899554' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "636c5286-4826-4d3b-a79c-cf7abe97433f"}]': finished 2024-05-03T22:04:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: osdmap e5: 1 total, 0 up, 1 in 2024-05-03T22:04:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:20.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: Standby manager daemon z started 2024-05-03T22:04:20.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-03T22:04:20.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:04:20.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-03T22:04:20.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:20 smithi082 ceph-mon[28404]: from='mgr.? 172.21.15.130:0/2508604750' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:04:20.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:20.829+0000 7fce57e00700 1 -- 172.21.15.82:0/4293590241 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7fce4c022470 con 0x7fce6010ac30 2024-05-03T22:04:20.935 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:20 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:20.649+0000 7f54b9bbe200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T22:04:20.935 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:20 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:20.774+0000 7f54b9bbe200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T22:04:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:21 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2905650232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:04:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:21 smithi130 ceph-mon[32417]: mgrmap e14: x(active, since 104s), standbys: z 2024-05-03T22:04:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:21 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-03T22:04:21.670 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:21 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:21.228+0000 7f54b9bbe200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T22:04:21.670 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:21 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:21.667+0000 7f54b9bbe200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T22:04:21.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:21 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2905650232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:04:21.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:21 smithi116 ceph-mon[31828]: mgrmap e14: x(active, since 104s), standbys: z 2024-05-03T22:04:21.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:21 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-03T22:04:21.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:21 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2905650232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:04:21.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:21 smithi082 ceph-mon[28404]: mgrmap e14: x(active, since 104s), standbys: z 2024-05-03T22:04:21.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:21 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-03T22:04:21.934 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:21 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:21.787+0000 7f54b9bbe200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T22:04:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:22 smithi116 ceph-mon[31828]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:22.435 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:22 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:22.097+0000 7f54b9bbe200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T22:04:22.435 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:22 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:22.271+0000 7f54b9bbe200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T22:04:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:22 smithi130 ceph-mon[32417]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:22.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:22 smithi082 ceph-mon[28404]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:22.904 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:22 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:22.636+0000 7f54b9bbe200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T22:04:22.905 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:22 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:22.783+0000 7f54b9bbe200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T22:04:22.905 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:22 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:22.902+0000 7f54b9bbe200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T22:04:23.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:23 smithi130 ceph-mon[32417]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:23.653 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:23 smithi116 ceph-mon[31828]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:23.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:23 smithi082 ceph-mon[28404]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:23.935 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:23.651+0000 7f54b9bbe200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T22:04:24.255 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:04:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y[33211]: 2024-05-03T22:04:23.934+0000 7f54b9bbe200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T22:04:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:24.287+0000 7fce57e00700 1 -- 172.21.15.82:0/4293590241 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fce4c0163a0 con 0x7fce6010ac30 2024-05-03T22:04:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:24 smithi130 ceph-mon[32417]: Standby manager daemon y started 2024-05-03T22:04:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:24 smithi130 ceph-mon[32417]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-03T22:04:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:24 smithi130 ceph-mon[32417]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:04:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:24 smithi130 ceph-mon[32417]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-03T22:04:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:24 smithi130 ceph-mon[32417]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:04:24.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:24 smithi082 ceph-mon[28404]: Standby manager daemon y started 2024-05-03T22:04:24.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:24 smithi082 ceph-mon[28404]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-03T22:04:24.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:24 smithi082 ceph-mon[28404]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:04:24.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:24 smithi082 ceph-mon[28404]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-03T22:04:24.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:24 smithi082 ceph-mon[28404]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:04:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:24 smithi116 ceph-mon[31828]: Standby manager daemon y started 2024-05-03T22:04:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:24 smithi116 ceph-mon[31828]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-03T22:04:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:24 smithi116 ceph-mon[31828]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:04:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:24 smithi116 ceph-mon[31828]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-03T22:04:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:24 smithi116 ceph-mon[31828]: from='mgr.? 172.21.15.116:0/2508705768' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:04:25.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:25 smithi082 ceph-mon[28404]: mgrmap e15: x(active, since 107s), standbys: z, y 2024-05-03T22:04:25.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-03T22:04:25.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:25 smithi082 ceph-mon[28404]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:25.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:25 smithi116 ceph-mon[31828]: mgrmap e15: x(active, since 107s), standbys: z, y 2024-05-03T22:04:25.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-03T22:04:25.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:25 smithi116 ceph-mon[31828]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:25.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:25 smithi130 ceph-mon[32417]: mgrmap e15: x(active, since 107s), standbys: z, y 2024-05-03T22:04:25.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-03T22:04:25.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:25 smithi130 ceph-mon[32417]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:27.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:27 smithi082 ceph-mon[28404]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:27.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:27 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:27.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:27 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:27.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:27 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:27.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:27 smithi130 ceph-mon[32417]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:27.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:27 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:27.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:27 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:27.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:27 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:27.872 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:27 smithi116 ceph-mon[31828]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:27.873 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:27 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:27.873 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:27 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:27.873 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:27 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:28.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:28.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:28.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:28.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:28.947 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:28.947 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:30.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:29 smithi130 ceph-mon[32417]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:30.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:29 smithi116 ceph-mon[31828]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:30.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:29 smithi082 ceph-mon[28404]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:31.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:30 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-03T22:04:31.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:30 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:31.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:30 smithi130 ceph-mon[32417]: Deploying daemon osd.0 on smithi082 2024-05-03T22:04:31.079 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:30 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-03T22:04:31.079 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:30 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:31.079 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:30 smithi082 ceph-mon[28404]: Deploying daemon osd.0 on smithi082 2024-05-03T22:04:31.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:30 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-03T22:04:31.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:30 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:31.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:30 smithi116 ceph-mon[31828]: Deploying daemon osd.0 on smithi082 2024-05-03T22:04:32.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:31 smithi130 ceph-mon[32417]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:32.170 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:31 smithi082 ceph-mon[28404]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:32.184 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:31 smithi116 ceph-mon[31828]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:33.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:33 smithi082 ceph-mon[28404]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:34.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:33 smithi130 ceph-mon[32417]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:34.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:33 smithi116 ceph-mon[31828]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:35.900 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:35 smithi082 ceph-mon[28404]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:36.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:35 smithi130 ceph-mon[32417]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:36.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:35 smithi116 ceph-mon[31828]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:37.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:37 smithi082 ceph-mon[28404]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:38.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:37 smithi116 ceph-mon[31828]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:38.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:37 smithi130 ceph-mon[32417]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:39.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:39 smithi116 ceph-mon[31828]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:39.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:39.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:39.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:39.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:39 smithi082 ceph-mon[28404]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:39.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:39.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:39.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:40.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:39 smithi130 ceph-mon[32417]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:40.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:40.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:40.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:41.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:41 smithi082 ceph-mon[28404]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:41.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:41 smithi116 ceph-mon[31828]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:42.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:41 smithi130 ceph-mon[32417]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:43 smithi116 ceph-mon[31828]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-03T22:04:43.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:43.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:43.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:43.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:43.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:43.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:43 smithi082 ceph-mon[28404]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-03T22:04:43.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:43.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:43.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:43.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:43.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:43.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:43 smithi130 ceph-mon[32417]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-03T22:04:43.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.775+0000 7fce57e00700 1 -- 172.21.15.82:0/4293590241 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fce600638e0 con 0x7fce4403e750 2024-05-03T22:04:43.777 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 0 on host 'smithi082' 2024-05-03T22:04:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 -- 172.21.15.82:0/4293590241 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce4403e750 msgr2=0x7fce44040c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce4403e750 0x7fce44040c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fce50009aa0 tx=0x7fce50009240 comp rx=0 tx=0).stop 2024-05-03T22:04:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 -- 172.21.15.82:0/4293590241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce6010ac30 msgr2=0x7fce601a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce6010ac30 0x7fce601a0020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0036f0 tx=0x7fce4c00fa00 comp rx=0 tx=0).stop 2024-05-03T22:04:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 -- 172.21.15.82:0/4293590241 shutdown_connections 2024-05-03T22:04:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fce4403e750 0x7fce44040c10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce6010b5d0 0x7fce601a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce60109a30 0x7fce6019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 --2- 172.21.15.82:0/4293590241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce6010ac30 0x7fce601a0020 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:43.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 -- 172.21.15.82:0/4293590241 >> 172.21.15.82:0/4293590241 conn(0x7fce60078a00 msgr2=0x7fce6010dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:04:43.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 -- 172.21.15.82:0/4293590241 shutdown_connections 2024-05-03T22:04:43.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:04:43.779+0000 7fce65000700 1 -- 172.21.15.82:0/4293590241 wait complete. 2024-05-03T22:04:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:44 smithi116 ceph-mon[31828]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:44 smithi116 ceph-mon[31828]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-03T22:04:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:44 smithi116 ceph-mon[31828]: osdmap e6: 1 total, 0 up, 1 in 2024-05-03T22:04:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:44 smithi116 ceph-mon[31828]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:04:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:44 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:44 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:44.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:44 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:44.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:44 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:44 smithi082 ceph-mon[28404]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:44 smithi082 ceph-mon[28404]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-03T22:04:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:44 smithi082 ceph-mon[28404]: osdmap e6: 1 total, 0 up, 1 in 2024-05-03T22:04:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:44 smithi082 ceph-mon[28404]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:04:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:44 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:44 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:44 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:44 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:44 smithi130 ceph-mon[32417]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:44 smithi130 ceph-mon[32417]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-03T22:04:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:44 smithi130 ceph-mon[32417]: osdmap e6: 1 total, 0 up, 1 in 2024-05-03T22:04:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:44 smithi130 ceph-mon[32417]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:04:44.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:44 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:44.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:44 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:44.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:44 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:44.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:44 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:04:44.670 DEBUG:teuthology.orchestra.run.smithi082:osd.0> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.0.service 2024-05-03T22:04:44.674 INFO:tasks.cephadm:Deploying osd.1 on smithi116 with /dev/vg_nvme/lv_4... 2024-05-03T22:04:44.675 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-03T22:04:45.096 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:04:45.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:45 smithi082 ceph-mon[28404]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:04:45.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:45 smithi082 ceph-mon[28404]: osdmap e7: 1 total, 0 up, 1 in 2024-05-03T22:04:45.200 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:45.200 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:45.393 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:45 smithi116 ceph-mon[31828]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:04:45.393 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:45 smithi116 ceph-mon[31828]: osdmap e7: 1 total, 0 up, 1 in 2024-05-03T22:04:45.393 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:45 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:45.394 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:45 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:45.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:45 smithi130 ceph-mon[32417]: from='osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:04:45.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:45 smithi130 ceph-mon[32417]: osdmap e7: 1 total, 0 up, 1 in 2024-05-03T22:04:45.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:45.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:46.237 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:46 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:04:46.237 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:46 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:04:46.237 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:46 smithi116 ceph-mon[31828]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:46.237 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:46 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:46.238 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:46 smithi116 ceph-mon[31828]: osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646] boot 2024-05-03T22:04:46.238 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:46 smithi116 ceph-mon[31828]: osdmap e8: 1 total, 1 up, 1 in 2024-05-03T22:04:46.238 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:46 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:46 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:04:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:46 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:04:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:46 smithi082 ceph-mon[28404]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:46 smithi082 ceph-mon[28404]: osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646] boot 2024-05-03T22:04:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:46 smithi082 ceph-mon[28404]: osdmap e8: 1 total, 1 up, 1 in 2024-05-03T22:04:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:46 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:04:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:46 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:04:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:46 smithi130 ceph-mon[32417]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:04:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:46 smithi130 ceph-mon[32417]: osd.0 [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646] boot 2024-05-03T22:04:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:46 smithi130 ceph-mon[32417]: osdmap e8: 1 total, 1 up, 1 in 2024-05-03T22:04:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:04:47.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:47 smithi116 ceph-mon[31828]: osdmap e9: 1 total, 1 up, 1 in 2024-05-03T22:04:47.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:47 smithi082 ceph-mon[28404]: osdmap e9: 1 total, 1 up, 1 in 2024-05-03T22:04:47.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:47 smithi130 ceph-mon[32417]: osdmap e9: 1 total, 1 up, 1 in 2024-05-03T22:04:47.717 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-03T22:04:47.717 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-03T22:04:47.717 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2024-05-03T22:04:47.717 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2024-05-03T22:04:47.717 INFO:teuthology.orchestra.run.smithi116.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0364765 s, 287 MB/s 2024-05-03T22:04:47.717 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2024-05-03T22:04:48.372 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:48 smithi116 ceph-mon[31828]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:48 smithi082 ceph-mon[28404]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:48.511 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_4 2024-05-03T22:04:48.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:48 smithi130 ceph-mon[32417]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:48.927 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:04:50.377 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:50 smithi116 ceph-mon[31828]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:50.378 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.378 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.378 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:04:50.378 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.378 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:50.378 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:50.378 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:50 smithi082 ceph-mon[28404]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:50 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:50 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:50 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:50 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:50 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:50 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:50.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:50 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:50 smithi130 ceph-mon[32417]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:50 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:50 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:50 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:04:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:50 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:50 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:50.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:50 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:04:50.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:50 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.827+0000 7fb08cc00700 1 -- 172.21.15.116:0/3392015266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0881050a0 msgr2=0x7fb08810b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.827+0000 7fb08cc00700 1 --2- 172.21.15.116:0/3392015266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0881050a0 0x7fb08810b950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb08000b0d0 tx=0x7fb08000b3e0 comp rx=0 tx=0).stop 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.828+0000 7fb08cc00700 1 -- 172.21.15.116:0/3392015266 shutdown_connections 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.828+0000 7fb08cc00700 1 --2- 172.21.15.116:0/3392015266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0881050a0 0x7fb08810b950 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.828+0000 7fb08cc00700 1 --2- 172.21.15.116:0/3392015266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb088103500 0x7fb088103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.828+0000 7fb08cc00700 1 --2- 172.21.15.116:0/3392015266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb088104700 0x7fb088104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.828+0000 7fb08cc00700 1 -- 172.21.15.116:0/3392015266 >> 172.21.15.116:0/3392015266 conn(0x7fb0880feaa0 msgr2=0x7fb088100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.828+0000 7fb08cc00700 1 -- 172.21.15.116:0/3392015266 shutdown_connections 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.828+0000 7fb08cc00700 1 -- 172.21.15.116:0/3392015266 wait complete. 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.829+0000 7fb08cc00700 1 Processor -- start 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.829+0000 7fb08cc00700 1 -- start start 2024-05-03T22:04:50.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.829+0000 7fb08cc00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb088103500 0x7fb08819b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:50.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.829+0000 7fb08cc00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb088104700 0x7fb08819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:50.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.829+0000 7fb08cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0881050a0 0x7fb0881a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:50.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.829+0000 7fb08cc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb08810eea0 con 0x7fb0881050a0 2024-05-03T22:04:50.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.829+0000 7fb08cc00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb08810ed20 con 0x7fb088103500 2024-05-03T22:04:50.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.829+0000 7fb08cc00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb08810f020 con 0x7fb088104700 2024-05-03T22:04:50.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb085e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb088103500 0x7fb08819b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:50.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb085e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb088103500 0x7fb08819b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:38590/0 (socket says 172.21.15.116:38590) 2024-05-03T22:04:50.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb085e00700 1 -- 172.21.15.116:0/286726618 learned_addr learned my addr 172.21.15.116:0/286726618 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb085400700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb088104700 0x7fb08819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb085e00700 1 -- 172.21.15.116:0/286726618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb088104700 msgr2=0x7fb08819bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb086800700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0881050a0 0x7fb0881a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb085e00700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb088104700 0x7fb08819bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb085e00700 1 -- 172.21.15.116:0/286726618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0881050a0 msgr2=0x7fb0881a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb085e00700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0881050a0 0x7fb0881a2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb085e00700 1 -- 172.21.15.116:0/286726618 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0881a3410 con 0x7fb088103500 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb085e00700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb088103500 0x7fb08819b7b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb07800e950 tx=0x7fb07800ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.830+0000 7fb07ea00700 1 -- 172.21.15.116:0/286726618 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07800cbd0 con 0x7fb088103500 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.831+0000 7fb08cc00700 1 -- 172.21.15.116:0/286726618 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0881a3700 con 0x7fb088103500 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.831+0000 7fb07ea00700 1 -- 172.21.15.116:0/286726618 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0780044c0 con 0x7fb088103500 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.831+0000 7fb07ea00700 1 -- 172.21.15.116:0/286726618 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078003d50 con 0x7fb088103500 2024-05-03T22:04:50.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.831+0000 7fb08cc00700 1 -- 172.21.15.116:0/286726618 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0881a3bf0 con 0x7fb088103500 2024-05-03T22:04:50.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.832+0000 7fb08cc00700 1 -- 172.21.15.116:0/286726618 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08806a190 con 0x7fb088103500 2024-05-03T22:04:50.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.836+0000 7fb07ea00700 1 -- 172.21.15.116:0/286726618 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fb078003f50 con 0x7fb088103500 2024-05-03T22:04:50.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.837+0000 7fb07ea00700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb06c0b2870 0x7fb06c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:04:50.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.838+0000 7fb07ea00700 1 -- 172.21.15.116:0/286726618 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fb0780e0da0 con 0x7fb088103500 2024-05-03T22:04:50.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.838+0000 7fb085400700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb06c0b2870 0x7fb06c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:04:50.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.839+0000 7fb085400700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb06c0b2870 0x7fb06c0b4d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb074005950 tx=0x7fb0740058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:04:50.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:50.841+0000 7fb07ea00700 1 -- 172.21.15.116:0/286726618 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb0780aa490 con 0x7fb088103500 2024-05-03T22:04:51.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:04:51.086+0000 7fb08cc00700 1 -- 172.21.15.116:0/286726618 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb088076df0 con 0x7fb06c0b2870 2024-05-03T22:04:51.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:51 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi082 2024-05-03T22:04:51.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:51 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi082 to 17089M 2024-05-03T22:04:51.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:04:51.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:04:51.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:51.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:51 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi082 2024-05-03T22:04:51.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:51 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi082 to 17089M 2024-05-03T22:04:51.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:04:51.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:04:51.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:51.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:51 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi082 2024-05-03T22:04:51.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:51 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi082 to 17089M 2024-05-03T22:04:51.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:04:51.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:04:51.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:04:52.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:52 smithi130 ceph-mon[32417]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:52.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:52 smithi130 ceph-mon[32417]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:04:52.346 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:52 smithi116 ceph-mon[31828]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:52.347 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:52 smithi116 ceph-mon[31828]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:04:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:52 smithi082 ceph-mon[28404]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:52 smithi082 ceph-mon[28404]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:04:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:54 smithi116 ceph-mon[31828]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:54.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:54 smithi082 ceph-mon[28404]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:54.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:54 smithi130 ceph-mon[32417]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:55.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:55 smithi116 ceph-mon[31828]: from='client.? 172.21.15.116:0/1095187117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41174bd4-ab44-4c4d-9da9-bb2df85f6fd4"}]: dispatch 2024-05-03T22:04:55.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:55 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41174bd4-ab44-4c4d-9da9-bb2df85f6fd4"}]: dispatch 2024-05-03T22:04:55.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:55 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41174bd4-ab44-4c4d-9da9-bb2df85f6fd4"}]': finished 2024-05-03T22:04:55.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:55 smithi116 ceph-mon[31828]: osdmap e10: 2 total, 1 up, 2 in 2024-05-03T22:04:55.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:04:55.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:55 smithi082 ceph-mon[28404]: from='client.? 172.21.15.116:0/1095187117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41174bd4-ab44-4c4d-9da9-bb2df85f6fd4"}]: dispatch 2024-05-03T22:04:55.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:55 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41174bd4-ab44-4c4d-9da9-bb2df85f6fd4"}]: dispatch 2024-05-03T22:04:55.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:55 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41174bd4-ab44-4c4d-9da9-bb2df85f6fd4"}]': finished 2024-05-03T22:04:55.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:55 smithi082 ceph-mon[28404]: osdmap e10: 2 total, 1 up, 2 in 2024-05-03T22:04:55.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:04:55.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:55 smithi130 ceph-mon[32417]: from='client.? 172.21.15.116:0/1095187117' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41174bd4-ab44-4c4d-9da9-bb2df85f6fd4"}]: dispatch 2024-05-03T22:04:55.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:55 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41174bd4-ab44-4c4d-9da9-bb2df85f6fd4"}]: dispatch 2024-05-03T22:04:55.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:55 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41174bd4-ab44-4c4d-9da9-bb2df85f6fd4"}]': finished 2024-05-03T22:04:55.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:55 smithi130 ceph-mon[32417]: osdmap e10: 2 total, 1 up, 2 in 2024-05-03T22:04:55.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:04:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:56 smithi116 ceph-mon[31828]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:56 smithi116 ceph-mon[31828]: from='client.? 172.21.15.116:0/1437559985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:04:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:56 smithi082 ceph-mon[28404]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:56 smithi082 ceph-mon[28404]: from='client.? 172.21.15.116:0/1437559985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:04:56.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:56 smithi130 ceph-mon[32417]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:56.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:56 smithi130 ceph-mon[32417]: from='client.? 172.21.15.116:0/1437559985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:04:58.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:04:58 smithi082 ceph-mon[28404]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:58.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:04:58 smithi130 ceph-mon[32417]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:04:58.684 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:04:58 smithi116 ceph-mon[31828]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:00.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:00 smithi082 ceph-mon[28404]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:00.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:00 smithi130 ceph-mon[32417]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:00.656 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:00 smithi116 ceph-mon[31828]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:02.308 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:02 smithi116 ceph-mon[31828]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:02 smithi082 ceph-mon[28404]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:02.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:02 smithi130 ceph-mon[32417]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:04 smithi082 ceph-mon[28404]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-03T22:05:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:04.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:04 smithi130 ceph-mon[32417]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:04.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-03T22:05:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:04.583 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:04 smithi116 ceph-mon[31828]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:04.583 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-03T22:05:04.583 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:05.408 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:05 smithi116 ceph-mon[31828]: Deploying daemon osd.1 on smithi116 2024-05-03T22:05:05.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:05 smithi082 ceph-mon[28404]: Deploying daemon osd.1 on smithi116 2024-05-03T22:05:05.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:05 smithi130 ceph-mon[32417]: Deploying daemon osd.1 on smithi116 2024-05-03T22:05:06.422 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:06 smithi116 ceph-mon[31828]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:06 smithi082 ceph-mon[28404]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:06.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:06 smithi130 ceph-mon[32417]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:08.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:08 smithi130 ceph-mon[32417]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:08.581 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:08 smithi116 ceph-mon[31828]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:08.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:08 smithi082 ceph-mon[28404]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:10 smithi116 ceph-mon[31828]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:10.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:10 smithi130 ceph-mon[32417]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:10 smithi082 ceph-mon[28404]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:12.485 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:12 smithi116 ceph-mon[31828]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:12.485 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:12 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:12.485 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:12 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:12.485 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:12 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:12 smithi130 ceph-mon[32417]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:12 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:12 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:12 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:12 smithi082 ceph-mon[28404]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:12 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:12 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:12 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:14.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:14 smithi116 ceph-mon[31828]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:14.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:14 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:14.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:14 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:14.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:14 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:14.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:14 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:14.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:14 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:14 smithi130 ceph-mon[32417]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:14 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:14 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:14 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:14 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:14 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:14 smithi082 ceph-mon[28404]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:14 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:14 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:14 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:14.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:14 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:14.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:14 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:15.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.995+0000 7fb07ea00700 1 -- 172.21.15.116:0/286726618 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb088076df0 con 0x7fb06c0b2870 2024-05-03T22:05:15.998 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 1 on host 'smithi116' 2024-05-03T22:05:16.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.998+0000 7fb08cc00700 1 -- 172.21.15.116:0/286726618 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb06c0b2870 msgr2=0x7fb06c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:05:16.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.998+0000 7fb08cc00700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb06c0b2870 0x7fb06c0b4d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb074005950 tx=0x7fb0740058e0 comp rx=0 tx=0).stop 2024-05-03T22:05:16.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.998+0000 7fb08cc00700 1 -- 172.21.15.116:0/286726618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb088103500 msgr2=0x7fb08819b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:05:16.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.998+0000 7fb08cc00700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb088103500 0x7fb08819b7b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb07800e950 tx=0x7fb07800ed10 comp rx=0 tx=0).stop 2024-05-03T22:05:16.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.998+0000 7fb08cc00700 1 -- 172.21.15.116:0/286726618 shutdown_connections 2024-05-03T22:05:16.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.998+0000 7fb08cc00700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb06c0b2870 0x7fb06c0b4d30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:16.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.998+0000 7fb08cc00700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0881050a0 0x7fb0881a2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:16.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.998+0000 7fb08cc00700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb088103500 0x7fb08819b7b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:16.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.998+0000 7fb08cc00700 1 --2- 172.21.15.116:0/286726618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb088104700 0x7fb08819bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:16.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.998+0000 7fb08cc00700 1 -- 172.21.15.116:0/286726618 >> 172.21.15.116:0/286726618 conn(0x7fb0880feaa0 msgr2=0x7fb0880756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:05:16.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.999+0000 7fb08cc00700 1 -- 172.21.15.116:0/286726618 shutdown_connections 2024-05-03T22:05:16.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:05:15.999+0000 7fb08cc00700 1 -- 172.21.15.116:0/286726618 wait complete. 2024-05-03T22:05:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:16 smithi130 ceph-mon[32417]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:16 smithi130 ceph-mon[32417]: from='osd.1 [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:05:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:16 smithi130 ceph-mon[32417]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:05:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:16 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:16 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:16 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:16.676 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:16 smithi116 ceph-mon[31828]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:16.676 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:16 smithi116 ceph-mon[31828]: from='osd.1 [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:05:16.677 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:16 smithi116 ceph-mon[31828]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:05:16.677 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:16 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:16.677 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:16 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:16.677 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:16 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:16.720 DEBUG:teuthology.orchestra.run.smithi116:osd.1> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.1.service 2024-05-03T22:05:16.724 INFO:tasks.cephadm:Deploying osd.2 on smithi130 with /dev/vg_nvme/lv_4... 2024-05-03T22:05:16.724 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-03T22:05:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:16 smithi082 ceph-mon[28404]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:16 smithi082 ceph-mon[28404]: from='osd.1 [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:05:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:16 smithi082 ceph-mon[28404]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:05:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:16 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:16 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:16 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:17.172 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:05:17.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:17 smithi130 ceph-mon[32417]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-03T22:05:17.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:17 smithi130 ceph-mon[32417]: osdmap e11: 2 total, 1 up, 2 in 2024-05-03T22:05:17.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:17.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:17 smithi130 ceph-mon[32417]: from='osd.1 [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:05:17.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:17 smithi130 ceph-mon[32417]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:05:17.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:17 smithi130 ceph-mon[32417]: pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:17.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:17 smithi116 ceph-mon[31828]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-03T22:05:17.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:17 smithi116 ceph-mon[31828]: osdmap e11: 2 total, 1 up, 2 in 2024-05-03T22:05:17.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:17.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:17 smithi116 ceph-mon[31828]: from='osd.1 [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:05:17.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:17 smithi116 ceph-mon[31828]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:05:17.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:17 smithi116 ceph-mon[31828]: pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:17.686 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:05:17 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1[36414]: 2024-05-03T22:05:17.298+0000 7f73c9e00700 -1 osd.1 0 waiting for initial osdmap 2024-05-03T22:05:17.686 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:05:17 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1[36414]: 2024-05-03T22:05:17.307+0000 7f73c4c00700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:05:17.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:17 smithi082 ceph-mon[28404]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-03T22:05:17.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:17 smithi082 ceph-mon[28404]: osdmap e11: 2 total, 1 up, 2 in 2024-05-03T22:05:17.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:17.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:17 smithi082 ceph-mon[28404]: from='osd.1 [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:05:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:17 smithi082 ceph-mon[28404]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:05:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:17 smithi082 ceph-mon[28404]: pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:18.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:18 smithi116 ceph-mon[31828]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:05:18.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:18 smithi116 ceph-mon[31828]: osdmap e12: 2 total, 1 up, 2 in 2024-05-03T22:05:18.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:18.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:18.431 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:18 smithi130 ceph-mon[32417]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:05:18.431 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:18 smithi130 ceph-mon[32417]: osdmap e12: 2 total, 1 up, 2 in 2024-05-03T22:05:18.431 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:18.431 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:18 smithi082 ceph-mon[28404]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:05:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:18 smithi082 ceph-mon[28404]: osdmap e12: 2 total, 1 up, 2 in 2024-05-03T22:05:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:19 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:05:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:19 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:05:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:19 smithi130 ceph-mon[32417]: osd.1 [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608] boot 2024-05-03T22:05:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:19 smithi130 ceph-mon[32417]: osdmap e13: 2 total, 2 up, 2 in 2024-05-03T22:05:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:19 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:19 smithi130 ceph-mon[32417]: pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:19 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:05:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:19 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:05:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:19 smithi116 ceph-mon[31828]: osd.1 [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608] boot 2024-05-03T22:05:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:19 smithi116 ceph-mon[31828]: osdmap e13: 2 total, 2 up, 2 in 2024-05-03T22:05:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:19 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:19 smithi116 ceph-mon[31828]: pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:19 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:05:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:19 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:05:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:19 smithi082 ceph-mon[28404]: osd.1 [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608] boot 2024-05-03T22:05:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:19 smithi082 ceph-mon[28404]: osdmap e13: 2 total, 2 up, 2 in 2024-05-03T22:05:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:19 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:05:19.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:19 smithi082 ceph-mon[28404]: pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:05:19.972 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-03T22:05:19.972 INFO:teuthology.orchestra.run.smithi130.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-03T22:05:19.972 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 10+0 records in 2024-05-03T22:05:19.973 INFO:teuthology.orchestra.run.smithi130.stderr:10+0 records out 2024-05-03T22:05:19.973 INFO:teuthology.orchestra.run.smithi130.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0332371 s, 315 MB/s 2024-05-03T22:05:19.973 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping successful for: 2024-05-03T22:05:20.598 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:20 smithi116 ceph-mon[31828]: osdmap e14: 2 total, 2 up, 2 in 2024-05-03T22:05:20.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:20 smithi082 ceph-mon[28404]: osdmap e14: 2 total, 2 up, 2 in 2024-05-03T22:05:20.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:20 smithi130 ceph-mon[32417]: osdmap e14: 2 total, 2 up, 2 in 2024-05-03T22:05:20.917 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_4 2024-05-03T22:05:21.343 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:05:22.250 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:22 smithi130 ceph-mon[32417]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:22.250 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:22 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi116 2024-05-03T22:05:22.250 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:22.250 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:22.251 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:05:22.251 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:22 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi116 to 17089M 2024-05-03T22:05:22.251 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:22.251 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:22.251 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:22.251 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:22 smithi116 ceph-mon[31828]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:22 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi116 2024-05-03T22:05:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:05:22.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:22 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi116 to 17089M 2024-05-03T22:05:22.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:22.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:22.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:22.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:22 smithi082 ceph-mon[28404]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:22 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi116 2024-05-03T22:05:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:22.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:22.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:05:22.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:22 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi116 to 17089M 2024-05-03T22:05:22.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:22.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:22.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:22.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:23.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.345+0000 7faae6000700 1 -- 172.21.15.130:0/2982685471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faae0104710 msgr2=0x7faae0104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:05:23.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.345+0000 7faae6000700 1 --2- 172.21.15.130:0/2982685471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faae0104710 0x7faae0104b70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faacc009990 tx=0x7faacc009ca0 comp rx=0 tx=0).stop 2024-05-03T22:05:23.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.346+0000 7faae6000700 1 -- 172.21.15.130:0/2982685471 shutdown_connections 2024-05-03T22:05:23.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.346+0000 7faae6000700 1 --2- 172.21.15.130:0/2982685471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0103510 0x7faae0103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:23.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.346+0000 7faae6000700 1 --2- 172.21.15.130:0/2982685471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faae01050b0 0x7faae010b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:23.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.346+0000 7faae6000700 1 --2- 172.21.15.130:0/2982685471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faae0104710 0x7faae0104b70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:23.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.346+0000 7faae6000700 1 -- 172.21.15.130:0/2982685471 >> 172.21.15.130:0/2982685471 conn(0x7faae00feab0 msgr2=0x7faae0100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:05:23.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.346+0000 7faae6000700 1 -- 172.21.15.130:0/2982685471 shutdown_connections 2024-05-03T22:05:23.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.346+0000 7faae6000700 1 -- 172.21.15.130:0/2982685471 wait complete. 2024-05-03T22:05:23.349 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.347+0000 7faae6000700 1 Processor -- start 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.347+0000 7faae6000700 1 -- start start 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.348+0000 7faae6000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faae0103510 0x7faae0077240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.348+0000 7faae6000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0104710 0x7faae0075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.348+0000 7faae6000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faae01050b0 0x7faae0075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.348+0000 7faae6000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faae010eeb0 con 0x7faae0104710 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.348+0000 7faae6000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faae010ed30 con 0x7faae0103510 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.348+0000 7faae6000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faae010f030 con 0x7faae01050b0 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.348+0000 7faadfe00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faae01050b0 0x7faae0075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.348+0000 7faadfe00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faae01050b0 0x7faae0075dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:40018/0 (socket says 172.21.15.130:40018) 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.348+0000 7faadfe00700 1 -- 172.21.15.130:0/117217120 learned_addr learned my addr 172.21.15.130:0/117217120 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.348+0000 7faadea00700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0104710 0x7faae0075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:05:23.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.348+0000 7faadf400700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faae0103510 0x7faae0077240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:05:23.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.349+0000 7faadfe00700 1 -- 172.21.15.130:0/117217120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faae0103510 msgr2=0x7faae0077240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:05:23.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.349+0000 7faadfe00700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faae0103510 0x7faae0077240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:23.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.349+0000 7faadfe00700 1 -- 172.21.15.130:0/117217120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0104710 msgr2=0x7faae0075890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:05:23.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.349+0000 7faadfe00700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0104710 0x7faae0075890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:23.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.349+0000 7faadfe00700 1 -- 172.21.15.130:0/117217120 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae0076680 con 0x7faae01050b0 2024-05-03T22:05:23.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.349+0000 7faadfe00700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faae01050b0 0x7faae0075dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faad8007ee0 tx=0x7faad800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:05:23.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.349+0000 7faad7e00700 1 -- 172.21.15.130:0/117217120 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad800dbd0 con 0x7faae01050b0 2024-05-03T22:05:23.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.349+0000 7faad7e00700 1 -- 172.21.15.130:0/117217120 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faad800dd70 con 0x7faae01050b0 2024-05-03T22:05:23.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.349+0000 7faae6000700 1 -- 172.21.15.130:0/117217120 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae01a36b0 con 0x7faae01050b0 2024-05-03T22:05:23.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.349+0000 7faad7e00700 1 -- 172.21.15.130:0/117217120 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad80058d0 con 0x7faae01050b0 2024-05-03T22:05:23.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.349+0000 7faae6000700 1 -- 172.21.15.130:0/117217120 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae01a3bc0 con 0x7faae01050b0 2024-05-03T22:05:23.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.351+0000 7faae6000700 1 -- 172.21.15.130:0/117217120 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae006a190 con 0x7faae01050b0 2024-05-03T22:05:23.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.355+0000 7faad7e00700 1 -- 172.21.15.130:0/117217120 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7faad801a020 con 0x7faae01050b0 2024-05-03T22:05:23.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.357+0000 7faad7e00700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faac40b27f0 0x7faac40b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:05:23.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.357+0000 7faad7e00700 1 -- 172.21.15.130:0/117217120 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7faad80e08b0 con 0x7faae01050b0 2024-05-03T22:05:23.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.358+0000 7faadf400700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faac40b27f0 0x7faac40b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:05:23.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.359+0000 7faadf400700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faac40b27f0 0x7faac40b4cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faad0005fd0 tx=0x7faad0005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:05:23.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.360+0000 7faad7e00700 1 -- 172.21.15.130:0/117217120 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7faad8010070 con 0x7faae01050b0 2024-05-03T22:05:23.600 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:23.599+0000 7faae6000700 1 -- 172.21.15.130:0/117217120 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7faae00638e0 con 0x7faac40b27f0 2024-05-03T22:05:24.412 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:24 smithi130 ceph-mon[32417]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:24.412 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:05:24.412 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:05:24.412 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:24 smithi116 ceph-mon[31828]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:05:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:05:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:24.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:24 smithi082 ceph-mon[28404]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:24.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:05:24.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:05:24.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:25.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:25 smithi116 ceph-mon[31828]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:05:25.436 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:25 smithi130 ceph-mon[32417]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:05:25.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:25 smithi082 ceph-mon[28404]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:05:26.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:26 smithi130 ceph-mon[32417]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:26 smithi116 ceph-mon[31828]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:26.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:26 smithi082 ceph-mon[28404]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:28 smithi116 ceph-mon[31828]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:28 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/4242707814' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5574fae9-c3b9-48ce-9707-77a85389fded"}]: dispatch 2024-05-03T22:05:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:28 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5574fae9-c3b9-48ce-9707-77a85389fded"}]: dispatch 2024-05-03T22:05:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:28 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5574fae9-c3b9-48ce-9707-77a85389fded"}]': finished 2024-05-03T22:05:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:28 smithi116 ceph-mon[31828]: osdmap e15: 3 total, 2 up, 3 in 2024-05-03T22:05:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:28 smithi082 ceph-mon[28404]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:28 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/4242707814' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5574fae9-c3b9-48ce-9707-77a85389fded"}]: dispatch 2024-05-03T22:05:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:28 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5574fae9-c3b9-48ce-9707-77a85389fded"}]: dispatch 2024-05-03T22:05:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:28 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5574fae9-c3b9-48ce-9707-77a85389fded"}]': finished 2024-05-03T22:05:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:28 smithi082 ceph-mon[28404]: osdmap e15: 3 total, 2 up, 3 in 2024-05-03T22:05:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:28 smithi130 ceph-mon[32417]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:28 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/4242707814' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5574fae9-c3b9-48ce-9707-77a85389fded"}]: dispatch 2024-05-03T22:05:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:28 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5574fae9-c3b9-48ce-9707-77a85389fded"}]: dispatch 2024-05-03T22:05:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:28 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5574fae9-c3b9-48ce-9707-77a85389fded"}]': finished 2024-05-03T22:05:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:28 smithi130 ceph-mon[32417]: osdmap e15: 3 total, 2 up, 3 in 2024-05-03T22:05:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:29.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:29 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/1366501050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:05:29.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:29 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/1366501050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:05:29.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:29 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/1366501050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:05:30.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:30 smithi116 ceph-mon[31828]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:30.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:30 smithi082 ceph-mon[28404]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:30.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:30 smithi130 ceph-mon[32417]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:32.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:32 smithi116 ceph-mon[31828]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:32.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:32 smithi082 ceph-mon[28404]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:32.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:32 smithi130 ceph-mon[32417]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:34.194 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:34 smithi130 ceph-mon[32417]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:34.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:34 smithi116 ceph-mon[31828]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:34.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:34 smithi082 ceph-mon[28404]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:36.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:36 smithi116 ceph-mon[31828]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:36.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-03T22:05:36.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:36.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:36 smithi082 ceph-mon[28404]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:36.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-03T22:05:36.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:36.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:36 smithi130 ceph-mon[32417]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:36.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-03T22:05:36.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:37.365 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:37 smithi130 ceph-mon[32417]: Deploying daemon osd.2 on smithi130 2024-05-03T22:05:37.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:37 smithi116 ceph-mon[31828]: Deploying daemon osd.2 on smithi130 2024-05-03T22:05:37.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:37 smithi082 ceph-mon[28404]: Deploying daemon osd.2 on smithi130 2024-05-03T22:05:38.199 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:38 smithi130 ceph-mon[32417]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:38.387 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:38 smithi116 ceph-mon[31828]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:38 smithi082 ceph-mon[28404]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:40.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:40 smithi130 ceph-mon[32417]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:40.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:40 smithi116 ceph-mon[31828]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:40.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:40 smithi082 ceph-mon[28404]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:42 smithi116 ceph-mon[31828]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:42.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:42 smithi082 ceph-mon[28404]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:42.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:42 smithi130 ceph-mon[32417]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:44.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:44 smithi130 ceph-mon[32417]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:44.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:44 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:44.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:44 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:44 smithi116 ceph-mon[31828]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:44 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:44 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:44 smithi082 ceph-mon[28404]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:44 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:44 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:45.343 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:45 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:45.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:46.368 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:46 smithi130 ceph-mon[32417]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:46 smithi116 ceph-mon[31828]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:46 smithi082 ceph-mon[28404]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:48 smithi116 ceph-mon[31828]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:48 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:48 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:48 smithi116 ceph-mon[31828]: from='osd.2 [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:05:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:48 smithi116 ceph-mon[31828]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:05:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:48 smithi082 ceph-mon[28404]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:48 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:48 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:48 smithi082 ceph-mon[28404]: from='osd.2 [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:05:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:48 smithi082 ceph-mon[28404]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:05:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:48 smithi130 ceph-mon[32417]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:48 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:48 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:48 smithi130 ceph-mon[32417]: from='osd.2 [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:05:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:48 smithi130 ceph-mon[32417]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:05:48.664 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.662+0000 7faad7e00700 1 -- 172.21.15.130:0/117217120 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faae00638e0 con 0x7faac40b27f0 2024-05-03T22:05:48.665 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 2 on host 'smithi130' 2024-05-03T22:05:48.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.666+0000 7faae6000700 1 -- 172.21.15.130:0/117217120 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faac40b27f0 msgr2=0x7faac40b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:05:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.666+0000 7faae6000700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faac40b27f0 0x7faac40b4cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faad0005fd0 tx=0x7faad0005e50 comp rx=0 tx=0).stop 2024-05-03T22:05:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.666+0000 7faae6000700 1 -- 172.21.15.130:0/117217120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faae01050b0 msgr2=0x7faae0075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:05:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.666+0000 7faae6000700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faae01050b0 0x7faae0075dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faad8007ee0 tx=0x7faad800d3b0 comp rx=0 tx=0).stop 2024-05-03T22:05:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.666+0000 7faae6000700 1 -- 172.21.15.130:0/117217120 shutdown_connections 2024-05-03T22:05:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.666+0000 7faae6000700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faac40b27f0 0x7faac40b4cb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.666+0000 7faae6000700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faae01050b0 0x7faae0075dd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.666+0000 7faae6000700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faae0103510 0x7faae0077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.666+0000 7faae6000700 1 --2- 172.21.15.130:0/117217120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae0104710 0x7faae0075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.666+0000 7faae6000700 1 -- 172.21.15.130:0/117217120 >> 172.21.15.130:0/117217120 conn(0x7faae00feab0 msgr2=0x7faae0107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:05:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.667+0000 7faae6000700 1 -- 172.21.15.130:0/117217120 shutdown_connections 2024-05-03T22:05:48.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:05:48.667+0000 7faae6000700 1 -- 172.21.15.130:0/117217120 wait complete. 2024-05-03T22:05:49.430 DEBUG:teuthology.orchestra.run.smithi130:osd.2> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.2.service 2024-05-03T22:05:49.434 INFO:tasks.cephadm:Deploying osd.3 on smithi082 with /dev/vg_nvme/lv_3... 2024-05-03T22:05:49.434 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-03T22:05:49.665 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:49 smithi130 ceph-mon[32417]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-03T22:05:49.665 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:49 smithi130 ceph-mon[32417]: osdmap e16: 3 total, 2 up, 3 in 2024-05-03T22:05:49.665 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:49 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:49.665 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:49 smithi130 ceph-mon[32417]: from='osd.2 [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:05:49.665 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:49 smithi130 ceph-mon[32417]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:05:49.666 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:49 smithi130 ceph-mon[32417]: pgmap v102: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:49.666 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:49 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:49.666 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:49 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:49.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:49 smithi116 ceph-mon[31828]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-03T22:05:49.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:49 smithi116 ceph-mon[31828]: osdmap e16: 3 total, 2 up, 3 in 2024-05-03T22:05:49.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:49 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:49.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:49 smithi116 ceph-mon[31828]: from='osd.2 [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:05:49.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:49 smithi116 ceph-mon[31828]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:05:49.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:49 smithi116 ceph-mon[31828]: pgmap v102: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:49.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:49 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:49.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:49 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:49.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:49 smithi082 ceph-mon[28404]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-03T22:05:49.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:49 smithi082 ceph-mon[28404]: osdmap e16: 3 total, 2 up, 3 in 2024-05-03T22:05:49.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:49 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:49.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:49 smithi082 ceph-mon[28404]: from='osd.2 [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:05:49.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:49 smithi082 ceph-mon[28404]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:05:49.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:49 smithi082 ceph-mon[28404]: pgmap v102: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:49.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:49 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:49.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:49 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:05:50.232 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:05:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2[37675]: 2024-05-03T22:05:50.120+0000 7f9923000700 -1 osd.2 0 waiting for initial osdmap 2024-05-03T22:05:50.232 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:05:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2[37675]: 2024-05-03T22:05:50.139+0000 7f9918e00700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:05:50.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:50 smithi130 ceph-mon[32417]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:05:50.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:50 smithi130 ceph-mon[32417]: osdmap e17: 3 total, 2 up, 3 in 2024-05-03T22:05:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:50 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:50 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:50 smithi130 ceph-mon[32417]: from='osd.2 ' entity='osd.2' 2024-05-03T22:05:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:50 smithi116 ceph-mon[31828]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:05:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:50 smithi116 ceph-mon[31828]: osdmap e17: 3 total, 2 up, 3 in 2024-05-03T22:05:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:50 smithi116 ceph-mon[31828]: from='osd.2 ' entity='osd.2' 2024-05-03T22:05:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:50 smithi082 ceph-mon[28404]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:05:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:50 smithi082 ceph-mon[28404]: osdmap e17: 3 total, 2 up, 3 in 2024-05-03T22:05:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:50 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:50.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:50 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:50.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:50 smithi082 ceph-mon[28404]: from='osd.2 ' entity='osd.2' 2024-05-03T22:05:51.366 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:51 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:05:51.367 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:51 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:05:51.367 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:51.367 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:51 smithi130 ceph-mon[32417]: pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:51.367 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:51 smithi130 ceph-mon[32417]: osd.2 [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365] boot 2024-05-03T22:05:51.367 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:51 smithi130 ceph-mon[32417]: osdmap e18: 3 total, 3 up, 3 in 2024-05-03T22:05:51.367 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:51.610 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:51 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:05:51.610 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:51 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:05:51.610 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:51.611 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:51 smithi082 ceph-mon[28404]: pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:51.611 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:51 smithi082 ceph-mon[28404]: osd.2 [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365] boot 2024-05-03T22:05:51.611 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:51 smithi082 ceph-mon[28404]: osdmap e18: 3 total, 3 up, 3 in 2024-05-03T22:05:51.611 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:51.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:51 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:05:51.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:51 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:05:51.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:51.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:51 smithi116 ceph-mon[31828]: pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:05:51.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:51 smithi116 ceph-mon[31828]: osd.2 [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365] boot 2024-05-03T22:05:51.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:51 smithi116 ceph-mon[31828]: osdmap e18: 3 total, 3 up, 3 in 2024-05-03T22:05:51.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:05:52.967 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-03T22:05:52.967 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-03T22:05:52.968 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-03T22:05:52.968 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-03T22:05:52.968 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0359527 s, 292 MB/s 2024-05-03T22:05:52.968 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 2024-05-03T22:05:52.968 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-03T22:05:53.523 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:53 smithi130 ceph-mon[32417]: osdmap e19: 3 total, 3 up, 3 in 2024-05-03T22:05:53.523 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:53 smithi130 ceph-mon[32417]: pgmap v107: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:05:53.523 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:53 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:05:53.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:53 smithi116 ceph-mon[31828]: osdmap e19: 3 total, 3 up, 3 in 2024-05-03T22:05:53.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:53 smithi116 ceph-mon[31828]: pgmap v107: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:05:53.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:53 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:05:53.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:53 smithi082 ceph-mon[28404]: osdmap e19: 3 total, 3 up, 3 in 2024-05-03T22:05:53.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:53 smithi082 ceph-mon[28404]: pgmap v107: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:05:53.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:05:53.894 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-05-03T22:05:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:05:54.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-03T22:05:54.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: osdmap e20: 3 total, 3 up, 3 in 2024-05-03T22:05:54.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:05:54.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi130 2024-05-03T22:05:54.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:05:54.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi130 to 17089M 2024-05-03T22:05:54.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:54.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:54.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-03T22:05:54.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: osdmap e20: 3 total, 3 up, 3 in 2024-05-03T22:05:54.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:05:54.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi130 2024-05-03T22:05:54.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:05:54.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi130 to 17089M 2024-05-03T22:05:54.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:54.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:54.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.703 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44968]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:05:54.703 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44968]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:54.703 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44968]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:54.703 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44968]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:54.703 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44987]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:05:54.703 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44987]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:54.703 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44987]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:54.703 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44987]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:54.772 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-03T22:05:54.772 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: osdmap e20: 3 total, 3 up, 3 in 2024-05-03T22:05:54.772 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:05:54.772 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi130 2024-05-03T22:05:54.772 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.773 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.773 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:05:54.773 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi130 to 17089M 2024-05-03T22:05:54.773 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.773 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:54.773 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:54.773 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:54.935 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:05:54 smithi116 sudo[40445]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:05:54.935 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:05:54 smithi116 sudo[40445]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:54.935 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:05:54 smithi116 sudo[40445]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:54.935 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:05:54 smithi116 sudo[40445]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:54.935 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:05:54 smithi116 sudo[40464]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:05:54.935 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:05:54 smithi116 sudo[40464]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:54.935 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:05:54 smithi116 sudo[40464]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:54.935 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:05:54 smithi116 sudo[40464]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:54.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44997]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:05:54.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44997]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:54.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44997]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:54.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 sudo[44997]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:55.023 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 sudo[41794]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:05:55.023 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:05:54 smithi130 sudo[41783]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:05:55.023 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:05:54 smithi130 sudo[41783]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:55.023 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:05:54 smithi130 sudo[41783]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:55.023 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:05:54 smithi130 sudo[41783]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:55.023 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:05:54 smithi130 sudo[41791]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:05:55.024 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:05:54 smithi130 sudo[41791]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:55.024 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:05:54 smithi130 sudo[41791]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:55.024 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:05:54 smithi130 sudo[41791]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:55.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 sudo[45010]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:05:55.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 sudo[45010]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:55.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 sudo[45010]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:55.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:54 smithi082 sudo[45010]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:55.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 sudo[41794]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:55.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 sudo[41794]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:55.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 sudo[41794]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:55.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 sudo[41797]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:05:55.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 sudo[41797]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:55.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 sudo[41797]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:55.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 sudo[41797]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:55.373 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 sudo[40467]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:05:55.374 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 sudo[40467]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:55.374 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 sudo[40467]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:55.374 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 sudo[40467]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:55.374 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 sudo[40470]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:05:55.374 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 sudo[40470]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:05:55.374 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 sudo[40470]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:05:55.374 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 sudo[40470]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:05:55.374 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-03T22:05:55.374 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: osdmap e21: 3 total, 3 up, 3 in 2024-05-03T22:05:55.374 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:55.374 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: pgmap v110: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:05:55.375 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:05:55.376 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:05:55.376 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:05:55.376 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:05:55.376 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:05:55.376 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:05:55.376 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:55 smithi116 ceph-mon[31828]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:05:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-03T22:05:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: osdmap e21: 3 total, 3 up, 3 in 2024-05-03T22:05:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: pgmap v110: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:05:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:05:55.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:05:55.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:05:55.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:55 smithi082 ceph-mon[28404]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:05:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: osdmap e21: 3 total, 3 up, 3 in 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: pgmap v110: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:05:55.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:05:55.780 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:55 smithi130 ceph-mon[32417]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:05:56.582 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:56 smithi082 ceph-mon[28404]: osdmap e22: 3 total, 3 up, 3 in 2024-05-03T22:05:56.583 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:56 smithi082 ceph-mon[28404]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-03T22:05:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:56 smithi116 ceph-mon[31828]: osdmap e22: 3 total, 3 up, 3 in 2024-05-03T22:05:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:56 smithi116 ceph-mon[31828]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-03T22:05:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.752+0000 7f7fd2e00700 1 -- 172.21.15.82:0/4126134341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc1072e0 msgr2=0x7f7fcc10db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:05:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.752+0000 7f7fd2e00700 1 --2- 172.21.15.82:0/4126134341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc1072e0 0x7f7fcc10db90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400b0d0 tx=0x7f7fc400b3e0 comp rx=0 tx=0).stop 2024-05-03T22:05:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.752+0000 7f7fd2e00700 1 -- 172.21.15.82:0/4126134341 shutdown_connections 2024-05-03T22:05:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.752+0000 7f7fd2e00700 1 --2- 172.21.15.82:0/4126134341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc1072e0 0x7f7fcc10db90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:56.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.752+0000 7f7fd2e00700 1 --2- 172.21.15.82:0/4126134341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fcc105740 0x7f7fcc105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:56.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.752+0000 7f7fd2e00700 1 --2- 172.21.15.82:0/4126134341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fcc106940 0x7f7fcc106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:56.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.752+0000 7f7fd2e00700 1 -- 172.21.15.82:0/4126134341 >> 172.21.15.82:0/4126134341 conn(0x7f7fcc100d00 msgr2=0x7f7fcc103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:05:56.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.752+0000 7f7fd2e00700 1 -- 172.21.15.82:0/4126134341 shutdown_connections 2024-05-03T22:05:56.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.752+0000 7f7fd2e00700 1 -- 172.21.15.82:0/4126134341 wait complete. 2024-05-03T22:05:56.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.753+0000 7f7fd2e00700 1 Processor -- start 2024-05-03T22:05:56.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.753+0000 7f7fd2e00700 1 -- start start 2024-05-03T22:05:56.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.754+0000 7f7fd2e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc105740 0x7f7fcc19b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:05:56.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.754+0000 7f7fd2e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fcc106940 0x7f7fcc19bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:05:56.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.754+0000 7f7fd2e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fcc1072e0 0x7f7fcc1a2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:05:56.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.754+0000 7f7fd2e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc111090 con 0x7f7fcc105740 2024-05-03T22:05:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.754+0000 7f7fd2e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc110f10 con 0x7f7fcc106940 2024-05-03T22:05:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.754+0000 7f7fd2e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc111210 con 0x7f7fcc1072e0 2024-05-03T22:05:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.754+0000 7f7fcbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc105740 0x7f7fcc19b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:05:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.754+0000 7f7fcbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc105740 0x7f7fcc19b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55534/0 (socket says 172.21.15.82:55534) 2024-05-03T22:05:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.754+0000 7f7fcbe00700 1 -- 172.21.15.82:0/3950591567 learned_addr learned my addr 172.21.15.82:0/3950591567 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:05:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fcbe00700 1 -- 172.21.15.82:0/3950591567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fcc1072e0 msgr2=0x7f7fcc1a2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:05:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fcbe00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fcc1072e0 0x7f7fcc1a2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fc3e00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fcc106940 0x7f7fcc19bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:05:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fcbe00700 1 -- 172.21.15.82:0/3950591567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fcc106940 msgr2=0x7f7fcc19bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:05:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fcbe00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fcc106940 0x7f7fcc19bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:05:56.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fcbe00700 1 -- 172.21.15.82:0/3950591567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc1a3360 con 0x7f7fcc105740 2024-05-03T22:05:56.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fcbe00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc105740 0x7f7fcc19b700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00d9b0 tx=0x7f7fbc00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:05:56.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fc9600700 1 -- 172.21.15.82:0/3950591567 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc016070 con 0x7f7fcc105740 2024-05-03T22:05:56.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fc9600700 1 -- 172.21.15.82:0/3950591567 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fbc010460 con 0x7f7fcc105740 2024-05-03T22:05:56.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fd2e00700 1 -- 172.21.15.82:0/3950591567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc1a3650 con 0x7f7fcc105740 2024-05-03T22:05:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fc9600700 1 -- 172.21.15.82:0/3950591567 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc007e60 con 0x7f7fcc105740 2024-05-03T22:05:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.755+0000 7f7fd2e00700 1 -- 172.21.15.82:0/3950591567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc1a3be0 con 0x7f7fcc105740 2024-05-03T22:05:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.757+0000 7f7fd2e00700 1 -- 172.21.15.82:0/3950591567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fcc06a190 con 0x7f7fcc105740 2024-05-03T22:05:56.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.759+0000 7f7fc9600700 1 -- 172.21.15.82:0/3950591567 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7fbc019070 con 0x7f7fcc105740 2024-05-03T22:05:56.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.760+0000 7f7fc9600700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7fb00b2900 0x7f7fb00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:05:56.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.761+0000 7f7fc9600700 1 -- 172.21.15.82:0/3950591567 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3237+0+0 (secure 0 0 0) 0x7f7fbc0e0a40 con 0x7f7fcc105740 2024-05-03T22:05:56.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.761+0000 7f7fc3e00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7fb00b2900 0x7f7fb00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:05:56.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.761+0000 7f7fc3e00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7fb00b2900 0x7f7fb00b4dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4005fd0 tx=0x7f7fb4005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:05:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:56.765+0000 7f7fc9600700 1 -- 172.21.15.82:0/3950591567 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7fbc020030 con 0x7f7fcc105740 2024-05-03T22:05:56.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:56 smithi130 ceph-mon[32417]: osdmap e22: 3 total, 3 up, 3 in 2024-05-03T22:05:56.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:56 smithi130 ceph-mon[32417]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-03T22:05:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:05:57.007+0000 7f7fd2e00700 1 -- 172.21.15.82:0/3950591567 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7fcc0638e0 con 0x7f7fb00b2900 2024-05-03T22:05:57.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:57 smithi116 ceph-mon[31828]: pgmap v112: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:05:57.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:57 smithi116 ceph-mon[31828]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:05:57.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:05:57.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:05:57.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:57.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:57 smithi082 ceph-mon[28404]: pgmap v112: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:05:57.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:57 smithi082 ceph-mon[28404]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:05:57.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:05:57.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:05:57.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:57.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:57 smithi130 ceph-mon[32417]: pgmap v112: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:05:57.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:57 smithi130 ceph-mon[32417]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:05:57.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:05:57.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:05:57.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:05:59.793 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:05:59 smithi082 ceph-mon[28404]: pgmap v113: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:05:59.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:05:59 smithi116 ceph-mon[31828]: pgmap v113: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:05:59 smithi130 ceph-mon[32417]: pgmap v113: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:01.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:01 smithi116 ceph-mon[31828]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:01.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:01 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/681656496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6729dc19-766c-480a-ac53-3bf94391fef1"}]: dispatch 2024-05-03T22:06:01.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:01 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/681656496' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6729dc19-766c-480a-ac53-3bf94391fef1"}]': finished 2024-05-03T22:06:01.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:01 smithi116 ceph-mon[31828]: osdmap e23: 4 total, 3 up, 4 in 2024-05-03T22:06:01.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:01 smithi082 ceph-mon[28404]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:01 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/681656496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6729dc19-766c-480a-ac53-3bf94391fef1"}]: dispatch 2024-05-03T22:06:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:01 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/681656496' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6729dc19-766c-480a-ac53-3bf94391fef1"}]': finished 2024-05-03T22:06:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:01 smithi082 ceph-mon[28404]: osdmap e23: 4 total, 3 up, 4 in 2024-05-03T22:06:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:02.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:01 smithi130 ceph-mon[32417]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:02.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:01 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/681656496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6729dc19-766c-480a-ac53-3bf94391fef1"}]: dispatch 2024-05-03T22:06:02.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:01 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/681656496' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6729dc19-766c-480a-ac53-3bf94391fef1"}]': finished 2024-05-03T22:06:02.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:01 smithi130 ceph-mon[32417]: osdmap e23: 4 total, 3 up, 4 in 2024-05-03T22:06:02.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:02.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:02 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3059439104' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:06:02.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:02 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3059439104' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:06:03.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:02 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3059439104' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:06:03.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:03 smithi116 ceph-mon[31828]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:03.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:03 smithi082 ceph-mon[28404]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:04.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:03 smithi130 ceph-mon[32417]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:05.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:05 smithi082 ceph-mon[28404]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:05.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:05 smithi116 ceph-mon[31828]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:06.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:05 smithi130 ceph-mon[32417]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:07.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:07 smithi116 ceph-mon[31828]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:07.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:07 smithi082 ceph-mon[28404]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:08.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:07 smithi130 ceph-mon[32417]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:09.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:09 smithi116 ceph-mon[31828]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:09.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:09 smithi082 ceph-mon[28404]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:10.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:09 smithi130 ceph-mon[32417]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:11.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:11 smithi082 ceph-mon[28404]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:11.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:11 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-03T22:06:11.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:11 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:11.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:11 smithi082 ceph-mon[28404]: Deploying daemon osd.3 on smithi082 2024-05-03T22:06:11.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:11 smithi116 ceph-mon[31828]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:11.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:11 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-03T22:06:11.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:11 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:11.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:11 smithi116 ceph-mon[31828]: Deploying daemon osd.3 on smithi082 2024-05-03T22:06:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:11 smithi130 ceph-mon[32417]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:11 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-03T22:06:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:11 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:11 smithi130 ceph-mon[32417]: Deploying daemon osd.3 on smithi082 2024-05-03T22:06:13.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:13 smithi082 ceph-mon[28404]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:13 smithi116 ceph-mon[31828]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:14.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:13 smithi130 ceph-mon[32417]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:15.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:15 smithi082 ceph-mon[28404]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:15.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:15 smithi116 ceph-mon[31828]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:16.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:15 smithi130 ceph-mon[32417]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:17.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:17 smithi116 ceph-mon[31828]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:17.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:17 smithi082 ceph-mon[28404]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:18.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:17 smithi130 ceph-mon[32417]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:19 smithi082 ceph-mon[28404]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:19.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:19 smithi116 ceph-mon[31828]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:20.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:19 smithi130 ceph-mon[32417]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:20.887 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:20.887 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:06:20.887 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:21.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:21.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:06:21.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:21.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:21.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:06:21.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:21.965 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:21 smithi130 ceph-mon[32417]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:21.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:21 smithi082 ceph-mon[28404]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:22.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:21 smithi116 ceph-mon[31828]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:24 smithi116 ceph-mon[31828]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:24 smithi116 ceph-mon[31828]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-03T22:06:24.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:24 smithi082 ceph-mon[28404]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:24.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:24.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:24.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:24 smithi082 ceph-mon[28404]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-03T22:06:24.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:24 smithi130 ceph-mon[32417]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:24 smithi130 ceph-mon[32417]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-03T22:06:25.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.349+0000 7f7fc9600700 1 -- 172.21.15.82:0/3950591567 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7fcc0638e0 con 0x7f7fb00b2900 2024-05-03T22:06:25.353 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 3 on host 'smithi082' 2024-05-03T22:06:25.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.353+0000 7f7fd2e00700 1 -- 172.21.15.82:0/3950591567 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7fb00b2900 msgr2=0x7f7fb00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:06:25.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.353+0000 7f7fd2e00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7fb00b2900 0x7f7fb00b4dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4005fd0 tx=0x7f7fb4005ee0 comp rx=0 tx=0).stop 2024-05-03T22:06:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.353+0000 7f7fd2e00700 1 -- 172.21.15.82:0/3950591567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc105740 msgr2=0x7f7fcc19b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:06:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.353+0000 7f7fd2e00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc105740 0x7f7fcc19b700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00d9b0 tx=0x7f7fbc00dd70 comp rx=0 tx=0).stop 2024-05-03T22:06:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.353+0000 7f7fd2e00700 1 -- 172.21.15.82:0/3950591567 shutdown_connections 2024-05-03T22:06:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.353+0000 7f7fd2e00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7fb00b2900 0x7f7fb00b4dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.354+0000 7f7fd2e00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc105740 0x7f7fcc19b700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.354+0000 7f7fd2e00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fcc1072e0 0x7f7fcc1a2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.354+0000 7f7fd2e00700 1 --2- 172.21.15.82:0/3950591567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fcc106940 0x7f7fcc19bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.354+0000 7f7fd2e00700 1 -- 172.21.15.82:0/3950591567 >> 172.21.15.82:0/3950591567 conn(0x7f7fcc100d00 msgr2=0x7f7fcc109d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:06:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.354+0000 7f7fd2e00700 1 -- 172.21.15.82:0/3950591567 shutdown_connections 2024-05-03T22:06:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:06:25.354+0000 7f7fd2e00700 1 -- 172.21.15.82:0/3950591567 wait complete. 2024-05-03T22:06:25.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:25 smithi082 ceph-mon[28404]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-03T22:06:25.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:25 smithi082 ceph-mon[28404]: osdmap e24: 4 total, 3 up, 4 in 2024-05-03T22:06:25.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:25 smithi082 ceph-mon[28404]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:06:25.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:25.376 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:25.376 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:06:25.376 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:25.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:25 smithi116 ceph-mon[31828]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-03T22:06:25.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:25 smithi116 ceph-mon[31828]: osdmap e24: 4 total, 3 up, 4 in 2024-05-03T22:06:25.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:25 smithi116 ceph-mon[31828]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:06:25.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:25.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:25.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:06:25.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:25.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:25 smithi130 ceph-mon[32417]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-03T22:06:25.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:25 smithi130 ceph-mon[32417]: osdmap e24: 4 total, 3 up, 4 in 2024-05-03T22:06:25.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:25 smithi130 ceph-mon[32417]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:06:25.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:25.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:25.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:06:25.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:26.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:26 smithi082 ceph-mon[28404]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:26.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:26 smithi082 ceph-mon[28404]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:06:26.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:26 smithi082 ceph-mon[28404]: osdmap e25: 4 total, 3 up, 4 in 2024-05-03T22:06:26.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:26 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:26.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:26 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:26.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:26 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:06:26.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:26 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:26.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:26 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:26 smithi116 ceph-mon[31828]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:26 smithi116 ceph-mon[31828]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:06:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:26 smithi116 ceph-mon[31828]: osdmap e25: 4 total, 3 up, 4 in 2024-05-03T22:06:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:26 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:26 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:26 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:06:26.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:26 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:26.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:26 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:26.450 DEBUG:teuthology.orchestra.run.smithi082:osd.3> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.3.service 2024-05-03T22:06:26.455 INFO:tasks.cephadm:Deploying osd.4 on smithi116 with /dev/vg_nvme/lv_3... 2024-05-03T22:06:26.456 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-03T22:06:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:26 smithi130 ceph-mon[32417]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:26 smithi130 ceph-mon[32417]: from='osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:06:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:26 smithi130 ceph-mon[32417]: osdmap e25: 4 total, 3 up, 4 in 2024-05-03T22:06:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:26 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:26 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:26 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:06:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:26 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:26.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:26 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:26.892 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:06:27.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:27 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:06:27.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:27 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:06:27.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:27 smithi116 ceph-mon[31828]: osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809] boot 2024-05-03T22:06:27.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:27 smithi116 ceph-mon[31828]: osdmap e26: 4 total, 4 up, 4 in 2024-05-03T22:06:27.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:27 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:27.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:27 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:06:27.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:27 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:06:27.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:27 smithi082 ceph-mon[28404]: osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809] boot 2024-05-03T22:06:27.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:27 smithi082 ceph-mon[28404]: osdmap e26: 4 total, 4 up, 4 in 2024-05-03T22:06:27.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:27 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:27.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:27 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:06:27.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:27 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:06:27.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:27 smithi130 ceph-mon[32417]: osd.3 [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809] boot 2024-05-03T22:06:27.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:27 smithi130 ceph-mon[32417]: osdmap e26: 4 total, 4 up, 4 in 2024-05-03T22:06:27.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:27 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:06:28.390 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:28 smithi082 ceph-mon[28404]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:28.391 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:28 smithi082 ceph-mon[28404]: osdmap e27: 4 total, 4 up, 4 in 2024-05-03T22:06:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:28 smithi116 ceph-mon[31828]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:28 smithi116 ceph-mon[31828]: osdmap e27: 4 total, 4 up, 4 in 2024-05-03T22:06:28.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:28 smithi130 ceph-mon[32417]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:06:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:28 smithi130 ceph-mon[32417]: osdmap e27: 4 total, 4 up, 4 in 2024-05-03T22:06:29.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:29 smithi116 ceph-mon[31828]: osdmap e28: 4 total, 4 up, 4 in 2024-05-03T22:06:29.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:29 smithi082 ceph-mon[28404]: osdmap e28: 4 total, 4 up, 4 in 2024-05-03T22:06:29.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:29 smithi130 ceph-mon[32417]: osdmap e28: 4 total, 4 up, 4 in 2024-05-03T22:06:29.835 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-03T22:06:29.835 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-03T22:06:29.835 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2024-05-03T22:06:29.836 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2024-05-03T22:06:29.836 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0332893 s, 315 MB/s 2024-05-03T22:06:29.836 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2024-05-03T22:06:30.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:30 smithi116 ceph-mon[31828]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:30.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:30 smithi082 ceph-mon[28404]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:30.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:30 smithi130 ceph-mon[32417]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:30.659 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_3 2024-05-03T22:06:31.074 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:06:32.246 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:32 smithi116 ceph-mon[31828]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-05-03T22:06:32.246 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:32.246 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:32.246 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:06:32.246 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:06:32.247 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:32.247 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:32.247 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:06:32.247 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:32.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:32 smithi082 ceph-mon[28404]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-05-03T22:06:32.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:32.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:32.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:06:32.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:06:32.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:32.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:32.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:06:32.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:32 smithi130 ceph-mon[32417]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-05-03T22:06:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:06:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:06:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:06:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:33.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.089+0000 7f0722200700 1 -- 172.21.15.116:0/2795801597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f071c1071e0 msgr2=0x7f071c10da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:06:33.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.089+0000 7f0722200700 1 --2- 172.21.15.116:0/2795801597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f071c1071e0 0x7f071c10da90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f071400b0d0 tx=0x7f071400b3e0 comp rx=0 tx=0).stop 2024-05-03T22:06:33.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.089+0000 7f0722200700 1 -- 172.21.15.116:0/2795801597 shutdown_connections 2024-05-03T22:06:33.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.089+0000 7f0722200700 1 --2- 172.21.15.116:0/2795801597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f071c105640 0x7f071c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:33.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.089+0000 7f0722200700 1 --2- 172.21.15.116:0/2795801597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f071c1071e0 0x7f071c10da90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:33.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.089+0000 7f0722200700 1 --2- 172.21.15.116:0/2795801597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f071c106840 0x7f071c106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:33.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.089+0000 7f0722200700 1 -- 172.21.15.116:0/2795801597 >> 172.21.15.116:0/2795801597 conn(0x7f071c100be0 msgr2=0x7f071c103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:06:33.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.089+0000 7f0722200700 1 -- 172.21.15.116:0/2795801597 shutdown_connections 2024-05-03T22:06:33.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.089+0000 7f0722200700 1 -- 172.21.15.116:0/2795801597 wait complete. 2024-05-03T22:06:33.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.090+0000 7f0722200700 1 Processor -- start 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.090+0000 7f0722200700 1 -- start start 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.091+0000 7f0722200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f071c105640 0x7f071c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.091+0000 7f0722200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f071c106840 0x7f071c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.091+0000 7f0722200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f071c1071e0 0x7f071c1a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.091+0000 7f0722200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f071c110f70 con 0x7f071c105640 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.091+0000 7f0722200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f071c110df0 con 0x7f071c1071e0 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.091+0000 7f0722200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f071c1110f0 con 0x7f071c106840 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.091+0000 7f0721800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f071c1071e0 0x7f071c1a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.091+0000 7f0721800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f071c1071e0 0x7f071c1a2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:39450/0 (socket says 172.21.15.116:39450) 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.091+0000 7f0721800700 1 -- 172.21.15.116:0/3490136878 learned_addr learned my addr 172.21.15.116:0/3490136878 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.091+0000 7f0720e00700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f071c105640 0x7f071c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:06:33.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.091+0000 7f071be00700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f071c106840 0x7f071c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:06:33.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.092+0000 7f0721800700 1 -- 172.21.15.116:0/3490136878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f071c106840 msgr2=0x7f071c19ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:06:33.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.092+0000 7f0721800700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f071c106840 0x7f071c19ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:33.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.092+0000 7f0721800700 1 -- 172.21.15.116:0/3490136878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f071c105640 msgr2=0x7f071c19b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:06:33.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.092+0000 7f0721800700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f071c105640 0x7f071c19b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:33.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.092+0000 7f0721800700 1 -- 172.21.15.116:0/3490136878 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071c1a3120 con 0x7f071c1071e0 2024-05-03T22:06:33.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.092+0000 7f071be00700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f071c106840 0x7f071c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:06:33.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.092+0000 7f0721800700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f071c1071e0 0x7f071c1a2a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0714004fd0 tx=0x7f071400bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:06:33.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.092+0000 7f0719600700 1 -- 172.21.15.116:0/3490136878 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071401f030 con 0x7f071c1071e0 2024-05-03T22:06:33.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.092+0000 7f0719600700 1 -- 172.21.15.116:0/3490136878 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0714007bc0 con 0x7f071c1071e0 2024-05-03T22:06:33.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.092+0000 7f0719600700 1 -- 172.21.15.116:0/3490136878 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071401b670 con 0x7f071c1071e0 2024-05-03T22:06:33.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.092+0000 7f0722200700 1 -- 172.21.15.116:0/3490136878 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f071c1a33b0 con 0x7f071c1071e0 2024-05-03T22:06:33.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.093+0000 7f0722200700 1 -- 172.21.15.116:0/3490136878 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f071c1a3750 con 0x7f071c1071e0 2024-05-03T22:06:33.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.094+0000 7f0722200700 1 -- 172.21.15.116:0/3490136878 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f071c06a190 con 0x7f071c1071e0 2024-05-03T22:06:33.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.096+0000 7f0719600700 1 -- 172.21.15.116:0/3490136878 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0714005040 con 0x7f071c1071e0 2024-05-03T22:06:33.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.098+0000 7f0719600700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f07040b2900 0x7f07040b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:06:33.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.098+0000 7f0719600700 1 -- 172.21.15.116:0/3490136878 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7f07140e2430 con 0x7f071c1071e0 2024-05-03T22:06:33.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.098+0000 7f0720e00700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f07040b2900 0x7f07040b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:06:33.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.099+0000 7f0720e00700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f07040b2900 0x7f07040b4dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0710005fd0 tx=0x7f0710005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:06:33.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.103+0000 7f0719600700 1 -- 172.21.15.116:0/3490136878 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f07140ab360 con 0x7f071c1071e0 2024-05-03T22:06:33.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:33 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi082 2024-05-03T22:06:33.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:33 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi082 to 8544M 2024-05-03T22:06:33.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:33.344+0000 7f0722200700 1 -- 172.21.15.116:0/3490136878 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f071c0638e0 con 0x7f07040b2900 2024-05-03T22:06:33.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:33 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi082 2024-05-03T22:06:33.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:33 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi082 to 8544M 2024-05-03T22:06:33.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:33 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi082 2024-05-03T22:06:33.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:33 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi082 to 8544M 2024-05-03T22:06:34.449 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:34 smithi116 ceph-mon[31828]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-03T22:06:34.449 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:34 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:06:34.449 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:34 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:06:34.449 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:34 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:34.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:34 smithi082 ceph-mon[28404]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-03T22:06:34.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:34 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:06:34.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:34 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:06:34.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:34 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:34.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:34 smithi130 ceph-mon[32417]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-03T22:06:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:34 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:06:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:34 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:06:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:34 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:35.309 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:35 smithi116 ceph-mon[31828]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:06:35.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:35 smithi082 ceph-mon[28404]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:06:35.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:35 smithi130 ceph-mon[32417]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:06:36.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:36 smithi116 ceph-mon[31828]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:06:36.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:36 smithi082 ceph-mon[28404]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:06:36.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:36 smithi130 ceph-mon[32417]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:06:37.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:37 smithi082 ceph-mon[28404]: from='client.? 172.21.15.116:0/4097789491' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f1a58f6-d55b-4ea5-895c-68109a8e02ca"}]: dispatch 2024-05-03T22:06:37.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:37 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f1a58f6-d55b-4ea5-895c-68109a8e02ca"}]: dispatch 2024-05-03T22:06:37.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:37 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f1a58f6-d55b-4ea5-895c-68109a8e02ca"}]': finished 2024-05-03T22:06:37.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:37 smithi082 ceph-mon[28404]: osdmap e29: 5 total, 4 up, 5 in 2024-05-03T22:06:37.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:06:37.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:37 smithi130 ceph-mon[32417]: from='client.? 172.21.15.116:0/4097789491' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f1a58f6-d55b-4ea5-895c-68109a8e02ca"}]: dispatch 2024-05-03T22:06:37.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:37 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f1a58f6-d55b-4ea5-895c-68109a8e02ca"}]: dispatch 2024-05-03T22:06:37.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:37 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f1a58f6-d55b-4ea5-895c-68109a8e02ca"}]': finished 2024-05-03T22:06:37.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:37 smithi130 ceph-mon[32417]: osdmap e29: 5 total, 4 up, 5 in 2024-05-03T22:06:37.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:06:37.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:37 smithi116 ceph-mon[31828]: from='client.? 172.21.15.116:0/4097789491' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f1a58f6-d55b-4ea5-895c-68109a8e02ca"}]: dispatch 2024-05-03T22:06:37.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:37 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f1a58f6-d55b-4ea5-895c-68109a8e02ca"}]: dispatch 2024-05-03T22:06:37.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:37 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f1a58f6-d55b-4ea5-895c-68109a8e02ca"}]': finished 2024-05-03T22:06:37.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:37 smithi116 ceph-mon[31828]: osdmap e29: 5 total, 4 up, 5 in 2024-05-03T22:06:37.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:06:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:38 smithi082 ceph-mon[28404]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-03T22:06:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:38 smithi082 ceph-mon[28404]: from='client.? 172.21.15.116:0/2164637557' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:06:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:38 smithi130 ceph-mon[32417]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-03T22:06:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:38 smithi130 ceph-mon[32417]: from='client.? 172.21.15.116:0/2164637557' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:06:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:38 smithi116 ceph-mon[31828]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-03T22:06:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:38 smithi116 ceph-mon[31828]: from='client.? 172.21.15.116:0/2164637557' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:06:40.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:40 smithi116 ceph-mon[31828]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:06:40.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:40 smithi130 ceph-mon[32417]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:06:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:40 smithi082 ceph-mon[28404]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:06:42.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:42 smithi116 ceph-mon[31828]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:42.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:42 smithi130 ceph-mon[32417]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:42.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:42 smithi082 ceph-mon[28404]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:44 smithi116 ceph-mon[31828]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:44.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:44 smithi130 ceph-mon[32417]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:44.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:44 smithi082 ceph-mon[28404]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:46 smithi116 ceph-mon[31828]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:46 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-03T22:06:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:46 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:46 smithi130 ceph-mon[32417]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-03T22:06:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:46 smithi082 ceph-mon[28404]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-03T22:06:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:06:47.401 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:47 smithi116 ceph-mon[31828]: Deploying daemon osd.4 on smithi116 2024-05-03T22:06:47.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:47 smithi130 ceph-mon[32417]: Deploying daemon osd.4 on smithi116 2024-05-03T22:06:47.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:47 smithi082 ceph-mon[28404]: Deploying daemon osd.4 on smithi116 2024-05-03T22:06:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:48 smithi116 ceph-mon[31828]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:48.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:48 smithi130 ceph-mon[32417]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:48.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:48 smithi082 ceph-mon[28404]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:50 smithi130 ceph-mon[32417]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:50 smithi116 ceph-mon[31828]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:50 smithi082 ceph-mon[28404]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:51.657 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:51 smithi116 ceph-mon[31828]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:51.714 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:51 smithi130 ceph-mon[32417]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:51.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:51 smithi082 ceph-mon[28404]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:53.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:53 smithi116 ceph-mon[31828]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:53.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:53 smithi082 ceph-mon[28404]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:54.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:53 smithi130 ceph-mon[32417]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:55.529 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:55.529 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:06:55.529 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:55.529 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:55 smithi116 ceph-mon[31828]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:55.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:55.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:06:55.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:55.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:55 smithi082 ceph-mon[28404]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:06:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:55 smithi130 ceph-mon[32417]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:57.684 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:57 smithi116 ceph-mon[31828]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:57.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:57 smithi082 ceph-mon[28404]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:58.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:57 smithi130 ceph-mon[32417]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:06:58.855 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:58 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:58.856 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:58 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:58.856 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:58 smithi116 ceph-mon[31828]: from='osd.4 [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:06:58.856 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:58 smithi116 ceph-mon[31828]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:06:58.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.965+0000 7f0719600700 1 -- 172.21.15.116:0/3490136878 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f071c0638e0 con 0x7f07040b2900 2024-05-03T22:06:58.968 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 4 on host 'smithi116' 2024-05-03T22:06:58.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.968+0000 7f0722200700 1 -- 172.21.15.116:0/3490136878 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f07040b2900 msgr2=0x7f07040b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:06:58.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.968+0000 7f0722200700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f07040b2900 0x7f07040b4dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0710005fd0 tx=0x7f0710005e50 comp rx=0 tx=0).stop 2024-05-03T22:06:58.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.968+0000 7f0722200700 1 -- 172.21.15.116:0/3490136878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f071c1071e0 msgr2=0x7f071c1a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:06:58.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.968+0000 7f0722200700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f071c1071e0 0x7f071c1a2a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0714004fd0 tx=0x7f071400bd60 comp rx=0 tx=0).stop 2024-05-03T22:06:58.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.968+0000 7f0722200700 1 -- 172.21.15.116:0/3490136878 shutdown_connections 2024-05-03T22:06:58.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.968+0000 7f0722200700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f07040b2900 0x7f07040b4dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:58.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.968+0000 7f0722200700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f071c105640 0x7f071c19b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:58.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.968+0000 7f0722200700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f071c1071e0 0x7f071c1a2a80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:58.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.968+0000 7f0722200700 1 --2- 172.21.15.116:0/3490136878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f071c106840 0x7f071c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:06:58.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.968+0000 7f0722200700 1 -- 172.21.15.116:0/3490136878 >> 172.21.15.116:0/3490136878 conn(0x7f071c100be0 msgr2=0x7f071c109a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:06:58.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.969+0000 7f0722200700 1 -- 172.21.15.116:0/3490136878 shutdown_connections 2024-05-03T22:06:58.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:06:58.969+0000 7f0722200700 1 -- 172.21.15.116:0/3490136878 wait complete. 2024-05-03T22:06:58.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:58 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:58.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:58 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:58.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:58 smithi082 ceph-mon[28404]: from='osd.4 [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:06:58.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:58 smithi082 ceph-mon[28404]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:06:59.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:58 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:59.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:58 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:06:59.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:58 smithi130 ceph-mon[32417]: from='osd.4 [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:06:59.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:58 smithi130 ceph-mon[32417]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:06:59.704 DEBUG:teuthology.orchestra.run.smithi116:osd.4> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.4.service 2024-05-03T22:06:59.708 INFO:tasks.cephadm:Deploying osd.5 on smithi130 with /dev/vg_nvme/lv_3... 2024-05-03T22:06:59.709 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-03T22:06:59.739 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:59 smithi116 ceph-mon[31828]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:07:00.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:59 smithi130 ceph-mon[32417]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:07:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:59 smithi130 ceph-mon[32417]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-03T22:07:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:59 smithi130 ceph-mon[32417]: osdmap e30: 5 total, 4 up, 5 in 2024-05-03T22:07:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:59 smithi130 ceph-mon[32417]: from='osd.4 [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:07:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:59 smithi130 ceph-mon[32417]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:07:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:06:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:00.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:59 smithi116 ceph-mon[31828]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-03T22:07:00.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:59 smithi116 ceph-mon[31828]: osdmap e30: 5 total, 4 up, 5 in 2024-05-03T22:07:00.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:00.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:59 smithi116 ceph-mon[31828]: from='osd.4 [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:07:00.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:59 smithi116 ceph-mon[31828]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:07:00.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:00.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:06:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:00.154 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:07:00.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:59 smithi082 ceph-mon[28404]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:07:00.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:59 smithi082 ceph-mon[28404]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-03T22:07:00.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:59 smithi082 ceph-mon[28404]: osdmap e30: 5 total, 4 up, 5 in 2024-05-03T22:07:00.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:00.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:59 smithi082 ceph-mon[28404]: from='osd.4 [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:07:00.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:59 smithi082 ceph-mon[28404]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:07:00.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:00.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:06:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:01.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:00 smithi130 ceph-mon[32417]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:07:01.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:00 smithi130 ceph-mon[32417]: osdmap e31: 5 total, 4 up, 5 in 2024-05-03T22:07:01.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:00 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:01.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:00 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:01.124 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:00 smithi116 ceph-mon[31828]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:07:01.125 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:00 smithi116 ceph-mon[31828]: osdmap e31: 5 total, 4 up, 5 in 2024-05-03T22:07:01.125 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:00 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:01.125 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:00 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:01.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:00 smithi082 ceph-mon[28404]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:07:01.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:00 smithi082 ceph-mon[28404]: osdmap e31: 5 total, 4 up, 5 in 2024-05-03T22:07:01.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:00 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:01.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:00 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:01.958 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:01 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:07:01.959 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:01 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:07:01.959 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:01 smithi130 ceph-mon[32417]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:07:01.959 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:01 smithi130 ceph-mon[32417]: osd.4 [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667] boot 2024-05-03T22:07:01.959 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:01 smithi130 ceph-mon[32417]: osdmap e32: 5 total, 5 up, 5 in 2024-05-03T22:07:01.959 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:02.128 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:01 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:07:02.128 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:01 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:07:02.128 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:01 smithi082 ceph-mon[28404]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:07:02.128 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:01 smithi082 ceph-mon[28404]: osd.4 [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667] boot 2024-05-03T22:07:02.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:01 smithi082 ceph-mon[28404]: osdmap e32: 5 total, 5 up, 5 in 2024-05-03T22:07:02.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:02.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:01 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:07:02.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:01 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:07:02.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:01 smithi116 ceph-mon[31828]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:07:02.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:01 smithi116 ceph-mon[31828]: osd.4 [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667] boot 2024-05-03T22:07:02.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:01 smithi116 ceph-mon[31828]: osdmap e32: 5 total, 5 up, 5 in 2024-05-03T22:07:02.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:07:02.846 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-03T22:07:02.846 INFO:teuthology.orchestra.run.smithi130.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-03T22:07:02.846 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 10+0 records in 2024-05-03T22:07:02.846 INFO:teuthology.orchestra.run.smithi130.stderr:10+0 records out 2024-05-03T22:07:02.846 INFO:teuthology.orchestra.run.smithi130.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0318914 s, 329 MB/s 2024-05-03T22:07:02.846 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping successful for: 2024-05-03T22:07:03.156 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:02 smithi082 ceph-mon[28404]: osdmap e33: 5 total, 5 up, 5 in 2024-05-03T22:07:03.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:02 smithi116 ceph-mon[31828]: osdmap e33: 5 total, 5 up, 5 in 2024-05-03T22:07:03.239 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:02 smithi130 ceph-mon[32417]: osdmap e33: 5 total, 5 up, 5 in 2024-05-03T22:07:03.640 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_3 2024-05-03T22:07:04.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:03 smithi130 ceph-mon[32417]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:04.075 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:07:04.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:03 smithi116 ceph-mon[31828]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:04.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:03 smithi082 ceph-mon[28404]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:05.489 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi116 2024-05-03T22:07:05.489 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.489 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.489 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:05.489 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:05.489 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi116 to 8544M 2024-05-03T22:07:05.489 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.490 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:05.490 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:05.490 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.490 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:05.490 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:07:05.490 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:05.490 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:05.490 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi116 2024-05-03T22:07:05.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi116 to 8544M 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:05.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi116 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi116 to 8544M 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:05.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:06.266 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.265+0000 7fee6ac00700 1 -- 172.21.15.130:0/1734582095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee64106940 msgr2=0x7fee64106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:07:06.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.265+0000 7fee6ac00700 1 --2- 172.21.15.130:0/1734582095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee64106940 0x7fee64106da0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fee50009990 tx=0x7fee50009ca0 comp rx=0 tx=0).stop 2024-05-03T22:07:06.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.265+0000 7fee6ac00700 1 -- 172.21.15.130:0/1734582095 shutdown_connections 2024-05-03T22:07:06.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.265+0000 7fee6ac00700 1 --2- 172.21.15.130:0/1734582095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee64105740 0x7fee64105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:06.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.265+0000 7fee6ac00700 1 --2- 172.21.15.130:0/1734582095 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee641072e0 0x7fee6410db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:06.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.265+0000 7fee6ac00700 1 --2- 172.21.15.130:0/1734582095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee64106940 0x7fee64106da0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:06.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.265+0000 7fee6ac00700 1 -- 172.21.15.130:0/1734582095 >> 172.21.15.130:0/1734582095 conn(0x7fee64100d00 msgr2=0x7fee64103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:07:06.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.265+0000 7fee6ac00700 1 -- 172.21.15.130:0/1734582095 shutdown_connections 2024-05-03T22:07:06.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.265+0000 7fee6ac00700 1 -- 172.21.15.130:0/1734582095 wait complete. 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.266+0000 7fee6ac00700 1 Processor -- start 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.266+0000 7fee6ac00700 1 -- start start 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.267+0000 7fee6ac00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee64105740 0x7fee6419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.267+0000 7fee6ac00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee64106940 0x7fee6419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.267+0000 7fee6ac00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee641072e0 0x7fee641a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.267+0000 7fee6ac00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fee641110e0 con 0x7fee64106940 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.267+0000 7fee6ac00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fee64110f60 con 0x7fee64105740 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.267+0000 7fee6ac00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fee64111260 con 0x7fee641072e0 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.267+0000 7fee68c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee641072e0 0x7fee641a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.267+0000 7fee68c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee641072e0 0x7fee641a2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57852/0 (socket says 172.21.15.130:57852) 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.267+0000 7fee68c00700 1 -- 172.21.15.130:0/927994052 learned_addr learned my addr 172.21.15.130:0/927994052 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-05-03T22:07:06.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.267+0000 7fee63e00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee64105740 0x7fee6419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:07:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.267+0000 7fee63400700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee64106940 0x7fee6419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:07:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.268+0000 7fee68c00700 1 -- 172.21.15.130:0/927994052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee64105740 msgr2=0x7fee6419b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:07:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.268+0000 7fee68c00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee64105740 0x7fee6419b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.268+0000 7fee68c00700 1 -- 172.21.15.130:0/927994052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee64106940 msgr2=0x7fee6419bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:07:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.268+0000 7fee68c00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee64106940 0x7fee6419bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.268+0000 7fee68c00700 1 -- 172.21.15.130:0/927994052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee641a3410 con 0x7fee641072e0 2024-05-03T22:07:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.268+0000 7fee63400700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee64106940 0x7fee6419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:07:06.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.268+0000 7fee68c00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee641072e0 0x7fee641a2d70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee5c007f10 tx=0x7fee5c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:07:06.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.268+0000 7fee60c00700 1 -- 172.21.15.130:0/927994052 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c004bb0 con 0x7fee641072e0 2024-05-03T22:07:06.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.268+0000 7fee6ac00700 1 -- 172.21.15.130:0/927994052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee641a3700 con 0x7fee641072e0 2024-05-03T22:07:06.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.268+0000 7fee60c00700 1 -- 172.21.15.130:0/927994052 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee5c004d50 con 0x7fee641072e0 2024-05-03T22:07:06.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.268+0000 7fee60c00700 1 -- 172.21.15.130:0/927994052 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c005970 con 0x7fee641072e0 2024-05-03T22:07:06.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.269+0000 7fee6ac00700 1 -- 172.21.15.130:0/927994052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee641a3c40 con 0x7fee641072e0 2024-05-03T22:07:06.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.270+0000 7fee6ac00700 1 -- 172.21.15.130:0/927994052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee6406a190 con 0x7fee641072e0 2024-05-03T22:07:06.273 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.272+0000 7fee60c00700 1 -- 172.21.15.130:0/927994052 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fee5c01a020 con 0x7fee641072e0 2024-05-03T22:07:06.276 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.274+0000 7fee60c00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fee480b2880 0x7fee480b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:07:06.276 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.275+0000 7fee60c00700 1 -- 172.21.15.130:0/927994052 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7fee5c0e1070 con 0x7fee641072e0 2024-05-03T22:07:06.276 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.275+0000 7fee63e00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fee480b2880 0x7fee480b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:07:06.277 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.276+0000 7fee63e00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fee480b2880 0x7fee480b4d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fee54005950 tx=0x7fee540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:07:06.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.278+0000 7fee60c00700 1 -- 172.21.15.130:0/927994052 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fee5c010070 con 0x7fee641072e0 2024-05-03T22:07:06.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:06.519+0000 7fee6ac00700 1 -- 172.21.15.130:0/927994052 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fee640638e0 con 0x7fee480b2880 2024-05-03T22:07:06.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:07:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:07:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:06.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:07:06.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:07:06.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:06.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:07:06.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:07:06.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:07.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:07 smithi130 ceph-mon[32417]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:07.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:07 smithi130 ceph-mon[32417]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:07:07.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:07 smithi116 ceph-mon[31828]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:07.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:07 smithi116 ceph-mon[31828]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:07:07.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:07 smithi082 ceph-mon[28404]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:07.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:07 smithi082 ceph-mon[28404]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:07:09.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:09 smithi116 ceph-mon[31828]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:09.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:09 smithi082 ceph-mon[28404]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:10.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:09 smithi130 ceph-mon[32417]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:10.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:10 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/3770534544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0445007b-3edb-4501-b9b6-9e6a5ccfc2fa"}]: dispatch 2024-05-03T22:07:10.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:10 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0445007b-3edb-4501-b9b6-9e6a5ccfc2fa"}]: dispatch 2024-05-03T22:07:10.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:10 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0445007b-3edb-4501-b9b6-9e6a5ccfc2fa"}]': finished 2024-05-03T22:07:10.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:10 smithi116 ceph-mon[31828]: osdmap e34: 6 total, 5 up, 6 in 2024-05-03T22:07:10.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:10 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:10.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:10 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/3770534544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0445007b-3edb-4501-b9b6-9e6a5ccfc2fa"}]: dispatch 2024-05-03T22:07:10.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:10 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0445007b-3edb-4501-b9b6-9e6a5ccfc2fa"}]: dispatch 2024-05-03T22:07:10.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:10 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0445007b-3edb-4501-b9b6-9e6a5ccfc2fa"}]': finished 2024-05-03T22:07:10.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:10 smithi082 ceph-mon[28404]: osdmap e34: 6 total, 5 up, 6 in 2024-05-03T22:07:10.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:10 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:11.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:10 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/3770534544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0445007b-3edb-4501-b9b6-9e6a5ccfc2fa"}]: dispatch 2024-05-03T22:07:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:10 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0445007b-3edb-4501-b9b6-9e6a5ccfc2fa"}]: dispatch 2024-05-03T22:07:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:10 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0445007b-3edb-4501-b9b6-9e6a5ccfc2fa"}]': finished 2024-05-03T22:07:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:10 smithi130 ceph-mon[32417]: osdmap e34: 6 total, 5 up, 6 in 2024-05-03T22:07:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:10 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:11.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:11 smithi116 ceph-mon[31828]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:11.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:11 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/3465968970' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:07:11.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:11 smithi082 ceph-mon[28404]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:11.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:11 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/3465968970' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:07:12.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:11 smithi130 ceph-mon[32417]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:11 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/3465968970' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:07:13.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:13 smithi130 ceph-mon[32417]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:13 smithi116 ceph-mon[31828]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:13.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:13 smithi082 ceph-mon[28404]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:15.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:15 smithi116 ceph-mon[31828]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:15.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:15 smithi082 ceph-mon[28404]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:16.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:15 smithi130 ceph-mon[32417]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:17.738 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:17 smithi130 ceph-mon[32417]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:17.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:17 smithi116 ceph-mon[31828]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:17.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:17 smithi082 ceph-mon[28404]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:19.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:19 smithi116 ceph-mon[31828]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:19.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:19 smithi082 ceph-mon[28404]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:20.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:19 smithi130 ceph-mon[32417]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:20.934 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-03T22:07:20.934 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:20.934 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:20 smithi130 ceph-mon[32417]: Deploying daemon osd.5 on smithi130 2024-05-03T22:07:20.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-03T22:07:20.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:20.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:20 smithi116 ceph-mon[31828]: Deploying daemon osd.5 on smithi130 2024-05-03T22:07:20.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-03T22:07:20.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:20.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:20 smithi082 ceph-mon[28404]: Deploying daemon osd.5 on smithi130 2024-05-03T22:07:21.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:21 smithi116 ceph-mon[31828]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:21.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:21 smithi082 ceph-mon[28404]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:22.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:21 smithi130 ceph-mon[32417]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:23.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:23 smithi130 ceph-mon[32417]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:23.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:23 smithi116 ceph-mon[31828]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:23 smithi082 ceph-mon[28404]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:25.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:25 smithi116 ceph-mon[31828]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:25.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:25 smithi082 ceph-mon[28404]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:26.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:25 smithi130 ceph-mon[32417]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:27.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:27 smithi116 ceph-mon[31828]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:27.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:27 smithi082 ceph-mon[28404]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:28.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:27 smithi130 ceph-mon[32417]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:29.094 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:29.094 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:29.094 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:07:29.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:29.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:29.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:07:29.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:29.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:29.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:07:30.148 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:29 smithi130 ceph-mon[32417]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:30.184 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:29 smithi116 ceph-mon[31828]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:30.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:29 smithi082 ceph-mon[28404]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:32.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:31 smithi116 ceph-mon[31828]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:32.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:32.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:32.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:32.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:32.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:32.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:31 smithi116 ceph-mon[31828]: from='osd.5 [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:07:32.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:31 smithi116 ceph-mon[31828]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:07:32.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:31 smithi082 ceph-mon[28404]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:32.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:32.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:32.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:32.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:32.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:32.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:31 smithi082 ceph-mon[28404]: from='osd.5 [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:07:32.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:31 smithi082 ceph-mon[28404]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:07:32.229 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:31 smithi130 ceph-mon[32417]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:32.229 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:32.229 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:32.229 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:32.229 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:32.229 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:32.229 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:31 smithi130 ceph-mon[32417]: from='osd.5 [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:07:32.229 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:31 smithi130 ceph-mon[32417]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:07:32.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.680+0000 7fee60c00700 1 -- 172.21.15.130:0/927994052 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fee640638e0 con 0x7fee480b2880 2024-05-03T22:07:32.683 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 5 on host 'smithi130' 2024-05-03T22:07:32.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.683+0000 7fee6ac00700 1 -- 172.21.15.130:0/927994052 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fee480b2880 msgr2=0x7fee480b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:07:32.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.683+0000 7fee6ac00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fee480b2880 0x7fee480b4d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fee54005950 tx=0x7fee540058e0 comp rx=0 tx=0).stop 2024-05-03T22:07:32.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.683+0000 7fee6ac00700 1 -- 172.21.15.130:0/927994052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee641072e0 msgr2=0x7fee641a2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:07:32.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.683+0000 7fee6ac00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee641072e0 0x7fee641a2d70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee5c007f10 tx=0x7fee5c00d3b0 comp rx=0 tx=0).stop 2024-05-03T22:07:32.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.684+0000 7fee6ac00700 1 -- 172.21.15.130:0/927994052 shutdown_connections 2024-05-03T22:07:32.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.684+0000 7fee6ac00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fee480b2880 0x7fee480b4d40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:32.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.684+0000 7fee6ac00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee641072e0 0x7fee641a2d70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:32.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.684+0000 7fee6ac00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee64105740 0x7fee6419b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:32.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.684+0000 7fee6ac00700 1 --2- 172.21.15.130:0/927994052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee64106940 0x7fee6419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:32.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.684+0000 7fee6ac00700 1 -- 172.21.15.130:0/927994052 >> 172.21.15.130:0/927994052 conn(0x7fee64100d00 msgr2=0x7fee64109cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:07:32.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.684+0000 7fee6ac00700 1 -- 172.21.15.130:0/927994052 shutdown_connections 2024-05-03T22:07:32.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:07:32.684+0000 7fee6ac00700 1 -- 172.21.15.130:0/927994052 wait complete. 2024-05-03T22:07:33.426 DEBUG:teuthology.orchestra.run.smithi130:osd.5> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.5.service 2024-05-03T22:07:33.430 INFO:tasks.cephadm:Deploying osd.6 on smithi082 with /dev/vg_nvme/lv_2... 2024-05-03T22:07:33.431 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-03T22:07:33.680 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:33 smithi130 ceph-mon[32417]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-03T22:07:33.680 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:33 smithi130 ceph-mon[32417]: osdmap e35: 6 total, 5 up, 6 in 2024-05-03T22:07:33.680 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:33 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:33.680 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:33 smithi130 ceph-mon[32417]: from='osd.5 [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:07:33.680 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:33 smithi130 ceph-mon[32417]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:07:33.680 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:33 smithi130 ceph-mon[32417]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:33.680 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:33 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:33.680 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:33 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:33.680 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:33 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:07:33.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:33 smithi082 ceph-mon[28404]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-03T22:07:33.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:33 smithi082 ceph-mon[28404]: osdmap e35: 6 total, 5 up, 6 in 2024-05-03T22:07:33.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:33.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:33 smithi082 ceph-mon[28404]: from='osd.5 [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:07:33.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:33 smithi082 ceph-mon[28404]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:07:33.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:33 smithi082 ceph-mon[28404]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:33.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:33.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:33.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:07:33.866 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:07:33.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:33 smithi116 ceph-mon[31828]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-03T22:07:33.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:33 smithi116 ceph-mon[31828]: osdmap e35: 6 total, 5 up, 6 in 2024-05-03T22:07:33.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:33 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:33.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:33 smithi116 ceph-mon[31828]: from='osd.5 [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:07:33.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:33 smithi116 ceph-mon[31828]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:07:33.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:33 smithi116 ceph-mon[31828]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:33.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:33 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:33.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:33 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:33.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:33 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:07:34.574 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:34 smithi082 ceph-mon[28404]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:07:34.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:34 smithi082 ceph-mon[28404]: osdmap e36: 6 total, 5 up, 6 in 2024-05-03T22:07:34.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:34 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:34.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:34 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:34.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:34 smithi082 ceph-mon[28404]: osdmap e37: 6 total, 5 up, 6 in 2024-05-03T22:07:34.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:34 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:34.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:34 smithi082 ceph-mon[28404]: from='osd.5 ' entity='osd.5' 2024-05-03T22:07:34.738 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:34 smithi130 ceph-mon[32417]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:07:34.738 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:34 smithi130 ceph-mon[32417]: osdmap e36: 6 total, 5 up, 6 in 2024-05-03T22:07:34.738 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:34 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:34.738 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:34 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:34.738 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:34 smithi130 ceph-mon[32417]: osdmap e37: 6 total, 5 up, 6 in 2024-05-03T22:07:34.738 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:34 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:34.739 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:34 smithi130 ceph-mon[32417]: from='osd.5 ' entity='osd.5' 2024-05-03T22:07:34.739 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:07:34 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:07:34.273+0000 7f38e4e00700 -1 osd.5 0 waiting for initial osdmap 2024-05-03T22:07:34.739 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:07:34 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:07:34.296+0000 7f38dac00700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:07:34.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:34 smithi116 ceph-mon[31828]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:07:34.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:34 smithi116 ceph-mon[31828]: osdmap e36: 6 total, 5 up, 6 in 2024-05-03T22:07:34.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:34 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:34.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:34 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:34.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:34 smithi116 ceph-mon[31828]: osdmap e37: 6 total, 5 up, 6 in 2024-05-03T22:07:34.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:34 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:34.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:34 smithi116 ceph-mon[31828]: from='osd.5 ' entity='osd.5' 2024-05-03T22:07:35.715 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:35 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:07:35.715 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:35 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:07:35.715 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:35 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:35.715 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:35 smithi130 ceph-mon[32417]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:35.716 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:35 smithi130 ceph-mon[32417]: osd.5 [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455] boot 2024-05-03T22:07:35.716 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:35 smithi130 ceph-mon[32417]: osdmap e38: 6 total, 6 up, 6 in 2024-05-03T22:07:35.716 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:35 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:35.756 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:35 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:07:35.756 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:35 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:07:35.757 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:35 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:35.757 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:35 smithi082 ceph-mon[28404]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:35.757 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:35 smithi082 ceph-mon[28404]: osd.5 [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455] boot 2024-05-03T22:07:35.757 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:35 smithi082 ceph-mon[28404]: osdmap e38: 6 total, 6 up, 6 in 2024-05-03T22:07:35.757 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:35 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:35 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:07:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:35 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:07:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:35 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:35 smithi116 ceph-mon[31828]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:07:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:35 smithi116 ceph-mon[31828]: osd.5 [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455] boot 2024-05-03T22:07:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:35 smithi116 ceph-mon[31828]: osdmap e38: 6 total, 6 up, 6 in 2024-05-03T22:07:35.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:35 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:07:36.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:36 smithi082 ceph-mon[28404]: osdmap e39: 6 total, 6 up, 6 in 2024-05-03T22:07:37.031 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-03T22:07:37.031 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-03T22:07:37.031 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-03T22:07:37.031 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-03T22:07:37.031 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0505544 s, 207 MB/s 2024-05-03T22:07:37.032 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-03T22:07:37.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:36 smithi116 ceph-mon[31828]: osdmap e39: 6 total, 6 up, 6 in 2024-05-03T22:07:37.188 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:36 smithi130 ceph-mon[32417]: osdmap e39: 6 total, 6 up, 6 in 2024-05-03T22:07:37.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:37 smithi082 ceph-mon[28404]: pgmap v179: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:37.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:37 smithi082 ceph-mon[28404]: osdmap e40: 6 total, 6 up, 6 in 2024-05-03T22:07:38.052 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-05-03T22:07:38.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:37 smithi116 ceph-mon[31828]: pgmap v179: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:38.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:37 smithi116 ceph-mon[31828]: osdmap e40: 6 total, 6 up, 6 in 2024-05-03T22:07:38.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:37 smithi130 ceph-mon[32417]: pgmap v179: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:38.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:37 smithi130 ceph-mon[32417]: osdmap e40: 6 total, 6 up, 6 in 2024-05-03T22:07:38.481 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:07:39.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:39 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi130 2024-05-03T22:07:39.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:39.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:39.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:39.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:39.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:39 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi130 to 8544M 2024-05-03T22:07:39.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:39.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:39.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:39.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:39.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:39 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi130 2024-05-03T22:07:39.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:39.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:39.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:39.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:39.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:39 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi130 to 8544M 2024-05-03T22:07:39.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:39.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:39.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:39.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:39.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:39 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi130 2024-05-03T22:07:39.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:39.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:39.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:39.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:07:39.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:39 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi130 to 8544M 2024-05-03T22:07:39.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:39.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:39.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:07:39.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:07:40.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:40 smithi082 ceph-mon[28404]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:40.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:40 smithi116 ceph-mon[31828]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:40.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:40 smithi130 ceph-mon[32417]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.805+0000 7fe53e200700 1 -- 172.21.15.82:0/3542513074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5381016e0 msgr2=0x7fe538101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:07:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.805+0000 7fe53e200700 1 --2- 172.21.15.82:0/3542513074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5381016e0 0x7fe538101b00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009990 tx=0x7fe52c009ca0 comp rx=0 tx=0).stop 2024-05-03T22:07:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.806+0000 7fe53e200700 1 -- 172.21.15.82:0/3542513074 shutdown_connections 2024-05-03T22:07:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.806+0000 7fe53e200700 1 --2- 172.21.15.82:0/3542513074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5381016e0 0x7fe538101b00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.806+0000 7fe53e200700 1 --2- 172.21.15.82:0/3542513074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe538105060 0x7fe53810b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.806+0000 7fe53e200700 1 --2- 172.21.15.82:0/3542513074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5381046c0 0x7fe538104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.806+0000 7fe53e200700 1 -- 172.21.15.82:0/3542513074 >> 172.21.15.82:0/3542513074 conn(0x7fe5380fd040 msgr2=0x7fe5380ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:07:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.806+0000 7fe53e200700 1 -- 172.21.15.82:0/3542513074 shutdown_connections 2024-05-03T22:07:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.806+0000 7fe53e200700 1 -- 172.21.15.82:0/3542513074 wait complete. 2024-05-03T22:07:40.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.807+0000 7fe53e200700 1 Processor -- start 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.807+0000 7fe53e200700 1 -- start start 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.807+0000 7fe53e200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5381016e0 0x7fe538199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.807+0000 7fe53e200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5381046c0 0x7fe5381999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.807+0000 7fe53e200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe538105060 0x7fe5381a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.808+0000 7fe53e200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe53810ed50 con 0x7fe538105060 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.808+0000 7fe53e200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe53810ebd0 con 0x7fe5381046c0 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.808+0000 7fe53e200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe53810eed0 con 0x7fe5381016e0 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.808+0000 7fe53d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe538105060 0x7fe5381a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.808+0000 7fe53d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe538105060 0x7fe5381a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46858/0 (socket says 172.21.15.82:46858) 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.808+0000 7fe53d800700 1 -- 172.21.15.82:0/4166038467 learned_addr learned my addr 172.21.15.82:0/4166038467 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.808+0000 7fe53ce00700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5381016e0 0x7fe538199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.808+0000 7fe537e00700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5381046c0 0x7fe5381999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:07:40.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.808+0000 7fe53d800700 1 -- 172.21.15.82:0/4166038467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5381016e0 msgr2=0x7fe538199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:07:40.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.808+0000 7fe53d800700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5381016e0 0x7fe538199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:40.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.809+0000 7fe53d800700 1 -- 172.21.15.82:0/4166038467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5381046c0 msgr2=0x7fe5381999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:07:40.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.809+0000 7fe53d800700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5381046c0 0x7fe5381999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:07:40.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.809+0000 7fe53d800700 1 -- 172.21.15.82:0/4166038467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5381a10d0 con 0x7fe538105060 2024-05-03T22:07:40.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.809+0000 7fe53d800700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe538105060 0x7fe5381a0a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe530007f10 tx=0x7fe53000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:07:40.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.809+0000 7fe535600700 1 -- 172.21.15.82:0/4166038467 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53000ddd0 con 0x7fe538105060 2024-05-03T22:07:40.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.809+0000 7fe53e200700 1 -- 172.21.15.82:0/4166038467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5381a13c0 con 0x7fe538105060 2024-05-03T22:07:40.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.809+0000 7fe535600700 1 -- 172.21.15.82:0/4166038467 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe530004020 con 0x7fe538105060 2024-05-03T22:07:40.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.809+0000 7fe535600700 1 -- 172.21.15.82:0/4166038467 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe530015660 con 0x7fe538105060 2024-05-03T22:07:40.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.809+0000 7fe53e200700 1 -- 172.21.15.82:0/4166038467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5381a1900 con 0x7fe538105060 2024-05-03T22:07:40.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.811+0000 7fe53e200700 1 -- 172.21.15.82:0/4166038467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe53806a190 con 0x7fe538105060 2024-05-03T22:07:40.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.813+0000 7fe535600700 1 -- 172.21.15.82:0/4166038467 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe5300041d0 con 0x7fe538105060 2024-05-03T22:07:40.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.814+0000 7fe535600700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe5200b2980 0x7fe5200b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:07:40.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.815+0000 7fe535600700 1 -- 172.21.15.82:0/4166038467 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4533+0+0 (secure 0 0 0) 0x7fe5300e0dd0 con 0x7fe538105060 2024-05-03T22:07:40.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.815+0000 7fe53ce00700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe5200b2980 0x7fe5200b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:07:40.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.816+0000 7fe53ce00700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe5200b2980 0x7fe5200b4e40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00b2e0 tx=0x7fe52c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:07:40.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:40.819+0000 7fe535600700 1 -- 172.21.15.82:0/4166038467 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe5300e5070 con 0x7fe538105060 2024-05-03T22:07:41.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:07:41.059+0000 7fe53e200700 1 -- 172.21.15.82:0/4166038467 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe5380638e0 con 0x7fe5200b2980 2024-05-03T22:07:42.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:42 smithi082 ceph-mon[28404]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-03T22:07:42.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:42 smithi082 ceph-mon[28404]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:07:42.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:42 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:07:42.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:42 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:07:42.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:42 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:42 smithi116 ceph-mon[31828]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-03T22:07:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:42 smithi116 ceph-mon[31828]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:07:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:42 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:07:42.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:42 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:07:42.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:42 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:42 smithi130 ceph-mon[32417]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-03T22:07:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:42 smithi130 ceph-mon[32417]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:07:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:42 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:07:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:42 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:07:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:42 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:44.314 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:44 smithi082 ceph-mon[28404]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-03T22:07:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:44 smithi116 ceph-mon[31828]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-03T22:07:44.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:44 smithi130 ceph-mon[32417]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-03T22:07:46.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:46 smithi082 ceph-mon[28404]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-03T22:07:46.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:46 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/664274779' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bc2258f-990b-485d-baef-9bd16b39d4ec"}]: dispatch 2024-05-03T22:07:46.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:46 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/664274779' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7bc2258f-990b-485d-baef-9bd16b39d4ec"}]': finished 2024-05-03T22:07:46.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:46 smithi082 ceph-mon[28404]: osdmap e41: 7 total, 6 up, 7 in 2024-05-03T22:07:46.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:07:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:46 smithi116 ceph-mon[31828]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-03T22:07:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:46 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/664274779' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bc2258f-990b-485d-baef-9bd16b39d4ec"}]: dispatch 2024-05-03T22:07:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:46 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/664274779' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7bc2258f-990b-485d-baef-9bd16b39d4ec"}]': finished 2024-05-03T22:07:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:46 smithi116 ceph-mon[31828]: osdmap e41: 7 total, 6 up, 7 in 2024-05-03T22:07:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:46 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:07:46.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:46 smithi130 ceph-mon[32417]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-03T22:07:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:46 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/664274779' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7bc2258f-990b-485d-baef-9bd16b39d4ec"}]: dispatch 2024-05-03T22:07:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:46 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/664274779' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7bc2258f-990b-485d-baef-9bd16b39d4ec"}]': finished 2024-05-03T22:07:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:46 smithi130 ceph-mon[32417]: osdmap e41: 7 total, 6 up, 7 in 2024-05-03T22:07:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:07:47.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:47 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/312780015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:07:47.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:47 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/312780015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:07:47.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:47 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/312780015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:07:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:48 smithi116 ceph-mon[31828]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T22:07:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:48 smithi082 ceph-mon[28404]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T22:07:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:48 smithi130 ceph-mon[32417]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T22:07:50.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:50 smithi116 ceph-mon[31828]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:07:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:50 smithi082 ceph-mon[28404]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:07:50.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:50 smithi130 ceph-mon[32417]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:07:52.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:52 smithi130 ceph-mon[32417]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:52.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:52 smithi116 ceph-mon[31828]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:52 smithi082 ceph-mon[28404]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:54.383 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:54 smithi082 ceph-mon[28404]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:54 smithi116 ceph-mon[31828]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:54.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:54 smithi130 ceph-mon[32417]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:56.417 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:56 smithi082 ceph-mon[28404]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:56.417 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:56 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-03T22:07:56.418 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:56 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:56 smithi116 ceph-mon[31828]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:56 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-03T22:07:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:56 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:56 smithi130 ceph-mon[32417]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:56 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-03T22:07:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:56 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:07:57.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:57 smithi082 ceph-mon[28404]: Deploying daemon osd.6 on smithi082 2024-05-03T22:07:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:57 smithi116 ceph-mon[31828]: Deploying daemon osd.6 on smithi082 2024-05-03T22:07:57.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:57 smithi130 ceph-mon[32417]: Deploying daemon osd.6 on smithi082 2024-05-03T22:07:58.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:07:58 smithi082 ceph-mon[28404]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:58.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:07:58 smithi116 ceph-mon[31828]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:07:58.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:07:58 smithi130 ceph-mon[32417]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:00 smithi116 ceph-mon[31828]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:00.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:00 smithi082 ceph-mon[28404]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:00.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:00 smithi130 ceph-mon[32417]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:02 smithi116 ceph-mon[31828]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:02 smithi082 ceph-mon[28404]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:02 smithi130 ceph-mon[32417]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:04.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:04 smithi082 ceph-mon[28404]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:04.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:04 smithi116 ceph-mon[31828]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:04 smithi130 ceph-mon[32417]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:05.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:05 smithi082 ceph-mon[28404]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:05.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:05.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:05.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:05 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:05.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:05 smithi116 ceph-mon[31828]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:05.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:05.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:05.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:05 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:06.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:05 smithi130 ceph-mon[32417]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:06.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:06.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:06.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:05 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:07.830 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:07 smithi082 ceph-mon[28404]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:07.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:07 smithi116 ceph-mon[31828]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:08.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:07 smithi130 ceph-mon[32417]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:08.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:08 smithi116 ceph-mon[31828]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-03T22:08:08.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:08.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:08.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:08.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:08.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:08.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:08 smithi082 ceph-mon[28404]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-03T22:08:08.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:08.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:08.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:08.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:08.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:09.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:08 smithi130 ceph-mon[32417]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-03T22:08:09.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:09.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:09.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:09.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:09.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:09.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:09 smithi082 ceph-mon[28404]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:09.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:09 smithi082 ceph-mon[28404]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-03T22:08:09.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:09 smithi082 ceph-mon[28404]: osdmap e42: 7 total, 6 up, 7 in 2024-05-03T22:08:09.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:09 smithi082 ceph-mon[28404]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:08:09.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:09 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:09.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:09 smithi116 ceph-mon[31828]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:09.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:09 smithi116 ceph-mon[31828]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-03T22:08:09.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:09 smithi116 ceph-mon[31828]: osdmap e42: 7 total, 6 up, 7 in 2024-05-03T22:08:09.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:09 smithi116 ceph-mon[31828]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:08:09.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:09 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:10.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:09 smithi130 ceph-mon[32417]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:10.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:09 smithi130 ceph-mon[32417]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-03T22:08:10.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:09 smithi130 ceph-mon[32417]: osdmap e42: 7 total, 6 up, 7 in 2024-05-03T22:08:10.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:09 smithi130 ceph-mon[32417]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:08:10.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:09 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:10.062 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 6 on host 'smithi082' 2024-05-03T22:08:10.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.059+0000 7fe535600700 1 -- 172.21.15.82:0/4166038467 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe5380638e0 con 0x7fe5200b2980 2024-05-03T22:08:10.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.063+0000 7fe53e200700 1 -- 172.21.15.82:0/4166038467 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe5200b2980 msgr2=0x7fe5200b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:08:10.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.063+0000 7fe53e200700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe5200b2980 0x7fe5200b4e40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00b2e0 tx=0x7fe52c01a040 comp rx=0 tx=0).stop 2024-05-03T22:08:10.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.063+0000 7fe53e200700 1 -- 172.21.15.82:0/4166038467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe538105060 msgr2=0x7fe5381a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:08:10.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.063+0000 7fe53e200700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe538105060 0x7fe5381a0a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe530007f10 tx=0x7fe53000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:08:10.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.064+0000 7fe53e200700 1 -- 172.21.15.82:0/4166038467 shutdown_connections 2024-05-03T22:08:10.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.064+0000 7fe53e200700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe5200b2980 0x7fe5200b4e40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:10.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.064+0000 7fe53e200700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe538105060 0x7fe5381a0a30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:10.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.064+0000 7fe53e200700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5381016e0 0x7fe538199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:10.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.064+0000 7fe53e200700 1 --2- 172.21.15.82:0/4166038467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5381046c0 0x7fe5381999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:10.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.064+0000 7fe53e200700 1 -- 172.21.15.82:0/4166038467 >> 172.21.15.82:0/4166038467 conn(0x7fe5380fd040 msgr2=0x7fe538107a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:08:10.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.064+0000 7fe53e200700 1 -- 172.21.15.82:0/4166038467 shutdown_connections 2024-05-03T22:08:10.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:08:10.064+0000 7fe53e200700 1 -- 172.21.15.82:0/4166038467 wait complete. 2024-05-03T22:08:10.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:10 smithi082 ceph-mon[28404]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:08:10.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:10 smithi082 ceph-mon[28404]: osdmap e43: 7 total, 6 up, 7 in 2024-05-03T22:08:10.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:10 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:10.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:10 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:10.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:10 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:10.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:10 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:10.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:10 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:10.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:10 smithi082 ceph-mon[28404]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' 2024-05-03T22:08:10.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:10 smithi116 ceph-mon[31828]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:08:10.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:10 smithi116 ceph-mon[31828]: osdmap e43: 7 total, 6 up, 7 in 2024-05-03T22:08:10.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:10 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:10.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:10 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:10.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:10 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:10.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:10 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:10.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:10 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:10.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:10 smithi116 ceph-mon[31828]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' 2024-05-03T22:08:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:10 smithi130 ceph-mon[32417]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:08:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:10 smithi130 ceph-mon[32417]: osdmap e43: 7 total, 6 up, 7 in 2024-05-03T22:08:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:10 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:10 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:10 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:10 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:10 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:11.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:10 smithi130 ceph-mon[32417]: from='osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315]' entity='osd.6' 2024-05-03T22:08:11.325 DEBUG:teuthology.orchestra.run.smithi082:osd.6> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.6.service 2024-05-03T22:08:11.331 INFO:tasks.cephadm:Deploying osd.7 on smithi116 with /dev/vg_nvme/lv_2... 2024-05-03T22:08:11.331 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-03T22:08:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:11 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:08:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:11 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:08:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:11 smithi116 ceph-mon[31828]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:11 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:11 smithi116 ceph-mon[31828]: osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315] boot 2024-05-03T22:08:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:11 smithi116 ceph-mon[31828]: osdmap e44: 7 total, 7 up, 7 in 2024-05-03T22:08:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:11 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:11.770 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:08:11.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:11 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:08:11.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:11 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:08:11.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:11 smithi082 ceph-mon[28404]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:11.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:11 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:11.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:11 smithi082 ceph-mon[28404]: osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315] boot 2024-05-03T22:08:11.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:11 smithi082 ceph-mon[28404]: osdmap e44: 7 total, 7 up, 7 in 2024-05-03T22:08:11.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:11 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:11 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:08:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:11 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:08:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:11 smithi130 ceph-mon[32417]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:08:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:11 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:11 smithi130 ceph-mon[32417]: osd.6 [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315] boot 2024-05-03T22:08:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:11 smithi130 ceph-mon[32417]: osdmap e44: 7 total, 7 up, 7 in 2024-05-03T22:08:12.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:11 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:08:13.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:13 smithi082 ceph-mon[28404]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:13.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:13 smithi082 ceph-mon[28404]: osdmap e45: 7 total, 7 up, 7 in 2024-05-03T22:08:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:13 smithi116 ceph-mon[31828]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:13 smithi116 ceph-mon[31828]: osdmap e45: 7 total, 7 up, 7 in 2024-05-03T22:08:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:13 smithi130 ceph-mon[32417]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:13 smithi130 ceph-mon[32417]: osdmap e45: 7 total, 7 up, 7 in 2024-05-03T22:08:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-03T22:08:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-03T22:08:14.585 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2024-05-03T22:08:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2024-05-03T22:08:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0345361 s, 304 MB/s 2024-05-03T22:08:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2024-05-03T22:08:15.512 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_2 2024-05-03T22:08:15.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:15 smithi082 ceph-mon[28404]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:15.934 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:15 smithi116 ceph-mon[31828]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:15.949 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:08:16.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:15 smithi130 ceph-mon[32417]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:17.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi082 2024-05-03T22:08:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi082 to 5696M 2024-05-03T22:08:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:17 smithi082 ceph-mon[28404]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:17.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi082 2024-05-03T22:08:17.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:17.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:17.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:17.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi082 to 5696M 2024-05-03T22:08:17.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:17.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:17.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:17 smithi130 ceph-mon[32417]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:17.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi082 2024-05-03T22:08:17.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:17.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:17.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:17.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi082 to 5696M 2024-05-03T22:08:17.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.806 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:17.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:17.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:17.807 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:17 smithi116 ceph-mon[31828]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:17.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.976+0000 7f96b5c00700 1 -- 172.21.15.116:0/2656046264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96b0106940 msgr2=0x7f96b0106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:08:17.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.976+0000 7f96b5c00700 1 --2- 172.21.15.116:0/2656046264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96b0106940 0x7f96b0106da0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f969c0099c0 tx=0x7f969c009cd0 comp rx=0 tx=0).stop 2024-05-03T22:08:17.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.976+0000 7f96b5c00700 1 -- 172.21.15.116:0/2656046264 shutdown_connections 2024-05-03T22:08:17.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.976+0000 7f96b5c00700 1 --2- 172.21.15.116:0/2656046264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b0105740 0x7f96b0105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:17.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.976+0000 7f96b5c00700 1 --2- 172.21.15.116:0/2656046264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f96b01072e0 0x7f96b010db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:17.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.976+0000 7f96b5c00700 1 --2- 172.21.15.116:0/2656046264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96b0106940 0x7f96b0106da0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:17.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.976+0000 7f96b5c00700 1 -- 172.21.15.116:0/2656046264 >> 172.21.15.116:0/2656046264 conn(0x7f96b0100d00 msgr2=0x7f96b0103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:08:17.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.976+0000 7f96b5c00700 1 -- 172.21.15.116:0/2656046264 shutdown_connections 2024-05-03T22:08:17.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.976+0000 7f96b5c00700 1 -- 172.21.15.116:0/2656046264 wait complete. 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.977+0000 7f96b5c00700 1 Processor -- start 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.977+0000 7f96b5c00700 1 -- start start 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96b5c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96b0105740 0x7f96b019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96b5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b0106940 0x7f96b019bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96b5c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f96b01072e0 0x7f96b01a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96b5c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96b0111090 con 0x7f96b0106940 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96b5c00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f96b0110f10 con 0x7f96b0105740 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96b5c00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f96b0111210 con 0x7f96b01072e0 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96aea00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96b0105740 0x7f96b019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96aea00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96b0105740 0x7f96b019b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:56254/0 (socket says 172.21.15.116:56254) 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96aea00700 1 -- 172.21.15.116:0/1209943054 learned_addr learned my addr 172.21.15.116:0/1209943054 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-05-03T22:08:17.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96ae000700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b0106940 0x7f96b019bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96aea00700 1 -- 172.21.15.116:0/1209943054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f96b01072e0 msgr2=0x7f96b01a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96aea00700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f96b01072e0 0x7f96b01a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96aea00700 1 -- 172.21.15.116:0/1209943054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b0106940 msgr2=0x7f96b019bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96aea00700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b0106940 0x7f96b019bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.978+0000 7f96aea00700 1 -- 172.21.15.116:0/1209943054 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b01a33a0 con 0x7f96b0105740 2024-05-03T22:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.979+0000 7f96aea00700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96b0105740 0x7f96b019b740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f96a000d980 tx=0x7f96a000dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.979+0000 7f96a7400700 1 -- 172.21.15.116:0/1209943054 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0017030 con 0x7f96b0105740 2024-05-03T22:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.979+0000 7f96a7400700 1 -- 172.21.15.116:0/1209943054 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96a00044b0 con 0x7f96b0105740 2024-05-03T22:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.979+0000 7f96a7400700 1 -- 172.21.15.116:0/1209943054 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0003970 con 0x7f96b0105740 2024-05-03T22:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.979+0000 7f96b5c00700 1 -- 172.21.15.116:0/1209943054 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b01a3690 con 0x7f96b0105740 2024-05-03T22:08:17.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.979+0000 7f96b5c00700 1 -- 172.21.15.116:0/1209943054 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b01a3b80 con 0x7f96b0105740 2024-05-03T22:08:17.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.980+0000 7f96b5c00700 1 -- 172.21.15.116:0/1209943054 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b006a190 con 0x7f96b0105740 2024-05-03T22:08:17.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.983+0000 7f96a7400700 1 -- 172.21.15.116:0/1209943054 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f96a001a070 con 0x7f96b0105740 2024-05-03T22:08:17.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.984+0000 7f96a7400700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f96940b2980 0x7f96940b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:08:17.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.984+0000 7f96a7400700 1 -- 172.21.15.116:0/1209943054 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4965+0+0 (secure 0 0 0) 0x7f96a00e1250 con 0x7f96b0105740 2024-05-03T22:08:17.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.985+0000 7f96ae000700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f96940b2980 0x7f96940b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:08:17.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.986+0000 7f96ae000700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f96940b2980 0x7f96940b4e40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f969c000c00 tx=0x7f969c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:08:17.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:17.987+0000 7f96a7400700 1 -- 172.21.15.116:0/1209943054 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f96a00a9c60 con 0x7f96b0105740 2024-05-03T22:08:18.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:18.230+0000 7f96b5c00700 1 -- 172.21.15.116:0/1209943054 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f96b00638e0 con 0x7f96940b2980 2024-05-03T22:08:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:18 smithi130 ceph-mon[32417]: from='client.34265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:08:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:08:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:08:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:18.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:18 smithi116 ceph-mon[31828]: from='client.34265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:08:18.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:08:18.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:08:18.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:18.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:18 smithi082 ceph-mon[28404]: from='client.34265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:08:18.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:08:18.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:08:18.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:19.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:19 smithi130 ceph-mon[32417]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:19.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:19 smithi116 ceph-mon[31828]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:19.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:19 smithi082 ceph-mon[28404]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:21.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:21 smithi116 ceph-mon[31828]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:21.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:21 smithi082 ceph-mon[28404]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:22.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:21 smithi130 ceph-mon[32417]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:22.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:22 smithi116 ceph-mon[31828]: from='client.? 172.21.15.116:0/1626355348' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06aedaa7-11ea-4bfc-b2b7-1897c26376fc"}]: dispatch 2024-05-03T22:08:22.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:22 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06aedaa7-11ea-4bfc-b2b7-1897c26376fc"}]: dispatch 2024-05-03T22:08:22.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:22 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06aedaa7-11ea-4bfc-b2b7-1897c26376fc"}]': finished 2024-05-03T22:08:22.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:22 smithi116 ceph-mon[31828]: osdmap e46: 8 total, 7 up, 8 in 2024-05-03T22:08:22.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:22.964 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:22 smithi130 ceph-mon[32417]: from='client.? 172.21.15.116:0/1626355348' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06aedaa7-11ea-4bfc-b2b7-1897c26376fc"}]: dispatch 2024-05-03T22:08:22.964 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:22 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06aedaa7-11ea-4bfc-b2b7-1897c26376fc"}]: dispatch 2024-05-03T22:08:22.964 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:22 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06aedaa7-11ea-4bfc-b2b7-1897c26376fc"}]': finished 2024-05-03T22:08:22.964 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:22 smithi130 ceph-mon[32417]: osdmap e46: 8 total, 7 up, 8 in 2024-05-03T22:08:22.964 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:22 smithi082 ceph-mon[28404]: from='client.? 172.21.15.116:0/1626355348' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06aedaa7-11ea-4bfc-b2b7-1897c26376fc"}]: dispatch 2024-05-03T22:08:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:22 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "06aedaa7-11ea-4bfc-b2b7-1897c26376fc"}]: dispatch 2024-05-03T22:08:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:22 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "06aedaa7-11ea-4bfc-b2b7-1897c26376fc"}]': finished 2024-05-03T22:08:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:22 smithi082 ceph-mon[28404]: osdmap e46: 8 total, 7 up, 8 in 2024-05-03T22:08:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:23.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:23 smithi116 ceph-mon[31828]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:23.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:23 smithi116 ceph-mon[31828]: from='client.? 172.21.15.116:0/4202549626' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:08:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:23 smithi082 ceph-mon[28404]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:23 smithi082 ceph-mon[28404]: from='client.? 172.21.15.116:0/4202549626' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:08:24.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:23 smithi130 ceph-mon[32417]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:24.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:23 smithi130 ceph-mon[32417]: from='client.? 172.21.15.116:0/4202549626' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:08:25.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:25 smithi116 ceph-mon[31828]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:25.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:25 smithi082 ceph-mon[28404]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:26.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:25 smithi130 ceph-mon[32417]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:27.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:27 smithi116 ceph-mon[31828]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:27.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:27 smithi082 ceph-mon[28404]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:28.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:27 smithi130 ceph-mon[32417]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:29.871 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:29 smithi116 ceph-mon[31828]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:29.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:29 smithi082 ceph-mon[28404]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:30.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:29 smithi130 ceph-mon[32417]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:31.820 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:31 smithi116 ceph-mon[31828]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:31.820 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-03T22:08:31.820 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:31.820 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:31 smithi116 ceph-mon[31828]: Deploying daemon osd.7 on smithi116 2024-05-03T22:08:31.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:31 smithi082 ceph-mon[28404]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:31.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-03T22:08:31.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:31.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:31 smithi082 ceph-mon[28404]: Deploying daemon osd.7 on smithi116 2024-05-03T22:08:32.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:31 smithi130 ceph-mon[32417]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:32.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-03T22:08:32.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:32.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:31 smithi130 ceph-mon[32417]: Deploying daemon osd.7 on smithi116 2024-05-03T22:08:33.835 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:33 smithi116 ceph-mon[31828]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:33.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:33 smithi082 ceph-mon[28404]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:34.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:33 smithi130 ceph-mon[32417]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:35.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:35 smithi082 ceph-mon[28404]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:35 smithi116 ceph-mon[31828]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:36.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:35 smithi130 ceph-mon[32417]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:37.885 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:37 smithi116 ceph-mon[31828]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:37.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:37 smithi082 ceph-mon[28404]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:38.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:37 smithi130 ceph-mon[32417]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:39.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:39 smithi116 ceph-mon[31828]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:39.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:39.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:39.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:39.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:39 smithi082 ceph-mon[28404]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:39.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:39.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:39.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:40.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:39 smithi130 ceph-mon[32417]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:40.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:40.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:40.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:41.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:41 smithi116 ceph-mon[31828]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:41.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:41 smithi082 ceph-mon[28404]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:42.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:41 smithi130 ceph-mon[32417]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:44.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:43 smithi116 ceph-mon[31828]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:44.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:44.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:44.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:44.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:44.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:44.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:43 smithi116 ceph-mon[31828]: from='osd.7 [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:08:44.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:43 smithi116 ceph-mon[31828]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:08:44.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:43 smithi130 ceph-mon[32417]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:44.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:44.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:44.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:44.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:44.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:44.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:43 smithi130 ceph-mon[32417]: from='osd.7 [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:08:44.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:43 smithi130 ceph-mon[32417]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:08:44.393 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 7 on host 'smithi116' 2024-05-03T22:08:44.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.391+0000 7f96a7400700 1 -- 172.21.15.116:0/1209943054 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f96b00638e0 con 0x7f96940b2980 2024-05-03T22:08:44.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 -- 172.21.15.116:0/1209943054 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f96940b2980 msgr2=0x7f96940b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:08:44.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f96940b2980 0x7f96940b4e40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f969c000c00 tx=0x7f969c01a040 comp rx=0 tx=0).stop 2024-05-03T22:08:44.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 -- 172.21.15.116:0/1209943054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96b0105740 msgr2=0x7f96b019b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:08:44.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96b0105740 0x7f96b019b740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f96a000d980 tx=0x7f96a000dd40 comp rx=0 tx=0).stop 2024-05-03T22:08:44.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 -- 172.21.15.116:0/1209943054 shutdown_connections 2024-05-03T22:08:44.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f96940b2980 0x7f96940b4e40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:44.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f96b01072e0 0x7f96b01a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:44.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96b0105740 0x7f96b019b740 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:44.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 --2- 172.21.15.116:0/1209943054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96b0106940 0x7f96b019bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:44.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 -- 172.21.15.116:0/1209943054 >> 172.21.15.116:0/1209943054 conn(0x7f96b0100d00 msgr2=0x7f96b0109d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:08:44.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 -- 172.21.15.116:0/1209943054 shutdown_connections 2024-05-03T22:08:44.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:08:44.395+0000 7f96b5c00700 1 -- 172.21.15.116:0/1209943054 wait complete. 2024-05-03T22:08:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:43 smithi082 ceph-mon[28404]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:43 smithi082 ceph-mon[28404]: from='osd.7 [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:08:44.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:43 smithi082 ceph-mon[28404]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:08:45.202 DEBUG:teuthology.orchestra.run.smithi116:osd.7> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.7.service 2024-05-03T22:08:45.210 INFO:tasks.cephadm:Deploying osd.8 on smithi130 with /dev/vg_nvme/lv_2... 2024-05-03T22:08:45.210 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-03T22:08:45.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:45 smithi082 ceph-mon[28404]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-03T22:08:45.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:45 smithi082 ceph-mon[28404]: osdmap e47: 8 total, 7 up, 8 in 2024-05-03T22:08:45.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:45.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:45 smithi082 ceph-mon[28404]: from='osd.7 [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:08:45.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:45 smithi082 ceph-mon[28404]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:08:45.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:45.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:45.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:45 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:45.289 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:45 smithi130 ceph-mon[32417]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-03T22:08:45.289 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:45 smithi130 ceph-mon[32417]: osdmap e47: 8 total, 7 up, 8 in 2024-05-03T22:08:45.289 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:45.290 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:45 smithi130 ceph-mon[32417]: from='osd.7 [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:08:45.290 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:45 smithi130 ceph-mon[32417]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:08:45.290 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:45.290 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:45.290 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:45 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:45 smithi116 ceph-mon[31828]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-03T22:08:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:45 smithi116 ceph-mon[31828]: osdmap e47: 8 total, 7 up, 8 in 2024-05-03T22:08:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:45 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:45 smithi116 ceph-mon[31828]: from='osd.7 [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:08:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:45 smithi116 ceph-mon[31828]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:08:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:45 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:45 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:45 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:08:45.657 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:08:46.018 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:08:45 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:08:45.851+0000 7f52ad400700 -1 osd.7 0 waiting for initial osdmap 2024-05-03T22:08:46.018 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:08:45 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:08:45.882+0000 7f52a3200700 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:08:46.060 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:46 smithi130 ceph-mon[32417]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:46.061 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:46 smithi130 ceph-mon[32417]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:08:46.061 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:46 smithi130 ceph-mon[32417]: osdmap e48: 8 total, 7 up, 8 in 2024-05-03T22:08:46.061 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:46.061 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:46.061 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:46 smithi130 ceph-mon[32417]: from='osd.7 ' entity='osd.7' 2024-05-03T22:08:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:46 smithi116 ceph-mon[31828]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:46 smithi116 ceph-mon[31828]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:08:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:46 smithi116 ceph-mon[31828]: osdmap e48: 8 total, 7 up, 8 in 2024-05-03T22:08:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:46 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:46 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:46 smithi116 ceph-mon[31828]: from='osd.7 ' entity='osd.7' 2024-05-03T22:08:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:46 smithi082 ceph-mon[28404]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:46 smithi082 ceph-mon[28404]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:08:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:46 smithi082 ceph-mon[28404]: osdmap e48: 8 total, 7 up, 8 in 2024-05-03T22:08:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:46.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:46 smithi082 ceph-mon[28404]: from='osd.7 ' entity='osd.7' 2024-05-03T22:08:47.260 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:47 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:08:47.260 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:47 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:08:47.260 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:47 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:47.260 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:47 smithi116 ceph-mon[31828]: osd.7 [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056] boot 2024-05-03T22:08:47.261 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:47 smithi116 ceph-mon[31828]: osdmap e49: 8 total, 8 up, 8 in 2024-05-03T22:08:47.261 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:47 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:47.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:47 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:08:47.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:47 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:08:47.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:47 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:47.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:47 smithi130 ceph-mon[32417]: osd.7 [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056] boot 2024-05-03T22:08:47.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:47 smithi130 ceph-mon[32417]: osdmap e49: 8 total, 8 up, 8 in 2024-05-03T22:08:47.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:47 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:47.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:47 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:08:47.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:47 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:08:47.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:47 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:47.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:47 smithi082 ceph-mon[28404]: osd.7 [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056] boot 2024-05-03T22:08:47.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:47 smithi082 ceph-mon[28404]: osdmap e49: 8 total, 8 up, 8 in 2024-05-03T22:08:47.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:47 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:08:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:48 smithi116 ceph-mon[31828]: pgmap v224: 1 pgs: 1 unknown; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:48 smithi116 ceph-mon[31828]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-03T22:08:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:48 smithi116 ceph-mon[31828]: osdmap e50: 8 total, 8 up, 8 in 2024-05-03T22:08:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:48 smithi082 ceph-mon[28404]: pgmap v224: 1 pgs: 1 unknown; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:48 smithi082 ceph-mon[28404]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-03T22:08:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:48 smithi082 ceph-mon[28404]: osdmap e50: 8 total, 8 up, 8 in 2024-05-03T22:08:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:48 smithi130 ceph-mon[32417]: pgmap v224: 1 pgs: 1 unknown; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:08:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:48 smithi130 ceph-mon[32417]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-03T22:08:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:48 smithi130 ceph-mon[32417]: osdmap e50: 8 total, 8 up, 8 in 2024-05-03T22:08:48.670 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-03T22:08:48.671 INFO:teuthology.orchestra.run.smithi130.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-03T22:08:48.671 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 10+0 records in 2024-05-03T22:08:48.671 INFO:teuthology.orchestra.run.smithi130.stderr:10+0 records out 2024-05-03T22:08:48.671 INFO:teuthology.orchestra.run.smithi130.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0367927 s, 285 MB/s 2024-05-03T22:08:48.671 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping successful for: 2024-05-03T22:08:49.412 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:49 smithi116 ceph-mon[31828]: osdmap e51: 8 total, 8 up, 8 in 2024-05-03T22:08:49.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:49 smithi082 ceph-mon[28404]: osdmap e51: 8 total, 8 up, 8 in 2024-05-03T22:08:49.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:49 smithi130 ceph-mon[32417]: osdmap e51: 8 total, 8 up, 8 in 2024-05-03T22:08:49.603 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_2 2024-05-03T22:08:50.030 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:08:50.379 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:50 smithi130 ceph-mon[32417]: pgmap v227: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:08:50.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:50 smithi116 ceph-mon[31828]: pgmap v227: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:08:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:50 smithi082 ceph-mon[28404]: pgmap v227: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:08:51.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi116 2024-05-03T22:08:51.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:51.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:51.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:51.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi116 to 5696M 2024-05-03T22:08:51.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:51.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:51.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:51 smithi116 ceph-mon[31828]: pgmap v228: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:08:51.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi116 2024-05-03T22:08:51.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:51.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:51.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:51.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi116 to 5696M 2024-05-03T22:08:51.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:51.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:51.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:51 smithi082 ceph-mon[28404]: pgmap v228: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:08:51.736 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi116 2024-05-03T22:08:51.736 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.736 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.736 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:51.736 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:51.736 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:08:51.736 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi116 to 5696M 2024-05-03T22:08:51.736 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.736 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:51.736 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:08:51.737 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:08:51.737 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:51 smithi130 ceph-mon[32417]: pgmap v228: 1 pgs: 1 unknown; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:08:52.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.232+0000 7f26fa600700 1 -- 172.21.15.130:0/1843246409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26f4103f80 msgr2=0x7f26f4106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:08:52.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.232+0000 7f26fa600700 1 --2- 172.21.15.130:0/1843246409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26f4103f80 0x7f26f4106370 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009990 tx=0x7f26e4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:08:52.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.232+0000 7f26fa600700 1 -- 172.21.15.130:0/1843246409 shutdown_connections 2024-05-03T22:08:52.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.232+0000 7f26fa600700 1 --2- 172.21.15.130:0/1843246409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f41091e0 0x7f26f410b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:52.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.232+0000 7f26fa600700 1 --2- 172.21.15.130:0/1843246409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26f4103f80 0x7f26f4106370 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:52.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.232+0000 7f26fa600700 1 --2- 172.21.15.130:0/1843246409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26f41068b0 0x7f26f4108ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:52.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.232+0000 7f26fa600700 1 -- 172.21.15.130:0/1843246409 >> 172.21.15.130:0/1843246409 conn(0x7f26f40fd990 msgr2=0x7f26f40ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:08:52.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.232+0000 7f26fa600700 1 -- 172.21.15.130:0/1843246409 shutdown_connections 2024-05-03T22:08:52.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.232+0000 7f26fa600700 1 -- 172.21.15.130:0/1843246409 wait complete. 2024-05-03T22:08:52.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.233+0000 7f26fa600700 1 Processor -- start 2024-05-03T22:08:52.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.233+0000 7f26fa600700 1 -- start start 2024-05-03T22:08:52.236 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.234+0000 7f26fa600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26f4103f80 0x7f26f419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:08:52.236 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.234+0000 7f26fa600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f41068b0 0x7f26f419bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.234+0000 7f26fa600700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26f41091e0 0x7f26f41a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.234+0000 7f26fa600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f26f410ee70 con 0x7f26f41068b0 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.234+0000 7f26fa600700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f26f410ecf0 con 0x7f26f41091e0 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.234+0000 7f26fa600700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f26f410eff0 con 0x7f26f4103f80 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.234+0000 7f26f3400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26f4103f80 0x7f26f419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.234+0000 7f26f3400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26f4103f80 0x7f26f419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:37486/0 (socket says 172.21.15.130:37486) 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.234+0000 7f26f3400700 1 -- 172.21.15.130:0/908821877 learned_addr learned my addr 172.21.15.130:0/908821877 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.234+0000 7f26f2a00700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f41068b0 0x7f26f419bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.234+0000 7f26f3e00700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26f41091e0 0x7f26f41a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26f3400700 1 -- 172.21.15.130:0/908821877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26f41091e0 msgr2=0x7f26f41a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26f3400700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26f41091e0 0x7f26f41a2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26f3400700 1 -- 172.21.15.130:0/908821877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f41068b0 msgr2=0x7f26f419bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:08:52.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26f3400700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f41068b0 0x7f26f419bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:08:52.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26f3400700 1 -- 172.21.15.130:0/908821877 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f41a3400 con 0x7f26f4103f80 2024-05-03T22:08:52.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26f3e00700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26f41091e0 0x7f26f41a2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:08:52.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26f3400700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26f4103f80 0x7f26f419b7a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f26e4005910 tx=0x7f26e4003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:08:52.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26ebe00700 1 -- 172.21.15.130:0/908821877 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4027070 con 0x7f26f4103f80 2024-05-03T22:08:52.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26ebe00700 1 -- 172.21.15.130:0/908821877 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26e4022470 con 0x7f26f4103f80 2024-05-03T22:08:52.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26fa600700 1 -- 172.21.15.130:0/908821877 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f41a3690 con 0x7f26f4103f80 2024-05-03T22:08:52.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26ebe00700 1 -- 172.21.15.130:0/908821877 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4004230 con 0x7f26f4103f80 2024-05-03T22:08:52.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.235+0000 7f26fa600700 1 -- 172.21.15.130:0/908821877 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f41a3ae0 con 0x7f26f4103f80 2024-05-03T22:08:52.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.237+0000 7f26fa600700 1 -- 172.21.15.130:0/908821877 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f406a190 con 0x7f26f4103f80 2024-05-03T22:08:52.239 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.239+0000 7f26ebe00700 1 -- 172.21.15.130:0/908821877 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f26e402a070 con 0x7f26f4103f80 2024-05-03T22:08:52.241 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.240+0000 7f26ebe00700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f26d80b2880 0x7f26d80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:08:52.241 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.241+0000 7f26ebe00700 1 -- 172.21.15.130:0/908821877 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5397+0+0 (secure 0 0 0) 0x7f26e40e2d30 con 0x7f26f4103f80 2024-05-03T22:08:52.242 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.241+0000 7f26f2a00700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f26d80b2880 0x7f26d80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:08:52.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.242+0000 7f26f2a00700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f26d80b2880 0x7f26d80b4d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f26e0005fd0 tx=0x7f26e000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:08:52.244 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.243+0000 7f26ebe00700 1 -- 172.21.15.130:0/908821877 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f26e4031070 con 0x7f26f4103f80 2024-05-03T22:08:52.488 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:08:52.487+0000 7f26fa600700 1 -- 172.21.15.130:0/908821877 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f26f40638e0 con 0x7f26d80b2880 2024-05-03T22:08:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:08:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:08:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:52.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:08:52.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:08:52.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:52.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:08:52.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:08:52.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:08:53.747 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:53 smithi130 ceph-mon[32417]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:08:53.747 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:53 smithi130 ceph-mon[32417]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 178 KiB/s, 0 objects/s recovering 2024-05-03T22:08:53.747 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:53 smithi130 ceph-mon[32417]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-03T22:08:53.747 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:53 smithi130 ceph-mon[32417]: Cluster is now healthy 2024-05-03T22:08:53.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:53 smithi116 ceph-mon[31828]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:08:53.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:53 smithi116 ceph-mon[31828]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 178 KiB/s, 0 objects/s recovering 2024-05-03T22:08:53.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:53 smithi116 ceph-mon[31828]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-03T22:08:53.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:53 smithi116 ceph-mon[31828]: Cluster is now healthy 2024-05-03T22:08:53.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:53 smithi082 ceph-mon[28404]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:08:53.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:53 smithi082 ceph-mon[28404]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 178 KiB/s, 0 objects/s recovering 2024-05-03T22:08:53.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:53 smithi082 ceph-mon[28404]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-03T22:08:53.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:53 smithi082 ceph-mon[28404]: Cluster is now healthy 2024-05-03T22:08:55.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:55 smithi116 ceph-mon[31828]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-03T22:08:55.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:55 smithi082 ceph-mon[28404]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-03T22:08:56.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:55 smithi130 ceph-mon[32417]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-03T22:08:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:56 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/621655070' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb8716a6-18d0-4b0a-ba8f-0809254e8982"}]: dispatch 2024-05-03T22:08:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:56 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb8716a6-18d0-4b0a-ba8f-0809254e8982"}]: dispatch 2024-05-03T22:08:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:56 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb8716a6-18d0-4b0a-ba8f-0809254e8982"}]': finished 2024-05-03T22:08:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:56 smithi116 ceph-mon[31828]: osdmap e52: 9 total, 8 up, 9 in 2024-05-03T22:08:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:56 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:08:56.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:56 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/621655070' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb8716a6-18d0-4b0a-ba8f-0809254e8982"}]: dispatch 2024-05-03T22:08:56.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:56 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb8716a6-18d0-4b0a-ba8f-0809254e8982"}]: dispatch 2024-05-03T22:08:56.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:56 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb8716a6-18d0-4b0a-ba8f-0809254e8982"}]': finished 2024-05-03T22:08:56.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:56 smithi082 ceph-mon[28404]: osdmap e52: 9 total, 8 up, 9 in 2024-05-03T22:08:56.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:56 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:08:57.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:56 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/621655070' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb8716a6-18d0-4b0a-ba8f-0809254e8982"}]: dispatch 2024-05-03T22:08:57.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:56 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb8716a6-18d0-4b0a-ba8f-0809254e8982"}]: dispatch 2024-05-03T22:08:57.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:56 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb8716a6-18d0-4b0a-ba8f-0809254e8982"}]': finished 2024-05-03T22:08:57.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:56 smithi130 ceph-mon[32417]: osdmap e52: 9 total, 8 up, 9 in 2024-05-03T22:08:57.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:56 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:08:57.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:57 smithi116 ceph-mon[31828]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-05-03T22:08:57.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:57 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/2488381512' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:08:57.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:57 smithi082 ceph-mon[28404]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-05-03T22:08:57.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:57 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/2488381512' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:08:58.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:57 smithi130 ceph-mon[32417]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-05-03T22:08:58.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:57 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/2488381512' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:08:59.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:08:59 smithi116 ceph-mon[31828]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-03T22:08:59.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:08:59 smithi082 ceph-mon[28404]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-03T22:09:00.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:08:59 smithi130 ceph-mon[32417]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-03T22:09:01.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:01 smithi116 ceph-mon[31828]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-03T22:09:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:01 smithi082 ceph-mon[28404]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-03T22:09:02.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:01 smithi130 ceph-mon[32417]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-03T22:09:03.689 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:03 smithi130 ceph-mon[32417]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:03.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:03 smithi116 ceph-mon[31828]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:03.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:03 smithi082 ceph-mon[28404]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:05.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:05 smithi116 ceph-mon[31828]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:05.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:05 smithi082 ceph-mon[28404]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:06.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:05 smithi130 ceph-mon[32417]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:06.845 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-03T22:09:06.846 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:06.846 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:06 smithi130 ceph-mon[32417]: Deploying daemon osd.8 on smithi130 2024-05-03T22:09:06.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-03T22:09:06.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:06.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:06 smithi116 ceph-mon[31828]: Deploying daemon osd.8 on smithi130 2024-05-03T22:09:06.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-03T22:09:06.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:06.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:06 smithi082 ceph-mon[28404]: Deploying daemon osd.8 on smithi130 2024-05-03T22:09:07.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:07 smithi130 ceph-mon[32417]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:07.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:07 smithi116 ceph-mon[31828]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:07.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:07 smithi082 ceph-mon[28404]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:09.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:09 smithi130 ceph-mon[32417]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:09.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:09 smithi116 ceph-mon[31828]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:09.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:09 smithi082 ceph-mon[28404]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:11.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:11 smithi116 ceph-mon[31828]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:11.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:11 smithi082 ceph-mon[28404]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:12.167 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:11 smithi130 ceph-mon[32417]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:13 smithi116 ceph-mon[31828]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:13.954 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:13 smithi130 ceph-mon[32417]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:13.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:13 smithi082 ceph-mon[28404]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:15.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:15.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:15.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:09:15.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:15.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:15.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:09:15.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:15.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:15.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:09:16.604 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:16 smithi130 ceph-mon[32417]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:16.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:16 smithi116 ceph-mon[31828]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:16 smithi082 ceph-mon[28404]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:18.459 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:18 smithi130 ceph-mon[32417]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:18.460 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:18.460 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:18 smithi116 ceph-mon[31828]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:18 smithi082 ceph-mon[28404]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:18.851 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 8 on host 'smithi130' 2024-05-03T22:09:18.852 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.849+0000 7f26ebe00700 1 -- 172.21.15.130:0/908821877 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f26f40638e0 con 0x7f26d80b2880 2024-05-03T22:09:18.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.851+0000 7f26fa600700 1 -- 172.21.15.130:0/908821877 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f26d80b2880 msgr2=0x7f26d80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:09:18.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.851+0000 7f26fa600700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f26d80b2880 0x7f26d80b4d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f26e0005fd0 tx=0x7f26e000a560 comp rx=0 tx=0).stop 2024-05-03T22:09:18.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.852+0000 7f26fa600700 1 -- 172.21.15.130:0/908821877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26f4103f80 msgr2=0x7f26f419b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:09:18.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.852+0000 7f26fa600700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26f4103f80 0x7f26f419b7a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f26e4005910 tx=0x7f26e4003970 comp rx=0 tx=0).stop 2024-05-03T22:09:18.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.852+0000 7f26fa600700 1 -- 172.21.15.130:0/908821877 shutdown_connections 2024-05-03T22:09:18.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.852+0000 7f26fa600700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f26d80b2880 0x7f26d80b4d40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:18.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.852+0000 7f26fa600700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26f41091e0 0x7f26f41a2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:18.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.852+0000 7f26fa600700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26f4103f80 0x7f26f419b7a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:18.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.852+0000 7f26fa600700 1 --2- 172.21.15.130:0/908821877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f41068b0 0x7f26f419bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:18.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.852+0000 7f26fa600700 1 -- 172.21.15.130:0/908821877 >> 172.21.15.130:0/908821877 conn(0x7f26f40fd990 msgr2=0x7f26f4103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:09:18.855 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.852+0000 7f26fa600700 1 -- 172.21.15.130:0/908821877 shutdown_connections 2024-05-03T22:09:18.855 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:09:18.852+0000 7f26fa600700 1 -- 172.21.15.130:0/908821877 wait complete. 2024-05-03T22:09:19.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:19 smithi130 ceph-mon[32417]: from='osd.8 [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:09:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:19 smithi130 ceph-mon[32417]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:09:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:19 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:19.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:19 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:19 smithi116 ceph-mon[31828]: from='osd.8 [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:09:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:19 smithi116 ceph-mon[31828]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:09:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:19 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:19 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:19.688 DEBUG:teuthology.orchestra.run.smithi130:osd.8> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.8.service 2024-05-03T22:09:19.694 INFO:tasks.cephadm:Deploying osd.9 on smithi082 with /dev/vg_nvme/lv_1... 2024-05-03T22:09:19.694 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-03T22:09:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:19 smithi082 ceph-mon[28404]: from='osd.8 [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:09:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:19 smithi082 ceph-mon[28404]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:09:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:19 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:19 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:09:20.574 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:20 smithi082 ceph-mon[28404]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:20.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:20 smithi082 ceph-mon[28404]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-03T22:09:20.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:20 smithi082 ceph-mon[28404]: from='osd.8 [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:09:20.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:20 smithi082 ceph-mon[28404]: osdmap e53: 9 total, 8 up, 9 in 2024-05-03T22:09:20.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:20.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:20 smithi082 ceph-mon[28404]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:09:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:20 smithi116 ceph-mon[31828]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:20 smithi116 ceph-mon[31828]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-03T22:09:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:20 smithi116 ceph-mon[31828]: from='osd.8 [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:09:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:20 smithi116 ceph-mon[31828]: osdmap e53: 9 total, 8 up, 9 in 2024-05-03T22:09:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:20 smithi116 ceph-mon[31828]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:09:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:20 smithi130 ceph-mon[32417]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:20 smithi130 ceph-mon[32417]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-03T22:09:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:20 smithi130 ceph-mon[32417]: from='osd.8 [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:09:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:20 smithi130 ceph-mon[32417]: osdmap e53: 9 total, 8 up, 9 in 2024-05-03T22:09:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:20 smithi130 ceph-mon[32417]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:09:20.778 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:09:20 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:09:20.350+0000 7fa0e7000700 -1 osd.8 0 waiting for initial osdmap 2024-05-03T22:09:20.778 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:09:20 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:09:20.373+0000 7fa0e1e00700 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:09:21.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:21 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:09:21.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:21 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:09:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:21 smithi130 ceph-mon[32417]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:09:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:21 smithi130 ceph-mon[32417]: osdmap e54: 9 total, 8 up, 9 in 2024-05-03T22:09:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:21 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:21 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:21 smithi130 ceph-mon[32417]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:21.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:21 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:09:21.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:21 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:09:21.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:21 smithi116 ceph-mon[31828]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:09:21.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:21 smithi116 ceph-mon[31828]: osdmap e54: 9 total, 8 up, 9 in 2024-05-03T22:09:21.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:21 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:21.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:21 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:21.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:21 smithi116 ceph-mon[31828]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:21.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:21 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:09:21.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:21 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:09:21.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:21 smithi082 ceph-mon[28404]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:09:21.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:21 smithi082 ceph-mon[28404]: osdmap e54: 9 total, 8 up, 9 in 2024-05-03T22:09:21.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:21 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:21.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:21 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:21.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:21 smithi082 ceph-mon[28404]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:09:22.419 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:22 smithi082 ceph-mon[28404]: osd.8 [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581] boot 2024-05-03T22:09:22.419 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:22 smithi082 ceph-mon[28404]: osdmap e55: 9 total, 9 up, 9 in 2024-05-03T22:09:22.419 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:22 smithi116 ceph-mon[31828]: osd.8 [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581] boot 2024-05-03T22:09:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:22 smithi116 ceph-mon[31828]: osdmap e55: 9 total, 9 up, 9 in 2024-05-03T22:09:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:22 smithi130 ceph-mon[32417]: osd.8 [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581] boot 2024-05-03T22:09:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:22 smithi130 ceph-mon[32417]: osdmap e55: 9 total, 9 up, 9 in 2024-05-03T22:09:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:09:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-03T22:09:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-03T22:09:23.455 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-03T22:09:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-03T22:09:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0538862 s, 195 MB/s 2024-05-03T22:09:23.455 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-03T22:09:23.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:23 smithi116 ceph-mon[31828]: osdmap e56: 9 total, 9 up, 9 in 2024-05-03T22:09:23.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:23 smithi116 ceph-mon[31828]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:23.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:23 smithi116 ceph-mon[31828]: osdmap e57: 9 total, 9 up, 9 in 2024-05-03T22:09:23.704 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:23 smithi130 ceph-mon[32417]: osdmap e56: 9 total, 9 up, 9 in 2024-05-03T22:09:23.704 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:23 smithi130 ceph-mon[32417]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:23.704 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:23 smithi130 ceph-mon[32417]: osdmap e57: 9 total, 9 up, 9 in 2024-05-03T22:09:23.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:23 smithi082 ceph-mon[28404]: osdmap e56: 9 total, 9 up, 9 in 2024-05-03T22:09:23.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:23 smithi082 ceph-mon[28404]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:23.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:23 smithi082 ceph-mon[28404]: osdmap e57: 9 total, 9 up, 9 in 2024-05-03T22:09:24.511 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2024-05-03T22:09:25.001 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:09:25.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: pgmap v251: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:25.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi130 2024-05-03T22:09:25.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:25.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:25.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:09:25.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:09:25.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:09:25.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi130 to 5696M 2024-05-03T22:09:25.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:25.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:25.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:09:25.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:25.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:09:25.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:25.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:09:25.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:25 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:25.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: pgmap v251: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:25.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi130 2024-05-03T22:09:25.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:25.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:25.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:09:25.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:09:25.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:09:25.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi130 to 5696M 2024-05-03T22:09:25.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:25.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:25.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:09:25.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:25.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:09:25.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:25.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:09:25.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:25 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:26.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: pgmap v251: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:26.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi130 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi130 to 5696M 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:09:26.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:25 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:27.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.526+0000 7f819ec00700 1 -- 172.21.15.82:0/36622101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8198109120 msgr2=0x7f819810b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:09:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.526+0000 7f819ec00700 1 --2- 172.21.15.82:0/36622101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8198109120 0x7f819810b590 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f819000b0a0 tx=0x7f819000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:09:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.527+0000 7f819ec00700 1 -- 172.21.15.82:0/36622101 shutdown_connections 2024-05-03T22:09:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.527+0000 7f819ec00700 1 --2- 172.21.15.82:0/36622101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8198109120 0x7f819810b590 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.527+0000 7f819ec00700 1 --2- 172.21.15.82:0/36622101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8198103ec0 0x7f81981062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.527+0000 7f819ec00700 1 --2- 172.21.15.82:0/36622101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81981067f0 0x7f8198108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.527+0000 7f819ec00700 1 -- 172.21.15.82:0/36622101 >> 172.21.15.82:0/36622101 conn(0x7f81980fd8d0 msgr2=0x7f81980ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:09:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.527+0000 7f819ec00700 1 -- 172.21.15.82:0/36622101 shutdown_connections 2024-05-03T22:09:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.527+0000 7f819ec00700 1 -- 172.21.15.82:0/36622101 wait complete. 2024-05-03T22:09:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.528+0000 7f819ec00700 1 Processor -- start 2024-05-03T22:09:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.528+0000 7f819ec00700 1 -- start start 2024-05-03T22:09:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.528+0000 7f819ec00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8198103ec0 0x7f819819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:09:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.528+0000 7f819ec00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81981067f0 0x7f819819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:09:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.528+0000 7f819ec00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8198109120 0x7f81981a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:09:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.528+0000 7f819ec00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f819810edb0 con 0x7f8198109120 2024-05-03T22:09:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.528+0000 7f819ec00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f819810ec30 con 0x7f8198103ec0 2024-05-03T22:09:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.528+0000 7f819ec00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f819810ef30 con 0x7f81981067f0 2024-05-03T22:09:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819e200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8198109120 0x7f81981a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:09:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819e200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8198109120 0x7f81981a2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41704/0 (socket says 172.21.15.82:41704) 2024-05-03T22:09:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819e200700 1 -- 172.21.15.82:0/3489910361 learned_addr learned my addr 172.21.15.82:0/3489910361 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:09:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819d800700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8198103ec0 0x7f819819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:09:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819ce00700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81981067f0 0x7f819819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:09:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819e200700 1 -- 172.21.15.82:0/3489910361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81981067f0 msgr2=0x7f819819bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:09:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819e200700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81981067f0 0x7f819819bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819e200700 1 -- 172.21.15.82:0/3489910361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8198103ec0 msgr2=0x7f819819b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:09:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819e200700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8198103ec0 0x7f819819b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819e200700 1 -- 172.21.15.82:0/3489910361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81981a32b0 con 0x7f8198109120 2024-05-03T22:09:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819ce00700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81981067f0 0x7f819819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:09:27.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.529+0000 7f819e200700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8198109120 0x7f81981a2c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f819000b070 tx=0x7f819000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:09:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.530+0000 7f8196000700 1 -- 172.21.15.82:0/3489910361 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8190021070 con 0x7f8198109120 2024-05-03T22:09:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.530+0000 7f8196000700 1 -- 172.21.15.82:0/3489910361 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8190007c00 con 0x7f8198109120 2024-05-03T22:09:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.530+0000 7f819ec00700 1 -- 172.21.15.82:0/3489910361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81981a3540 con 0x7f8198109120 2024-05-03T22:09:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.530+0000 7f8196000700 1 -- 172.21.15.82:0/3489910361 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8190005040 con 0x7f8198109120 2024-05-03T22:09:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.530+0000 7f819ec00700 1 -- 172.21.15.82:0/3489910361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81981a3990 con 0x7f8198109120 2024-05-03T22:09:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.531+0000 7f819ec00700 1 -- 172.21.15.82:0/3489910361 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f819806a190 con 0x7f8198109120 2024-05-03T22:09:27.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.534+0000 7f8196000700 1 -- 172.21.15.82:0/3489910361 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8190003a00 con 0x7f8198109120 2024-05-03T22:09:27.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.535+0000 7f8196000700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f81800b2880 0x7f81800b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:09:27.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.536+0000 7f8196000700 1 -- 172.21.15.82:0/3489910361 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5829+0+0 (secure 0 0 0) 0x7f819000f020 con 0x7f8198109120 2024-05-03T22:09:27.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.536+0000 7f819d800700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f81800b2880 0x7f81800b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:09:27.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.536+0000 7f819d800700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f81800b2880 0x7f81800b4d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f818c005950 tx=0x7f818c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:09:27.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.538+0000 7f8196000700 1 -- 172.21.15.82:0/3489910361 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f819002a020 con 0x7f8198109120 2024-05-03T22:09:27.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:27 smithi082 ceph-mon[28404]: pgmap v252: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:27.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:27.784+0000 7f819ec00700 1 -- 172.21.15.82:0/3489910361 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f81980638e0 con 0x7f81800b2880 2024-05-03T22:09:27.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:27 smithi116 ceph-mon[31828]: pgmap v252: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:28.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:27 smithi130 ceph-mon[32417]: pgmap v252: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:28.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:28 smithi116 ceph-mon[31828]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:09:28.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:09:28.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:09:28.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:28.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:28 smithi082 ceph-mon[28404]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:09:28.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:09:28.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:09:28.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:29.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:28 smithi130 ceph-mon[32417]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:09:29.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:09:29.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:09:29.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:30.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:29 smithi116 ceph-mon[31828]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-03T22:09:30.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:29 smithi082 ceph-mon[28404]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-03T22:09:30.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:29 smithi130 ceph-mon[32417]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-03T22:09:32.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:31 smithi116 ceph-mon[31828]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-03T22:09:32.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:31 smithi082 ceph-mon[28404]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-03T22:09:32.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:31 smithi130 ceph-mon[32417]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-03T22:09:33.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:32 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3902459498' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63a902a4-e216-4a8e-b994-f328086a584d"}]: dispatch 2024-05-03T22:09:33.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:32 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3902459498' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63a902a4-e216-4a8e-b994-f328086a584d"}]': finished 2024-05-03T22:09:33.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:32 smithi082 ceph-mon[28404]: osdmap e58: 10 total, 9 up, 10 in 2024-05-03T22:09:33.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:33.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:32 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3902459498' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63a902a4-e216-4a8e-b994-f328086a584d"}]: dispatch 2024-05-03T22:09:33.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:32 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3902459498' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63a902a4-e216-4a8e-b994-f328086a584d"}]': finished 2024-05-03T22:09:33.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:32 smithi116 ceph-mon[31828]: osdmap e58: 10 total, 9 up, 10 in 2024-05-03T22:09:33.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:33.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:32 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3902459498' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63a902a4-e216-4a8e-b994-f328086a584d"}]: dispatch 2024-05-03T22:09:33.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:32 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3902459498' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63a902a4-e216-4a8e-b994-f328086a584d"}]': finished 2024-05-03T22:09:33.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:32 smithi130 ceph-mon[32417]: osdmap e58: 10 total, 9 up, 10 in 2024-05-03T22:09:33.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:34.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:33 smithi116 ceph-mon[31828]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-05-03T22:09:34.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:33 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1919102887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:09:34.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:33 smithi082 ceph-mon[28404]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-05-03T22:09:34.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:33 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1919102887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:09:34.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:33 smithi130 ceph-mon[32417]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-05-03T22:09:34.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:33 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1919102887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:09:36.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:35 smithi116 ceph-mon[31828]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:09:36.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:35 smithi082 ceph-mon[28404]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:09:36.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:35 smithi130 ceph-mon[32417]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:09:38.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:37 smithi116 ceph-mon[31828]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:09:38.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:37 smithi082 ceph-mon[28404]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:09:38.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:37 smithi130 ceph-mon[32417]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:09:40.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:39 smithi116 ceph-mon[31828]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:40.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:39 smithi082 ceph-mon[28404]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:40.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:39 smithi130 ceph-mon[32417]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:42.175 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:41 smithi082 ceph-mon[28404]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:42.184 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:41 smithi116 ceph-mon[31828]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:42.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:41 smithi130 ceph-mon[32417]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:43.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:42 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-03T22:09:43.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:42 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:43.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:42 smithi116 ceph-mon[31828]: Deploying daemon osd.9 on smithi082 2024-05-03T22:09:43.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:42 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-03T22:09:43.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:42 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:43.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:42 smithi082 ceph-mon[28404]: Deploying daemon osd.9 on smithi082 2024-05-03T22:09:43.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:42 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-03T22:09:43.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:42 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:09:43.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:42 smithi130 ceph-mon[32417]: Deploying daemon osd.9 on smithi082 2024-05-03T22:09:44.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:43 smithi116 ceph-mon[31828]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:44.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:43 smithi082 ceph-mon[28404]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:44.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:43 smithi130 ceph-mon[32417]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:46.055 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:45 smithi082 ceph-mon[28404]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:46.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:45 smithi116 ceph-mon[31828]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:46.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:45 smithi130 ceph-mon[32417]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:48.081 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:47 smithi082 ceph-mon[28404]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:48.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:47 smithi116 ceph-mon[31828]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:48.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:47 smithi130 ceph-mon[32417]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:50.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:49 smithi116 ceph-mon[31828]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:50.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:49 smithi082 ceph-mon[28404]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:50.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:49 smithi130 ceph-mon[32417]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:52.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:51 smithi116 ceph-mon[31828]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:52.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:52.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:52.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:09:52.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:51 smithi082 ceph-mon[28404]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:52.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:52.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:52.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:09:52.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:51 smithi130 ceph-mon[32417]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:52.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:52.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:52.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:09:53.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:53 smithi082 ceph-mon[28404]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:54.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:53 smithi130 ceph-mon[32417]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:53 smithi116 ceph-mon[31828]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:56.225 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:55 smithi082 ceph-mon[28404]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:56.225 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:55 smithi082 ceph-mon[28404]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-03T22:09:56.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:55 smithi130 ceph-mon[32417]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:56.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:55 smithi130 ceph-mon[32417]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-03T22:09:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:55 smithi116 ceph-mon[31828]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:55 smithi116 ceph-mon[31828]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-03T22:09:56.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:56 smithi082 ceph-mon[28404]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-03T22:09:56.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:56 smithi082 ceph-mon[28404]: osdmap e59: 10 total, 9 up, 10 in 2024-05-03T22:09:56.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:56 smithi082 ceph-mon[28404]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:09:56.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:56 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:56.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:56 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:56.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:56 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:56.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:56 smithi082 ceph-mon[28404]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:09:56.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:56 smithi082 ceph-mon[28404]: osdmap e60: 10 total, 9 up, 10 in 2024-05-03T22:09:57.233 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 9 on host 'smithi082' 2024-05-03T22:09:57.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.230+0000 7f8196000700 1 -- 172.21.15.82:0/3489910361 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f81980638e0 con 0x7f81800b2880 2024-05-03T22:09:57.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 -- 172.21.15.82:0/3489910361 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f81800b2880 msgr2=0x7f81800b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:09:57.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f81800b2880 0x7f81800b4d40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f818c005950 tx=0x7f818c0058e0 comp rx=0 tx=0).stop 2024-05-03T22:09:57.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 -- 172.21.15.82:0/3489910361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8198109120 msgr2=0x7f81981a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:09:57.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8198109120 0x7f81981a2c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f819000b070 tx=0x7f819000bd70 comp rx=0 tx=0).stop 2024-05-03T22:09:57.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 -- 172.21.15.82:0/3489910361 shutdown_connections 2024-05-03T22:09:57.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f81800b2880 0x7f81800b4d40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:57.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8198109120 0x7f81981a2c10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:57.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8198103ec0 0x7f819819b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:57.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 --2- 172.21.15.82:0/3489910361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81981067f0 0x7f819819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:09:57.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 -- 172.21.15.82:0/3489910361 >> 172.21.15.82:0/3489910361 conn(0x7f81980fd8d0 msgr2=0x7f81981035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:09:57.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 -- 172.21.15.82:0/3489910361 shutdown_connections 2024-05-03T22:09:57.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:09:57.233+0000 7f819ec00700 1 -- 172.21.15.82:0/3489910361 wait complete. 2024-05-03T22:09:57.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:56 smithi130 ceph-mon[32417]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-03T22:09:57.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:56 smithi130 ceph-mon[32417]: osdmap e59: 10 total, 9 up, 10 in 2024-05-03T22:09:57.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:56 smithi130 ceph-mon[32417]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:09:57.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:56 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:57.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:56 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:57.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:56 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:57.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:56 smithi130 ceph-mon[32417]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:09:57.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:56 smithi130 ceph-mon[32417]: osdmap e60: 10 total, 9 up, 10 in 2024-05-03T22:09:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:56 smithi116 ceph-mon[31828]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-03T22:09:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:56 smithi116 ceph-mon[31828]: osdmap e59: 10 total, 9 up, 10 in 2024-05-03T22:09:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:56 smithi116 ceph-mon[31828]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-03T22:09:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:56 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:56 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:56 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:56 smithi116 ceph-mon[31828]: from='osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-03T22:09:57.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:56 smithi116 ceph-mon[31828]: osdmap e60: 10 total, 9 up, 10 in 2024-05-03T22:09:58.189 DEBUG:teuthology.orchestra.run.smithi082:osd.9> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.9.service 2024-05-03T22:09:58.194 INFO:tasks.cephadm:Deploying osd.10 on smithi116 with /dev/vg_nvme/lv_1... 2024-05-03T22:09:58.194 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-03T22:09:58.256 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:57 smithi082 ceph-mon[28404]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:58.256 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:58.257 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:58.257 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:58.257 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:58.266 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:57 smithi116 ceph-mon[31828]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:58.266 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:58.266 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:58.266 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:58.267 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:58.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:57 smithi130 ceph-mon[32417]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:09:58.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:58.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:58.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:58.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:09:58.647 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:09:59.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:58 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:09:59.117 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:58 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:09:59.117 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:58 smithi116 ceph-mon[31828]: osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669] boot 2024-05-03T22:09:59.117 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:58 smithi116 ceph-mon[31828]: osdmap e61: 10 total, 10 up, 10 in 2024-05-03T22:09:59.117 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:58 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:59.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:58 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:09:59.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:58 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:09:59.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:58 smithi082 ceph-mon[28404]: osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669] boot 2024-05-03T22:09:59.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:58 smithi082 ceph-mon[28404]: osdmap e61: 10 total, 10 up, 10 in 2024-05-03T22:09:59.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:58 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:09:59.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:58 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:09:59.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:58 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:09:59.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:58 smithi130 ceph-mon[32417]: osd.9 [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669] boot 2024-05-03T22:09:59.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:58 smithi130 ceph-mon[32417]: osdmap e61: 10 total, 10 up, 10 in 2024-05-03T22:09:59.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:58 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:10:00.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:59 smithi130 ceph-mon[32417]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:10:00.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:09:59 smithi130 ceph-mon[32417]: osdmap e62: 10 total, 10 up, 10 in 2024-05-03T22:10:00.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:59 smithi082 ceph-mon[28404]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:10:00.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:09:59 smithi082 ceph-mon[28404]: osdmap e62: 10 total, 10 up, 10 in 2024-05-03T22:10:00.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:59 smithi116 ceph-mon[31828]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:10:00.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:09:59 smithi116 ceph-mon[31828]: osdmap e62: 10 total, 10 up, 10 in 2024-05-03T22:10:01.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:00 smithi130 ceph-mon[32417]: overall HEALTH_OK 2024-05-03T22:10:01.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:00 smithi116 ceph-mon[31828]: overall HEALTH_OK 2024-05-03T22:10:01.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:00 smithi082 ceph-mon[28404]: overall HEALTH_OK 2024-05-03T22:10:01.576 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-03T22:10:01.576 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-03T22:10:01.576 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2024-05-03T22:10:01.576 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2024-05-03T22:10:01.576 INFO:teuthology.orchestra.run.smithi116.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0374007 s, 280 MB/s 2024-05-03T22:10:01.576 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2024-05-03T22:10:02.276 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:02 smithi116 ceph-mon[31828]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:02.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:02 smithi130 ceph-mon[32417]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:02 smithi082 ceph-mon[28404]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:02.565 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_1 2024-05-03T22:10:02.968 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:10:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi082 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi082 to 4272M 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:04.529 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:04 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:04.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi082 2024-05-03T22:10:04.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi082 to 4272M 2024-05-03T22:10:04.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:04.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:04.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:10:04.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:04.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:04.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:04 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:04.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi082 2024-05-03T22:10:04.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:04.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi082 to 4272M 2024-05-03T22:10:04.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:04.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:04.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:04.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:10:04.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:04.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:04.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:04 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:05.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.188+0000 7f4283000700 1 -- 172.21.15.116:0/2013804747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f427c103430 msgr2=0x7f427c103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:10:05.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.188+0000 7f4283000700 1 --2- 172.21.15.116:0/2013804747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f427c103430 0x7f427c103850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f42700099c0 tx=0x7f4270009cd0 comp rx=0 tx=0).stop 2024-05-03T22:10:05.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.188+0000 7f4283000700 1 -- 172.21.15.116:0/2013804747 shutdown_connections 2024-05-03T22:10:05.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.188+0000 7f4283000700 1 --2- 172.21.15.116:0/2013804747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f427c104fd0 0x7f427c10b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:05.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.188+0000 7f4283000700 1 --2- 172.21.15.116:0/2013804747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f427c103430 0x7f427c103850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:05.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.188+0000 7f4283000700 1 --2- 172.21.15.116:0/2013804747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f427c104630 0x7f427c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:05.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.188+0000 7f4283000700 1 -- 172.21.15.116:0/2013804747 >> 172.21.15.116:0/2013804747 conn(0x7f427c0fe9d0 msgr2=0x7f427c100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:10:05.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.188+0000 7f4283000700 1 -- 172.21.15.116:0/2013804747 shutdown_connections 2024-05-03T22:10:05.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.189+0000 7f4283000700 1 -- 172.21.15.116:0/2013804747 wait complete. 2024-05-03T22:10:05.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.189+0000 7f4283000700 1 Processor -- start 2024-05-03T22:10:05.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.190+0000 7f4283000700 1 -- start start 2024-05-03T22:10:05.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.190+0000 7f4283000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f427c103430 0x7f427c0771f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:10:05.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.190+0000 7f4283000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f427c104630 0x7f427c075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:10:05.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.190+0000 7f4283000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f427c104fd0 0x7f427c075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:10:05.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.190+0000 7f4283000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10edd0 con 0x7f427c104fd0 2024-05-03T22:10:05.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.190+0000 7f4283000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10ec50 con 0x7f427c103430 2024-05-03T22:10:05.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.190+0000 7f4283000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10ef50 con 0x7f427c104630 2024-05-03T22:10:05.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.190+0000 7f4281c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f427c103430 0x7f427c0771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:10:05.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.190+0000 7f4281c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f427c103430 0x7f427c0771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36912/0 (socket says 172.21.15.116:36912) 2024-05-03T22:10:05.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.190+0000 7f4281c00700 1 -- 172.21.15.116:0/2515256620 learned_addr learned my addr 172.21.15.116:0/2515256620 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-05-03T22:10:05.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f4281200700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f427c104630 0x7f427c075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:10:05.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f4282600700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f427c104fd0 0x7f427c075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f4281c00700 1 -- 172.21.15.116:0/2515256620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f427c104630 msgr2=0x7f427c075890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f4281c00700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f427c104630 0x7f427c075890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f4281c00700 1 -- 172.21.15.116:0/2515256620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f427c104fd0 msgr2=0x7f427c075dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f4281c00700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f427c104fd0 0x7f427c075dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f4281c00700 1 -- 172.21.15.116:0/2515256620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c0766a0 con 0x7f427c103430 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f4282600700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f427c104fd0 0x7f427c075dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f4281c00700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f427c103430 0x7f427c0771f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f42700098e0 tx=0x7f427000f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f427a000700 1 -- 172.21.15.116:0/2515256620 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4270027070 con 0x7f427c103430 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f427a000700 1 -- 172.21.15.116:0/2515256620 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f427000bd10 con 0x7f427c103430 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.191+0000 7f4283000700 1 -- 172.21.15.116:0/2515256620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427c1a3540 con 0x7f427c103430 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.192+0000 7f427a000700 1 -- 172.21.15.116:0/2515256620 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42700037f0 con 0x7f427c103430 2024-05-03T22:10:05.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.192+0000 7f4283000700 1 -- 172.21.15.116:0/2515256620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427c1a3a40 con 0x7f427c103430 2024-05-03T22:10:05.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.193+0000 7f4283000700 1 -- 172.21.15.116:0/2515256620 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427c06a190 con 0x7f427c103430 2024-05-03T22:10:05.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.195+0000 7f427a000700 1 -- 172.21.15.116:0/2515256620 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f427002a070 con 0x7f427c103430 2024-05-03T22:10:05.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.196+0000 7f427a000700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f42640b2900 0x7f42640b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:10:05.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.197+0000 7f427a000700 1 -- 172.21.15.116:0/2515256620 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6261+0+0 (secure 0 0 0) 0x7f42700e2a50 con 0x7f427c103430 2024-05-03T22:10:05.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.197+0000 7f4281200700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f42640b2900 0x7f42640b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:10:05.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.198+0000 7f4281200700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f42640b2900 0x7f42640b4dc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4268005fd0 tx=0x7f426800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:10:05.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.201+0000 7f427a000700 1 -- 172.21.15.116:0/2515256620 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4270013070 con 0x7f427c103430 2024-05-03T22:10:05.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:05.446+0000 7f4283000700 1 -- 172.21.15.116:0/2515256620 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f427c02e970 con 0x7f42640b2900 2024-05-03T22:10:06.541 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:06 smithi116 ceph-mon[31828]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:06.541 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:10:06.541 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:10:06.541 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:06.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:06 smithi082 ceph-mon[28404]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:06.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:10:06.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:10:06.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:06 smithi130 ceph-mon[32417]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:10:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:10:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:07.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:07 smithi116 ceph-mon[31828]: from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:10:07.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:07 smithi082 ceph-mon[28404]: from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:10:07.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:07 smithi130 ceph-mon[32417]: from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:10:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:08 smithi116 ceph-mon[31828]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:08.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:08 smithi082 ceph-mon[28404]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:08.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:08 smithi130 ceph-mon[32417]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:10 smithi116 ceph-mon[31828]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:10 smithi116 ceph-mon[31828]: from='client.? 172.21.15.116:0/1403392341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c49c2ad-a223-4996-aa9b-c44f37a029b5"}]: dispatch 2024-05-03T22:10:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:10 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c49c2ad-a223-4996-aa9b-c44f37a029b5"}]: dispatch 2024-05-03T22:10:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:10 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c49c2ad-a223-4996-aa9b-c44f37a029b5"}]': finished 2024-05-03T22:10:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:10 smithi116 ceph-mon[31828]: osdmap e63: 11 total, 10 up, 11 in 2024-05-03T22:10:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:10 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:10 smithi082 ceph-mon[28404]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:10 smithi082 ceph-mon[28404]: from='client.? 172.21.15.116:0/1403392341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c49c2ad-a223-4996-aa9b-c44f37a029b5"}]: dispatch 2024-05-03T22:10:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:10 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c49c2ad-a223-4996-aa9b-c44f37a029b5"}]: dispatch 2024-05-03T22:10:10.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:10 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c49c2ad-a223-4996-aa9b-c44f37a029b5"}]': finished 2024-05-03T22:10:10.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:10 smithi082 ceph-mon[28404]: osdmap e63: 11 total, 10 up, 11 in 2024-05-03T22:10:10.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:10 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:10 smithi130 ceph-mon[32417]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:10 smithi130 ceph-mon[32417]: from='client.? 172.21.15.116:0/1403392341' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c49c2ad-a223-4996-aa9b-c44f37a029b5"}]: dispatch 2024-05-03T22:10:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:10 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c49c2ad-a223-4996-aa9b-c44f37a029b5"}]: dispatch 2024-05-03T22:10:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:10 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c49c2ad-a223-4996-aa9b-c44f37a029b5"}]': finished 2024-05-03T22:10:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:10 smithi130 ceph-mon[32417]: osdmap e63: 11 total, 10 up, 11 in 2024-05-03T22:10:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:10 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:11 smithi116 ceph-mon[31828]: from='client.? 172.21.15.116:0/3401268202' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:10:11.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:11 smithi082 ceph-mon[28404]: from='client.? 172.21.15.116:0/3401268202' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:10:11.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:11 smithi130 ceph-mon[32417]: from='client.? 172.21.15.116:0/3401268202' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:10:12.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:12 smithi116 ceph-mon[31828]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:12 smithi082 ceph-mon[28404]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:12.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:12 smithi130 ceph-mon[32417]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:14.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:14 smithi116 ceph-mon[31828]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:14 smithi082 ceph-mon[28404]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:14.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:14 smithi130 ceph-mon[32417]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:15.658 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:15 smithi116 ceph-mon[31828]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:15.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:15 smithi082 ceph-mon[28404]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:15.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:15 smithi130 ceph-mon[32417]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:17.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:17 smithi116 ceph-mon[31828]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:17.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:17 smithi082 ceph-mon[28404]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:18.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:17 smithi130 ceph-mon[32417]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:19.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:19 smithi116 ceph-mon[31828]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:19.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:19 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-03T22:10:19.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:19 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:19.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:19 smithi116 ceph-mon[31828]: Deploying daemon osd.10 on smithi116 2024-05-03T22:10:19.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:19 smithi082 ceph-mon[28404]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:19.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:19 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-03T22:10:19.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:19 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:19.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:19 smithi082 ceph-mon[28404]: Deploying daemon osd.10 on smithi116 2024-05-03T22:10:20.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:19 smithi130 ceph-mon[32417]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:20.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:19 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-03T22:10:20.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:19 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:20.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:19 smithi130 ceph-mon[32417]: Deploying daemon osd.10 on smithi116 2024-05-03T22:10:21.801 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:21 smithi116 ceph-mon[31828]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:21.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:21 smithi082 ceph-mon[28404]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:22.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:21 smithi130 ceph-mon[32417]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:23.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:23 smithi116 ceph-mon[31828]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:23 smithi082 ceph-mon[28404]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:24.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:23 smithi130 ceph-mon[32417]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:25.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:25 smithi116 ceph-mon[31828]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:25.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:25 smithi082 ceph-mon[28404]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:26.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:25 smithi130 ceph-mon[32417]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:28 smithi082 ceph-mon[28404]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:10:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:28.521 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:28 smithi116 ceph-mon[31828]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:28.521 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:28.521 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:10:28.521 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:28.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:28 smithi130 ceph-mon[32417]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:10:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:30.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:30 smithi130 ceph-mon[32417]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:30.549 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:30 smithi116 ceph-mon[31828]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:30.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:30 smithi082 ceph-mon[28404]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:32.179 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:31 smithi116 ceph-mon[31828]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:32.179 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:32.179 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:32.179 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:31 smithi116 ceph-mon[31828]: from='osd.10 [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:10:32.179 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:31 smithi116 ceph-mon[31828]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:10:32.180 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 10 on host 'smithi116' 2024-05-03T22:10:32.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.176+0000 7f427a000700 1 -- 172.21.15.116:0/2515256620 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f426800e870 con 0x7f42640b2900 2024-05-03T22:10:32.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.180+0000 7f4283000700 1 -- 172.21.15.116:0/2515256620 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f42640b2900 msgr2=0x7f42640b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:10:32.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.180+0000 7f4283000700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f42640b2900 0x7f42640b4dc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4268005fd0 tx=0x7f426800a560 comp rx=0 tx=0).stop 2024-05-03T22:10:32.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.180+0000 7f4283000700 1 -- 172.21.15.116:0/2515256620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f427c103430 msgr2=0x7f427c0771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:10:32.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.180+0000 7f4283000700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f427c103430 0x7f427c0771f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f42700098e0 tx=0x7f427000f740 comp rx=0 tx=0).stop 2024-05-03T22:10:32.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.181+0000 7f4283000700 1 -- 172.21.15.116:0/2515256620 shutdown_connections 2024-05-03T22:10:32.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.181+0000 7f4283000700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f42640b2900 0x7f42640b4dc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:32.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.181+0000 7f4283000700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f427c104fd0 0x7f427c075dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:32.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.181+0000 7f4283000700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f427c103430 0x7f427c0771f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:32.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.181+0000 7f4283000700 1 --2- 172.21.15.116:0/2515256620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f427c104630 0x7f427c075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:32.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.181+0000 7f4283000700 1 -- 172.21.15.116:0/2515256620 >> 172.21.15.116:0/2515256620 conn(0x7f427c0fe9d0 msgr2=0x7f427c107a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:10:32.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.181+0000 7f4283000700 1 -- 172.21.15.116:0/2515256620 shutdown_connections 2024-05-03T22:10:32.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-05-03T22:10:32.181+0000 7f4283000700 1 -- 172.21.15.116:0/2515256620 wait complete. 2024-05-03T22:10:32.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:31 smithi082 ceph-mon[28404]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:32.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:32.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:32.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:31 smithi082 ceph-mon[28404]: from='osd.10 [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:10:32.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:31 smithi082 ceph-mon[28404]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:10:32.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:31 smithi130 ceph-mon[32417]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:32.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:32.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:32.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:31 smithi130 ceph-mon[32417]: from='osd.10 [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:10:32.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:31 smithi130 ceph-mon[32417]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:10:33.036 DEBUG:teuthology.orchestra.run.smithi116:osd.10> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.10.service 2024-05-03T22:10:33.041 INFO:tasks.cephadm:Deploying osd.11 on smithi130 with /dev/vg_nvme/lv_1... 2024-05-03T22:10:33.041 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-03T22:10:33.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:33 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:33.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:33 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:33.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:33 smithi130 ceph-mon[32417]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-03T22:10:33.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:33 smithi130 ceph-mon[32417]: osdmap e64: 11 total, 10 up, 11 in 2024-05-03T22:10:33.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:33 smithi130 ceph-mon[32417]: from='osd.10 [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:10:33.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:33 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:33.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:33 smithi130 ceph-mon[32417]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:10:33.298 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:33 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:33.298 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:33 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:33.298 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:33 smithi116 ceph-mon[31828]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-03T22:10:33.298 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:33 smithi116 ceph-mon[31828]: osdmap e64: 11 total, 10 up, 11 in 2024-05-03T22:10:33.298 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:33 smithi116 ceph-mon[31828]: from='osd.10 [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:10:33.298 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:33 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:33.298 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:33 smithi116 ceph-mon[31828]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:10:33.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:33.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:33.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:33 smithi082 ceph-mon[28404]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-03T22:10:33.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:33 smithi082 ceph-mon[28404]: osdmap e64: 11 total, 10 up, 11 in 2024-05-03T22:10:33.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:33 smithi082 ceph-mon[28404]: from='osd.10 [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:10:33.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:33 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:33.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:33 smithi082 ceph-mon[28404]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-05-03T22:10:33.483 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:10:34.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:34 smithi116 ceph-mon[31828]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:34.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:34 smithi116 ceph-mon[31828]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:10:34.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:34 smithi116 ceph-mon[31828]: osdmap e65: 11 total, 10 up, 11 in 2024-05-03T22:10:34.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:34 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:34.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:34 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:34.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:34 smithi116 ceph-mon[31828]: osdmap e66: 11 total, 10 up, 11 in 2024-05-03T22:10:34.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:34 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:34.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:34 smithi116 ceph-mon[31828]: from='osd.10 ' entity='osd.10' 2024-05-03T22:10:34.436 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:10:34 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:10:34.075+0000 7fb369200700 -1 osd.10 0 waiting for initial osdmap 2024-05-03T22:10:34.437 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:10:34 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:10:34.103+0000 7fb35e600700 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:10:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:34 smithi130 ceph-mon[32417]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:34.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:34 smithi130 ceph-mon[32417]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:10:34.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:34 smithi130 ceph-mon[32417]: osdmap e65: 11 total, 10 up, 11 in 2024-05-03T22:10:34.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:34 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:34.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:34 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:34.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:34 smithi130 ceph-mon[32417]: osdmap e66: 11 total, 10 up, 11 in 2024-05-03T22:10:34.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:34 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:34.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:34 smithi130 ceph-mon[32417]: from='osd.10 ' entity='osd.10' 2024-05-03T22:10:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:34 smithi082 ceph-mon[28404]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:34 smithi082 ceph-mon[28404]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-05-03T22:10:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:34 smithi082 ceph-mon[28404]: osdmap e65: 11 total, 10 up, 11 in 2024-05-03T22:10:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:34 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:34 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:34 smithi082 ceph-mon[28404]: osdmap e66: 11 total, 10 up, 11 in 2024-05-03T22:10:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:34 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:34 smithi082 ceph-mon[28404]: from='osd.10 ' entity='osd.10' 2024-05-03T22:10:35.387 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:35 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:10:35.387 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:35 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:10:35.387 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:35 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:35.387 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:35 smithi130 ceph-mon[32417]: osd.10 [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329] boot 2024-05-03T22:10:35.387 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:35 smithi130 ceph-mon[32417]: osdmap e67: 11 total, 11 up, 11 in 2024-05-03T22:10:35.387 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:35 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:35.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:35 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:10:35.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:35 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:10:35.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:35 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:35.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:35 smithi116 ceph-mon[31828]: osd.10 [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329] boot 2024-05-03T22:10:35.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:35 smithi116 ceph-mon[31828]: osdmap e67: 11 total, 11 up, 11 in 2024-05-03T22:10:35.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:35 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:35.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:35 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:10:35.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:35 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:10:35.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:35 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:35.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:35 smithi082 ceph-mon[28404]: osd.10 [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329] boot 2024-05-03T22:10:35.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:35 smithi082 ceph-mon[28404]: osdmap e67: 11 total, 11 up, 11 in 2024-05-03T22:10:35.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:35 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:10:36.397 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-03T22:10:36.397 INFO:teuthology.orchestra.run.smithi130.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-03T22:10:36.397 INFO:teuthology.orchestra.run.smithi130.stderr: stderr: 10+0 records in 2024-05-03T22:10:36.397 INFO:teuthology.orchestra.run.smithi130.stderr:10+0 records out 2024-05-03T22:10:36.397 INFO:teuthology.orchestra.run.smithi130.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0332446 s, 315 MB/s 2024-05-03T22:10:36.397 INFO:teuthology.orchestra.run.smithi130.stderr:--> Zapping successful for: 2024-05-03T22:10:36.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:36 smithi130 ceph-mon[32417]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:36.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:36 smithi130 ceph-mon[32417]: osdmap e68: 11 total, 11 up, 11 in 2024-05-03T22:10:36.684 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:36 smithi116 ceph-mon[31828]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:36 smithi116 ceph-mon[31828]: osdmap e68: 11 total, 11 up, 11 in 2024-05-03T22:10:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:36 smithi082 ceph-mon[28404]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:10:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:36 smithi082 ceph-mon[28404]: osdmap e68: 11 total, 11 up, 11 in 2024-05-03T22:10:37.355 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_1 2024-05-03T22:10:37.762 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:10:38.150 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:10:38.150 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: osdmap e69: 11 total, 11 up, 11 in 2024-05-03T22:10:38.150 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:38.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:38.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:38.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:38.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:38.151 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:38.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:10:38.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: osdmap e69: 11 total, 11 up, 11 in 2024-05-03T22:10:38.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:38.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:38.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:38.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:10:38.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: osdmap e69: 11 total, 11 up, 11 in 2024-05-03T22:10:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:10:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:39.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:38 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi116 2024-05-03T22:10:39.202 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:38 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi116 to 4272M 2024-05-03T22:10:39.202 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:10:39.203 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:39.203 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:39.203 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:39.221 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:38 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi116 2024-05-03T22:10:39.221 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:38 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi116 to 4272M 2024-05-03T22:10:39.221 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:10:39.221 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:39.221 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:39.221 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:39.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:38 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi116 2024-05-03T22:10:39.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:38 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi116 to 4272M 2024-05-03T22:10:39.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:10:39.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:39.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:10:39.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:10:40.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.038+0000 7f20dde00700 1 -- 172.21.15.130:0/55785135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20d810ad40 msgr2=0x7f20d810b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:10:40.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.038+0000 7f20dde00700 1 --2- 172.21.15.130:0/55785135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20d810ad40 0x7f20d810b1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009990 tx=0x7f20c4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:10:40.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.038+0000 7f20dde00700 1 -- 172.21.15.130:0/55785135 shutdown_connections 2024-05-03T22:10:40.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.038+0000 7f20dde00700 1 --2- 172.21.15.130:0/55785135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20d8109b40 0x7f20d8109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:40.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.038+0000 7f20dde00700 1 --2- 172.21.15.130:0/55785135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20d810b6e0 0x7f20d8111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:40.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.038+0000 7f20dde00700 1 --2- 172.21.15.130:0/55785135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20d810ad40 0x7f20d810b1a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:40.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.038+0000 7f20dde00700 1 -- 172.21.15.130:0/55785135 >> 172.21.15.130:0/55785135 conn(0x7f20d8078b10 msgr2=0x7f20d807af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:10:40.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.038+0000 7f20dde00700 1 -- 172.21.15.130:0/55785135 shutdown_connections 2024-05-03T22:10:40.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.038+0000 7f20dde00700 1 -- 172.21.15.130:0/55785135 wait complete. 2024-05-03T22:10:40.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.040+0000 7f20dde00700 1 Processor -- start 2024-05-03T22:10:40.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.040+0000 7f20dde00700 1 -- start start 2024-05-03T22:10:40.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.040+0000 7f20dde00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20d8109b40 0x7f20d819fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:10:40.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.040+0000 7f20dde00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20d810ad40 0x7f20d81a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:10:40.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.040+0000 7f20dde00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20d810b6e0 0x7f20d81a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:10:40.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.040+0000 7f20dde00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f20d81154e0 con 0x7f20d810ad40 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.040+0000 7f20dde00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f20d8115360 con 0x7f20d8109b40 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.040+0000 7f20dde00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20d8115660 con 0x7f20d810b6e0 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.041+0000 7f20d7400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20d810b6e0 0x7f20d81a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.041+0000 7f20d7400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20d810b6e0 0x7f20d81a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:49794/0 (socket says 172.21.15.130:49794) 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.041+0000 7f20d7400700 1 -- 172.21.15.130:0/2007773818 learned_addr learned my addr 172.21.15.130:0/2007773818 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.041+0000 7f20d6a00700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20d8109b40 0x7f20d819fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.041+0000 7f20d6000700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20d810ad40 0x7f20d81a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.041+0000 7f20d7400700 1 -- 172.21.15.130:0/2007773818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20d8109b40 msgr2=0x7f20d819fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.041+0000 7f20d7400700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20d8109b40 0x7f20d819fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.041+0000 7f20d7400700 1 -- 172.21.15.130:0/2007773818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20d810ad40 msgr2=0x7f20d81a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.041+0000 7f20d7400700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20d810ad40 0x7f20d81a0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:10:40.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.041+0000 7f20d7400700 1 -- 172.21.15.130:0/2007773818 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d81a7760 con 0x7f20d810b6e0 2024-05-03T22:10:40.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.042+0000 7f20d7400700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20d810b6e0 0x7f20d81a70c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f20d0007f10 tx=0x7f20d000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:10:40.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.042+0000 7f20dca00700 1 -- 172.21.15.130:0/2007773818 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0004bb0 con 0x7f20d810b6e0 2024-05-03T22:10:40.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.042+0000 7f20dca00700 1 -- 172.21.15.130:0/2007773818 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20d0004d50 con 0x7f20d810b6e0 2024-05-03T22:10:40.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.042+0000 7f20dde00700 1 -- 172.21.15.130:0/2007773818 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d81a7a50 con 0x7f20d810b6e0 2024-05-03T22:10:40.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.042+0000 7f20dca00700 1 -- 172.21.15.130:0/2007773818 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d00058b0 con 0x7f20d810b6e0 2024-05-03T22:10:40.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.042+0000 7f20dde00700 1 -- 172.21.15.130:0/2007773818 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d81a7f40 con 0x7f20d810b6e0 2024-05-03T22:10:40.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.044+0000 7f20dde00700 1 -- 172.21.15.130:0/2007773818 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d806a190 con 0x7f20d810b6e0 2024-05-03T22:10:40.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.046+0000 7f20dca00700 1 -- 172.21.15.130:0/2007773818 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f20d001a020 con 0x7f20d810b6e0 2024-05-03T22:10:40.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.048+0000 7f20dca00700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f20bc0b2880 0x7f20bc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:10:40.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.048+0000 7f20dca00700 1 -- 172.21.15.130:0/2007773818 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6694+0+0 (secure 0 0 0) 0x7f20d00e1970 con 0x7f20d810b6e0 2024-05-03T22:10:40.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.048+0000 7f20d6a00700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f20bc0b2880 0x7f20bc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:10:40.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.049+0000 7f20d6a00700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f20bc0b2880 0x7f20bc0b4d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f20d810aba0 tx=0x7f20c800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:10:40.052 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.051+0000 7f20dca00700 1 -- 172.21.15.130:0/2007773818 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f20d0010070 con 0x7f20d810b6e0 2024-05-03T22:10:40.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:39 smithi116 ceph-mon[31828]: pgmap v300: 1 pgs: 1 activating+degraded; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-03T22:10:40.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:39 smithi116 ceph-mon[31828]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-03T22:10:40.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:39 smithi082 ceph-mon[28404]: pgmap v300: 1 pgs: 1 activating+degraded; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-03T22:10:40.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:39 smithi082 ceph-mon[28404]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-03T22:10:40.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:39 smithi130 ceph-mon[32417]: pgmap v300: 1 pgs: 1 activating+degraded; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-03T22:10:40.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:39 smithi130 ceph-mon[32417]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-03T22:10:40.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:10:40.292+0000 7f20dde00700 1 -- 172.21.15.130:0/2007773818 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f20d80639a0 con 0x7f20bc0b2880 2024-05-03T22:10:41.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:40 smithi116 ceph-mon[31828]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:10:41.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:40 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:10:41.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:40 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:10:41.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:40 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:41.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:40 smithi082 ceph-mon[28404]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:10:41.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:40 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:10:41.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:40 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:10:41.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:40 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:41.241 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:40 smithi130 ceph-mon[32417]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:10:41.241 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:40 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:10:41.241 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:40 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:10:41.241 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:40 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:42.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:41 smithi116 ceph-mon[31828]: pgmap v301: 1 pgs: 1 activating+degraded; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-03T22:10:42.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:41 smithi082 ceph-mon[28404]: pgmap v301: 1 pgs: 1 activating+degraded; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-03T22:10:42.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:41 smithi130 ceph-mon[32417]: pgmap v301: 1 pgs: 1 activating+degraded; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-03T22:10:43.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:42 smithi130 ceph-mon[32417]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-03T22:10:43.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:42 smithi130 ceph-mon[32417]: Cluster is now healthy 2024-05-03T22:10:43.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:42 smithi082 ceph-mon[28404]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-03T22:10:43.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:42 smithi082 ceph-mon[28404]: Cluster is now healthy 2024-05-03T22:10:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:42 smithi116 ceph-mon[31828]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-03T22:10:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:42 smithi116 ceph-mon[31828]: Cluster is now healthy 2024-05-03T22:10:44.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:43 smithi130 ceph-mon[32417]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-03T22:10:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:43 smithi116 ceph-mon[31828]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-03T22:10:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:43 smithi082 ceph-mon[28404]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-03T22:10:45.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:44 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/2112982669' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43b98e6d-fba6-4cea-99fc-b3f0027fc693"}]: dispatch 2024-05-03T22:10:45.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:44 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43b98e6d-fba6-4cea-99fc-b3f0027fc693"}]: dispatch 2024-05-03T22:10:45.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:44 smithi082 ceph-mon[28404]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43b98e6d-fba6-4cea-99fc-b3f0027fc693"}]': finished 2024-05-03T22:10:45.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:44 smithi082 ceph-mon[28404]: osdmap e70: 12 total, 11 up, 12 in 2024-05-03T22:10:45.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:44 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:10:45.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:44 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/2112982669' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43b98e6d-fba6-4cea-99fc-b3f0027fc693"}]: dispatch 2024-05-03T22:10:45.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:44 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43b98e6d-fba6-4cea-99fc-b3f0027fc693"}]: dispatch 2024-05-03T22:10:45.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:44 smithi130 ceph-mon[32417]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43b98e6d-fba6-4cea-99fc-b3f0027fc693"}]': finished 2024-05-03T22:10:45.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:44 smithi130 ceph-mon[32417]: osdmap e70: 12 total, 11 up, 12 in 2024-05-03T22:10:45.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:44 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:10:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:44 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/2112982669' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43b98e6d-fba6-4cea-99fc-b3f0027fc693"}]: dispatch 2024-05-03T22:10:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:44 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43b98e6d-fba6-4cea-99fc-b3f0027fc693"}]: dispatch 2024-05-03T22:10:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:44 smithi116 ceph-mon[31828]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43b98e6d-fba6-4cea-99fc-b3f0027fc693"}]': finished 2024-05-03T22:10:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:44 smithi116 ceph-mon[31828]: osdmap e70: 12 total, 11 up, 12 in 2024-05-03T22:10:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:44 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:10:46.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:45 smithi130 ceph-mon[32417]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:10:46.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:45 smithi130 ceph-mon[32417]: from='client.? 172.21.15.130:0/1252754098' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:10:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:45 smithi116 ceph-mon[31828]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:10:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:45 smithi116 ceph-mon[31828]: from='client.? 172.21.15.130:0/1252754098' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:10:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:45 smithi082 ceph-mon[28404]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:10:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:45 smithi082 ceph-mon[28404]: from='client.? 172.21.15.130:0/1252754098' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:10:48.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:47 smithi130 ceph-mon[32417]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T22:10:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:47 smithi116 ceph-mon[31828]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T22:10:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:47 smithi082 ceph-mon[28404]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T22:10:50.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:49 smithi130 ceph-mon[32417]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:10:50.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:49 smithi116 ceph-mon[31828]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:10:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:49 smithi082 ceph-mon[28404]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:10:52.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:52 smithi130 ceph-mon[32417]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:10:52.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:52 smithi116 ceph-mon[31828]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:10:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:52 smithi082 ceph-mon[28404]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:10:54.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:54 smithi130 ceph-mon[32417]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:10:54.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-03T22:10:54.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:54 smithi116 ceph-mon[31828]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:10:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-03T22:10:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:54.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:54 smithi082 ceph-mon[28404]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:10:54.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-03T22:10:54.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:10:55.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:55 smithi130 ceph-mon[32417]: Deploying daemon osd.11 on smithi130 2024-05-03T22:10:55.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:55 smithi116 ceph-mon[31828]: Deploying daemon osd.11 on smithi130 2024-05-03T22:10:55.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:55 smithi082 ceph-mon[28404]: Deploying daemon osd.11 on smithi130 2024-05-03T22:10:56.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:56 smithi130 ceph-mon[32417]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:10:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:56 smithi116 ceph-mon[31828]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:10:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:56 smithi082 ceph-mon[28404]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:10:58.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:10:58 smithi116 ceph-mon[31828]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:10:58.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:10:58 smithi082 ceph-mon[28404]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:10:58.518 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:10:58 smithi130 ceph-mon[32417]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:00 smithi116 ceph-mon[31828]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:00.450 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:00 smithi130 ceph-mon[32417]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:00.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:00 smithi082 ceph-mon[28404]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:02.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:02 smithi130 ceph-mon[32417]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:02 smithi116 ceph-mon[31828]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:02 smithi082 ceph-mon[28404]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:03.415 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:03 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:03.415 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:03 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:03.415 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:03 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:11:03.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:03 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:03.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:03 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:03.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:03 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:11:03.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:03 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:03.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:03 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:03.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:03 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:11:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:04 smithi082 ceph-mon[28404]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:04 smithi130 ceph-mon[32417]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:04.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:04 smithi116 ceph-mon[31828]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:06 smithi082 ceph-mon[28404]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:06.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:06.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:11:06.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:06.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:06 smithi130 ceph-mon[32417]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:06.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:06.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:06.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:06.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:11:06.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:06 smithi116 ceph-mon[31828]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:06.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:11:06.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:07.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.144+0000 7f20dca00700 1 -- 172.21.15.130:0/2007773818 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f20d80639a0 con 0x7f20bc0b2880 2024-05-03T22:11:07.147 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 11 on host 'smithi130' 2024-05-03T22:11:07.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.148+0000 7f20dde00700 1 -- 172.21.15.130:0/2007773818 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f20bc0b2880 msgr2=0x7f20bc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:07.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.148+0000 7f20dde00700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f20bc0b2880 0x7f20bc0b4d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f20d810aba0 tx=0x7f20c800a3b0 comp rx=0 tx=0).stop 2024-05-03T22:11:07.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.149+0000 7f20dde00700 1 -- 172.21.15.130:0/2007773818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20d810b6e0 msgr2=0x7f20d81a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:07.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.149+0000 7f20dde00700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20d810b6e0 0x7f20d81a70c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f20d0007f10 tx=0x7f20d000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:11:07.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.149+0000 7f20dde00700 1 -- 172.21.15.130:0/2007773818 shutdown_connections 2024-05-03T22:11:07.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.149+0000 7f20dde00700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f20bc0b2880 0x7f20bc0b4d40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:07.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.149+0000 7f20dde00700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20d810b6e0 0x7f20d81a70c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:07.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.149+0000 7f20dde00700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20d8109b40 0x7f20d819fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:07.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.149+0000 7f20dde00700 1 --2- 172.21.15.130:0/2007773818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20d810ad40 0x7f20d81a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:07.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.149+0000 7f20dde00700 1 -- 172.21.15.130:0/2007773818 >> 172.21.15.130:0/2007773818 conn(0x7f20d8078b10 msgr2=0x7f20d810e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:07.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.149+0000 7f20dde00700 1 -- 172.21.15.130:0/2007773818 shutdown_connections 2024-05-03T22:11:07.152 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:07.149+0000 7f20dde00700 1 -- 172.21.15.130:0/2007773818 wait complete. 2024-05-03T22:11:07.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:07 smithi082 ceph-mon[28404]: from='osd.11 [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:11:07.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:07 smithi082 ceph-mon[28404]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:11:07.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:07 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:07.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:07 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:11:07.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:07 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:07.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:07 smithi130 ceph-mon[32417]: from='osd.11 [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:11:07.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:07 smithi130 ceph-mon[32417]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:11:07.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:07 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:07.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:07 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:11:07.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:07 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:07.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:07 smithi116 ceph-mon[31828]: from='osd.11 [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:11:07.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:07 smithi116 ceph-mon[31828]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:11:07.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:07 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:07.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:07 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:11:07.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:07 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:07.948 DEBUG:teuthology.orchestra.run.smithi130:osd.11> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.11.service 2024-05-03T22:11:07.954 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-03T22:11:07.954 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-03T22:11:08.404 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:11:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:08 smithi082 ceph-mon[28404]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:08 smithi082 ceph-mon[28404]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-03T22:11:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:08 smithi082 ceph-mon[28404]: from='osd.11 [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:11:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:08 smithi082 ceph-mon[28404]: osdmap e71: 12 total, 11 up, 12 in 2024-05-03T22:11:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:08 smithi082 ceph-mon[28404]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:11:08.491 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:08 smithi130 ceph-mon[32417]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:08.491 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:08 smithi130 ceph-mon[32417]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-03T22:11:08.491 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:08 smithi130 ceph-mon[32417]: from='osd.11 [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:11:08.491 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:08 smithi130 ceph-mon[32417]: osdmap e71: 12 total, 11 up, 12 in 2024-05-03T22:11:08.491 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:08.491 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:08 smithi130 ceph-mon[32417]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:11:08.492 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:11:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:11:08.270+0000 7f553de00700 -1 osd.11 0 waiting for initial osdmap 2024-05-03T22:11:08.492 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:11:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:11:08.315+0000 7f5538c00700 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:11:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:08 smithi116 ceph-mon[31828]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:08 smithi116 ceph-mon[31828]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-03T22:11:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:08 smithi116 ceph-mon[31828]: from='osd.11 [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:11:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:08 smithi116 ceph-mon[31828]: osdmap e71: 12 total, 11 up, 12 in 2024-05-03T22:11:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:08 smithi116 ceph-mon[31828]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]: dispatch 2024-05-03T22:11:09.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:09 smithi130 ceph-mon[32417]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:11:09.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:09 smithi130 ceph-mon[32417]: osdmap e72: 12 total, 11 up, 12 in 2024-05-03T22:11:09.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:09 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:09.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:09 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:09.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:09 smithi082 ceph-mon[28404]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:11:09.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:09 smithi082 ceph-mon[28404]: osdmap e72: 12 total, 11 up, 12 in 2024-05-03T22:11:09.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:09 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:09.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:09 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:09.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:09 smithi116 ceph-mon[31828]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-05-03T22:11:09.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:09 smithi116 ceph-mon[31828]: osdmap e72: 12 total, 11 up, 12 in 2024-05-03T22:11:09.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:09 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:09.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:09 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:10.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:10 smithi130 ceph-mon[32417]: purged_snaps scrub starts 2024-05-03T22:11:10.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:10 smithi130 ceph-mon[32417]: purged_snaps scrub ok 2024-05-03T22:11:10.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:10 smithi130 ceph-mon[32417]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:10.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:10 smithi130 ceph-mon[32417]: osd.11 [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775] boot 2024-05-03T22:11:10.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:10 smithi130 ceph-mon[32417]: osdmap e73: 12 total, 12 up, 12 in 2024-05-03T22:11:10.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:10 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:10.548 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:10 smithi082 ceph-mon[28404]: purged_snaps scrub starts 2024-05-03T22:11:10.548 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:10 smithi082 ceph-mon[28404]: purged_snaps scrub ok 2024-05-03T22:11:10.548 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:10 smithi082 ceph-mon[28404]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:10.548 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:10 smithi082 ceph-mon[28404]: osd.11 [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775] boot 2024-05-03T22:11:10.548 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:10 smithi082 ceph-mon[28404]: osdmap e73: 12 total, 12 up, 12 in 2024-05-03T22:11:10.548 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:10 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:10 smithi116 ceph-mon[31828]: purged_snaps scrub starts 2024-05-03T22:11:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:10 smithi116 ceph-mon[31828]: purged_snaps scrub ok 2024-05-03T22:11:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:10 smithi116 ceph-mon[31828]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:11:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:10 smithi116 ceph-mon[31828]: osd.11 [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775] boot 2024-05-03T22:11:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:10 smithi116 ceph-mon[31828]: osdmap e73: 12 total, 12 up, 12 in 2024-05-03T22:11:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:10 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:11:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.023+0000 7f732dc00700 1 -- 172.21.15.82:0/1532528304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73280774d0 msgr2=0x7f7328075930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.023+0000 7f732dc00700 1 --2- 172.21.15.82:0/1532528304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73280774d0 0x7f7328075930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7318009990 tx=0x7f7318009ca0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.023+0000 7f732dc00700 1 -- 172.21.15.82:0/1532528304 shutdown_connections 2024-05-03T22:11:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.023+0000 7f732dc00700 1 --2- 172.21.15.82:0/1532528304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73280774d0 0x7f7328075930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.023+0000 7f732dc00700 1 --2- 172.21.15.82:0/1532528304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f732810faf0 0x7f7328111ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.023+0000 7f732dc00700 1 --2- 172.21.15.82:0/1532528304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7328075f00 0x7f7328076380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.023+0000 7f732dc00700 1 -- 172.21.15.82:0/1532528304 >> 172.21.15.82:0/1532528304 conn(0x7f73280fea70 msgr2=0x7f7328100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.023+0000 7f732dc00700 1 -- 172.21.15.82:0/1532528304 shutdown_connections 2024-05-03T22:11:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.023+0000 7f732dc00700 1 -- 172.21.15.82:0/1532528304 wait complete. 2024-05-03T22:11:11.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.025+0000 7f732dc00700 1 Processor -- start 2024-05-03T22:11:11.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.025+0000 7f732dc00700 1 -- start start 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.025+0000 7f732dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7328075f00 0x7f732819fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.025+0000 7f732dc00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73280774d0 0x7f73281a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.025+0000 7f732dc00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f732810faf0 0x7f73281a7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.025+0000 7f732dc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7328115450 con 0x7f7328075f00 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.025+0000 7f732dc00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f73281152d0 con 0x7f732810faf0 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.025+0000 7f732dc00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f73281155d0 con 0x7f73280774d0 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.026+0000 7f7326a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7328075f00 0x7f732819fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.026+0000 7f7326a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7328075f00 0x7f732819fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37412/0 (socket says 172.21.15.82:37412) 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.026+0000 7f7326a00700 1 -- 172.21.15.82:0/1530087619 learned_addr learned my addr 172.21.15.82:0/1530087619 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.026+0000 7f7327400700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f732810faf0 0x7f73281a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.026+0000 7f731e000700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73280774d0 0x7f73281a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.026+0000 7f7326a00700 1 -- 172.21.15.82:0/1530087619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73280774d0 msgr2=0x7f73281a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.026+0000 7f7326a00700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73280774d0 0x7f73281a0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.026+0000 7f7326a00700 1 -- 172.21.15.82:0/1530087619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f732810faf0 msgr2=0x7f73281a7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.026+0000 7f7326a00700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f732810faf0 0x7f73281a7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.026+0000 7f7326a00700 1 -- 172.21.15.82:0/1530087619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73281a77a0 con 0x7f7328075f00 2024-05-03T22:11:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.027+0000 7f7326a00700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7328075f00 0x7f732819fb40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f73180098e0 tx=0x7f73180047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.027+0000 7f731fe00700 1 -- 172.21.15.82:0/1530087619 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318004830 con 0x7f7328075f00 2024-05-03T22:11:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.027+0000 7f731fe00700 1 -- 172.21.15.82:0/1530087619 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7318003be0 con 0x7f7328075f00 2024-05-03T22:11:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.027+0000 7f732dc00700 1 -- 172.21.15.82:0/1530087619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73281a7a30 con 0x7f7328075f00 2024-05-03T22:11:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.027+0000 7f731fe00700 1 -- 172.21.15.82:0/1530087619 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73180053e0 con 0x7f7328075f00 2024-05-03T22:11:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.027+0000 7f732dc00700 1 -- 172.21.15.82:0/1530087619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73281a7e80 con 0x7f7328075f00 2024-05-03T22:11:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.028+0000 7f732dc00700 1 -- 172.21.15.82:0/1530087619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f732806a190 con 0x7f7328075f00 2024-05-03T22:11:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.030+0000 7f731fe00700 1 -- 172.21.15.82:0/1530087619 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7318005580 con 0x7f7328075f00 2024-05-03T22:11:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.033+0000 7f731fe00700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f730c0b2900 0x7f730c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.033+0000 7f731fe00700 1 -- 172.21.15.82:0/1530087619 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f73180e3210 con 0x7f7328075f00 2024-05-03T22:11:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.033+0000 7f731e000700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f730c0b2900 0x7f730c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.034+0000 7f731e000700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f730c0b2900 0x7f730c0b4dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7310005950 tx=0x7f73100058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.036+0000 7f731fe00700 1 -- 172.21.15.82:0/1530087619 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7318013070 con 0x7f7328075f00 2024-05-03T22:11:11.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.268+0000 7f732dc00700 1 -- 172.21.15.82:0/1530087619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f732802e720 con 0x7f7328075f00 2024-05-03T22:11:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.269+0000 7f731fe00700 1 -- 172.21.15.82:0/1530087619 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f73180ab3c0 con 0x7f7328075f00 2024-05-03T22:11:11.271 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:11:11.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.273+0000 7f732dc00700 1 -- 172.21.15.82:0/1530087619 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f730c0b2900 msgr2=0x7f730c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:11.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.273+0000 7f732dc00700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f730c0b2900 0x7f730c0b4dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7310005950 tx=0x7f73100058e0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.273+0000 7f732dc00700 1 -- 172.21.15.82:0/1530087619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7328075f00 msgr2=0x7f732819fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:11.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.273+0000 7f732dc00700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7328075f00 0x7f732819fb40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f73180098e0 tx=0x7f73180047b0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.273+0000 7f732dc00700 1 -- 172.21.15.82:0/1530087619 shutdown_connections 2024-05-03T22:11:11.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.273+0000 7f732dc00700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f730c0b2900 0x7f730c0b4dc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.273+0000 7f732dc00700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7328075f00 0x7f732819fb40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.273+0000 7f732dc00700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f732810faf0 0x7f73281a7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.273+0000 7f732dc00700 1 --2- 172.21.15.82:0/1530087619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f73280774d0 0x7f73281a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:11.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.273+0000 7f732dc00700 1 -- 172.21.15.82:0/1530087619 >> 172.21.15.82:0/1530087619 conn(0x7f73280fea70 msgr2=0x7f7328102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:11.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.274+0000 7f732dc00700 1 -- 172.21.15.82:0/1530087619 shutdown_connections 2024-05-03T22:11:11.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:11.274+0000 7f732dc00700 1 -- 172.21.15.82:0/1530087619 wait complete. 2024-05-03T22:11:11.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:11 smithi130 ceph-mon[32417]: osdmap e74: 12 total, 12 up, 12 in 2024-05-03T22:11:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:11 smithi116 ceph-mon[31828]: osdmap e74: 12 total, 12 up, 12 in 2024-05-03T22:11:11.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:11 smithi082 ceph-mon[28404]: osdmap e74: 12 total, 12 up, 12 in 2024-05-03T22:11:12.189 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1714774269,"num_in_osds":12,"osd_in_since":1714774244,"num_remapped_pgs":0} 2024-05-03T22:11:12.190 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:11:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:12 smithi082 ceph-mon[28404]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:12 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1530087619' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-03T22:11:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:12 smithi130 ceph-mon[32417]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:12 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1530087619' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-03T22:11:12.637 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:11:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:12 smithi116 ceph-mon[31828]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:12 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1530087619' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-03T22:11:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: Detected new or changed devices on smithi130 2024-05-03T22:11:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:13.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:13.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:13.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi130 to 4272M 2024-05-03T22:11:13.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:13.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:13.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:11:13.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: Detected new or changed devices on smithi130 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi130 to 4272M 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:11:13.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: Detected new or changed devices on smithi130 2024-05-03T22:11:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:11:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi130 to 4272M 2024-05-03T22:11:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:11:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.125+0000 7fe63be00700 1 -- 172.21.15.82:0/716860100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c1033d0 msgr2=0x7fe63c103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.125+0000 7fe63be00700 1 --2- 172.21.15.82:0/716860100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c1033d0 0x7fe63c103850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe624009990 tx=0x7fe624009ca0 comp rx=0 tx=0).stop 2024-05-03T22:11:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.125+0000 7fe63be00700 1 -- 172.21.15.82:0/716860100 shutdown_connections 2024-05-03T22:11:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.125+0000 7fe63be00700 1 --2- 172.21.15.82:0/716860100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe63c103d90 0x7fe63c1102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.125+0000 7fe63be00700 1 --2- 172.21.15.82:0/716860100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c109460 0x7fe63c109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.125+0000 7fe63be00700 1 --2- 172.21.15.82:0/716860100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c1033d0 0x7fe63c103850 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.125+0000 7fe63be00700 1 -- 172.21.15.82:0/716860100 >> 172.21.15.82:0/716860100 conn(0x7fe63c0fef20 msgr2=0x7fe63c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.125+0000 7fe63be00700 1 -- 172.21.15.82:0/716860100 shutdown_connections 2024-05-03T22:11:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.125+0000 7fe63be00700 1 -- 172.21.15.82:0/716860100 wait complete. 2024-05-03T22:11:15.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.126+0000 7fe63be00700 1 Processor -- start 2024-05-03T22:11:15.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.126+0000 7fe63be00700 1 -- start start 2024-05-03T22:11:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.127+0000 7fe63be00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c1033d0 0x7fe63c19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.127+0000 7fe63be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103d90 0x7fe63c19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.127+0000 7fe63be00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe63c109460 0x7fe63c199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.127+0000 7fe63be00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113490 con 0x7fe63c103d90 2024-05-03T22:11:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.127+0000 7fe63be00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113310 con 0x7fe63c109460 2024-05-03T22:11:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.127+0000 7fe63be00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113610 con 0x7fe63c1033d0 2024-05-03T22:11:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.127+0000 7fe632000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103d90 0x7fe63c19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.127+0000 7fe632000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103d90 0x7fe63c19fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35688/0 (socket says 172.21.15.82:35688) 2024-05-03T22:11:15.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.127+0000 7fe632000700 1 -- 172.21.15.82:0/2686049428 learned_addr learned my addr 172.21.15.82:0/2686049428 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:11:15.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.128+0000 7fe63aa00700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c1033d0 0x7fe63c19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:15.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.128+0000 7fe63b400700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe63c109460 0x7fe63c199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.128+0000 7fe632000700 1 -- 172.21.15.82:0/2686049428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c1033d0 msgr2=0x7fe63c19f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.128+0000 7fe632000700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c1033d0 0x7fe63c19f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.128+0000 7fe632000700 1 -- 172.21.15.82:0/2686049428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe63c109460 msgr2=0x7fe63c199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.128+0000 7fe632000700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe63c109460 0x7fe63c199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.128+0000 7fe632000700 1 -- 172.21.15.82:0/2686049428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63c19a030 con 0x7fe63c103d90 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.128+0000 7fe63b400700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe63c109460 0x7fe63c199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.128+0000 7fe632000700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103d90 0x7fe63c19fc10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe624005910 tx=0x7fe6240047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.128+0000 7fe633e00700 1 -- 172.21.15.82:0/2686049428 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624027070 con 0x7fe63c103d90 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.129+0000 7fe63be00700 1 -- 172.21.15.82:0/2686049428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe63c19a2c0 con 0x7fe63c103d90 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.129+0000 7fe633e00700 1 -- 172.21.15.82:0/2686049428 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe62400fc00 con 0x7fe63c103d90 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.129+0000 7fe633e00700 1 -- 172.21.15.82:0/2686049428 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624022d40 con 0x7fe63c103d90 2024-05-03T22:11:15.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.129+0000 7fe63be00700 1 -- 172.21.15.82:0/2686049428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63c1a6530 con 0x7fe63c103d90 2024-05-03T22:11:15.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.130+0000 7fe63be00700 1 -- 172.21.15.82:0/2686049428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe63c104b10 con 0x7fe63c103d90 2024-05-03T22:11:15.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.134+0000 7fe633e00700 1 -- 172.21.15.82:0/2686049428 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe62402a070 con 0x7fe63c103d90 2024-05-03T22:11:15.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.135+0000 7fe633e00700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe6200b2900 0x7fe6200b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:15.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.135+0000 7fe633e00700 1 -- 172.21.15.82:0/2686049428 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fe6240e3230 con 0x7fe63c103d90 2024-05-03T22:11:15.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.135+0000 7fe63aa00700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe6200b2900 0x7fe6200b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:15.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.136+0000 7fe63aa00700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe6200b2900 0x7fe6200b4dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009c90 tx=0x7fe62c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:15.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.138+0000 7fe633e00700 1 -- 172.21.15.82:0/2686049428 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe624031070 con 0x7fe63c103d90 2024-05-03T22:11:15.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.371+0000 7fe63be00700 1 -- 172.21.15.82:0/2686049428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe63c19ad80 con 0x7fe63c103d90 2024-05-03T22:11:15.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.372+0000 7fe633e00700 1 -- 172.21.15.82:0/2686049428 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18444 (secure 0 0 0) 0x7fe624013070 con 0x7fe63c103d90 2024-05-03T22:11:15.375 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:11:15.375 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":74,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:11:10.255174+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:11:15.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.375+0000 7fe63be00700 1 -- 172.21.15.82:0/2686049428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe6200b2900 msgr2=0x7fe6200b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:15.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.375+0000 7fe63be00700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe6200b2900 0x7fe6200b4dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009c90 tx=0x7fe62c009040 comp rx=0 tx=0).stop 2024-05-03T22:11:15.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.375+0000 7fe63be00700 1 -- 172.21.15.82:0/2686049428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103d90 msgr2=0x7fe63c19fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.375+0000 7fe63be00700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103d90 0x7fe63c19fc10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe624005910 tx=0x7fe6240047b0 comp rx=0 tx=0).stop 2024-05-03T22:11:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.375+0000 7fe63be00700 1 -- 172.21.15.82:0/2686049428 shutdown_connections 2024-05-03T22:11:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.375+0000 7fe63be00700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe6200b2900 0x7fe6200b4dc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.375+0000 7fe63be00700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe63c109460 0x7fe63c199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.375+0000 7fe63be00700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe63c1033d0 0x7fe63c19f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.375+0000 7fe63be00700 1 --2- 172.21.15.82:0/2686049428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103d90 0x7fe63c19fc10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.375+0000 7fe63be00700 1 -- 172.21.15.82:0/2686049428 >> 172.21.15.82:0/2686049428 conn(0x7fe63c0fef20 msgr2=0x7fe63c0ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:15.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.376+0000 7fe63be00700 1 -- 172.21.15.82:0/2686049428 shutdown_connections 2024-05-03T22:11:15.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:15.376+0000 7fe63be00700 1 -- 172.21.15.82:0/2686049428 wait complete. 2024-05-03T22:11:15.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:15 smithi082 ceph-mon[28404]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:15.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:15 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2686049428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:11:16.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:15 smithi130 ceph-mon[32417]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:16.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:15 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2686049428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:11:16.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:15 smithi116 ceph-mon[31828]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:16.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:15 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2686049428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:11:16.383 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-03T22:05:52.600038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-03T22:11:16.383 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-03T22:11:16.849 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:11:17.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:17 smithi082 ceph-mon[28404]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:18.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:17 smithi130 ceph-mon[32417]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:18.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:17 smithi116 ceph-mon[31828]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.328+0000 7f2ed1c00700 1 -- 172.21.15.82:0/1648601296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ecc1055d0 msgr2=0x7f2ecc105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.328+0000 7f2ed1c00700 1 --2- 172.21.15.82:0/1648601296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ecc1055d0 0x7f2ecc105a50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009990 tx=0x7f2eb8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.328+0000 7f2ed1c00700 1 -- 172.21.15.82:0/1648601296 shutdown_connections 2024-05-03T22:11:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.328+0000 7f2ed1c00700 1 --2- 172.21.15.82:0/1648601296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ecc105f90 0x7f2ecc1124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.328+0000 7f2ed1c00700 1 --2- 172.21.15.82:0/1648601296 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ecc10b660 0x7f2ecc10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.328+0000 7f2ed1c00700 1 --2- 172.21.15.82:0/1648601296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ecc1055d0 0x7f2ecc105a50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.328+0000 7f2ed1c00700 1 -- 172.21.15.82:0/1648601296 >> 172.21.15.82:0/1648601296 conn(0x7f2ecc101080 msgr2=0x7f2ecc1034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.328+0000 7f2ed1c00700 1 -- 172.21.15.82:0/1648601296 shutdown_connections 2024-05-03T22:11:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.328+0000 7f2ed1c00700 1 -- 172.21.15.82:0/1648601296 wait complete. 2024-05-03T22:11:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.329+0000 7f2ed1c00700 1 Processor -- start 2024-05-03T22:11:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.329+0000 7f2ed1c00700 1 -- start start 2024-05-03T22:11:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.329+0000 7f2ed1c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ecc1055d0 0x7f2ecc1a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.329+0000 7f2ed1c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ecc105f90 0x7f2ecc1a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ecc10b660 0x7f2ecc19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc1156d0 con 0x7f2ecc10b660 2024-05-03T22:11:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1c00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc115550 con 0x7f2ecc105f90 2024-05-03T22:11:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1c00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc115850 con 0x7f2ecc1055d0 2024-05-03T22:11:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ecc10b660 0x7f2ecc19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ecc10b660 0x7f2ecc19b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35712/0 (socket says 172.21.15.82:35712) 2024-05-03T22:11:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1200700 1 -- 172.21.15.82:0/4131798700 learned_addr learned my addr 172.21.15.82:0/4131798700 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:11:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ecbe00700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ecc1055d0 0x7f2ecc1a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ecb400700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ecc105f90 0x7f2ecc1a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1200700 1 -- 172.21.15.82:0/4131798700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ecc1055d0 msgr2=0x7f2ecc1a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1200700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ecc1055d0 0x7f2ecc1a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1200700 1 -- 172.21.15.82:0/4131798700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ecc105f90 msgr2=0x7f2ecc1a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1200700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ecc105f90 0x7f2ecc1a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.330+0000 7f2ed1200700 1 -- 172.21.15.82:0/4131798700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc19c0f0 con 0x7f2ecc10b660 2024-05-03T22:11:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.331+0000 7f2ed1200700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ecc10b660 0x7f2ecc19b990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4007ee0 tx=0x7f2ec400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.331+0000 7f2ec8c00700 1 -- 172.21.15.82:0/4131798700 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400dbd0 con 0x7f2ecc10b660 2024-05-03T22:11:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.331+0000 7f2ec8c00700 1 -- 172.21.15.82:0/4131798700 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ec400dd70 con 0x7f2ecc10b660 2024-05-03T22:11:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.331+0000 7f2ec8c00700 1 -- 172.21.15.82:0/4131798700 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40058d0 con 0x7f2ecc10b660 2024-05-03T22:11:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.331+0000 7f2ed1c00700 1 -- 172.21.15.82:0/4131798700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc19c3e0 con 0x7f2ecc10b660 2024-05-03T22:11:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.331+0000 7f2ed1c00700 1 -- 172.21.15.82:0/4131798700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc1a86a0 con 0x7f2ecc10b660 2024-05-03T22:11:19.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.332+0000 7f2ed1c00700 1 -- 172.21.15.82:0/4131798700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ecc06a190 con 0x7f2ecc10b660 2024-05-03T22:11:19.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.335+0000 7f2ec8c00700 1 -- 172.21.15.82:0/4131798700 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2ec401a020 con 0x7f2ecc10b660 2024-05-03T22:11:19.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.336+0000 7f2ec8c00700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2eb00b2900 0x7f2eb00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:19.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.336+0000 7f2ec8c00700 1 -- 172.21.15.82:0/4131798700 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f2ec40e1c70 con 0x7f2ecc10b660 2024-05-03T22:11:19.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.336+0000 7f2ecbe00700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2eb00b2900 0x7f2eb00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:19.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.337+0000 7f2ecbe00700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2eb00b2900 0x7f2eb00b4dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc005950 tx=0x7f2ebc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:19.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.338+0000 7f2ec8c00700 1 -- 172.21.15.82:0/4131798700 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2ec4010070 con 0x7f2ecc10b660 2024-05-03T22:11:19.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.567+0000 7f2ed1c00700 1 -- 172.21.15.82:0/4131798700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2ecc02e510 con 0x7f2ecc10b660 2024-05-03T22:11:19.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.568+0000 7f2ec8c00700 1 -- 172.21.15.82:0/4131798700 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f2ec40a9d90 con 0x7f2ecc10b660 2024-05-03T22:11:19.570 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-03T22:11:19.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.571+0000 7f2ed1c00700 1 -- 172.21.15.82:0/4131798700 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2eb00b2900 msgr2=0x7f2eb00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:19.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.571+0000 7f2ed1c00700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2eb00b2900 0x7f2eb00b4dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc005950 tx=0x7f2ebc0058e0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.571+0000 7f2ed1c00700 1 -- 172.21.15.82:0/4131798700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ecc10b660 msgr2=0x7f2ecc19b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:19.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.571+0000 7f2ed1c00700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ecc10b660 0x7f2ecc19b990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4007ee0 tx=0x7f2ec400d3b0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.571+0000 7f2ed1c00700 1 -- 172.21.15.82:0/4131798700 shutdown_connections 2024-05-03T22:11:19.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.571+0000 7f2ed1c00700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2eb00b2900 0x7f2eb00b4dc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.571+0000 7f2ed1c00700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ecc10b660 0x7f2ecc19b990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.571+0000 7f2ed1c00700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ecc1055d0 0x7f2ecc1a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.571+0000 7f2ed1c00700 1 --2- 172.21.15.82:0/4131798700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ecc105f90 0x7f2ecc1a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:19.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.571+0000 7f2ed1c00700 1 -- 172.21.15.82:0/4131798700 >> 172.21.15.82:0/4131798700 conn(0x7f2ecc101080 msgr2=0x7f2ecc102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:19.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.572+0000 7f2ed1c00700 1 -- 172.21.15.82:0/4131798700 shutdown_connections 2024-05-03T22:11:19.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:19.572+0000 7f2ed1c00700 1 -- 172.21.15.82:0/4131798700 wait complete. 2024-05-03T22:11:19.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:19 smithi082 ceph-mon[28404]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:19.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:19 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/4131798700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-03T22:11:20.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:19 smithi130 ceph-mon[32417]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:20.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:19 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/4131798700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-03T22:11:20.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:19 smithi116 ceph-mon[31828]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:20.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:19 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/4131798700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-03T22:11:20.423 INFO:tasks.cephadm:Adding mds.a on smithi082 2024-05-03T22:11:20.423 INFO:tasks.cephadm:Adding mds.d on smithi082 2024-05-03T22:11:20.423 INFO:tasks.cephadm:Adding mds.g on smithi082 2024-05-03T22:11:20.423 INFO:tasks.cephadm:Adding mds.j on smithi082 2024-05-03T22:11:20.423 INFO:tasks.cephadm:Adding mds.b on smithi116 2024-05-03T22:11:20.423 INFO:tasks.cephadm:Adding mds.e on smithi116 2024-05-03T22:11:20.423 INFO:tasks.cephadm:Adding mds.h on smithi116 2024-05-03T22:11:20.424 INFO:tasks.cephadm:Adding mds.k on smithi116 2024-05-03T22:11:20.424 INFO:tasks.cephadm:Adding mds.c on smithi130 2024-05-03T22:11:20.424 INFO:tasks.cephadm:Adding mds.f on smithi130 2024-05-03T22:11:20.424 INFO:tasks.cephadm:Adding mds.i on smithi130 2024-05-03T22:11:20.424 INFO:tasks.cephadm:Adding mds.l on smithi130 2024-05-03T22:11:20.424 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph orch apply mds all '12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi130=c;smithi130=f;smithi130=i;smithi130=l' 2024-05-03T22:11:20.848 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:11:21.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:21 smithi082 ceph-mon[28404]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:22.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:21 smithi130 ceph-mon[32417]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:22.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:21 smithi116 ceph-mon[31828]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:23.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.002+0000 7fc3a5400700 1 -- 172.21.15.130:0/423917782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a0105640 msgr2=0x7fc3a0105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:23.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.002+0000 7fc3a5400700 1 --2- 172.21.15.130:0/423917782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a0105640 0x7fc3a0105a60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc390009990 tx=0x7fc390009ca0 comp rx=0 tx=0).stop 2024-05-03T22:11:23.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.003+0000 7fc3a5400700 1 -- 172.21.15.130:0/423917782 shutdown_connections 2024-05-03T22:11:23.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.003+0000 7fc3a5400700 1 --2- 172.21.15.130:0/423917782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3a01071e0 0x7fc3a010da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:23.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.003+0000 7fc3a5400700 1 --2- 172.21.15.130:0/423917782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a0105640 0x7fc3a0105a60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:23.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.003+0000 7fc3a5400700 1 --2- 172.21.15.130:0/423917782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a0106840 0x7fc3a0106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:23.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.003+0000 7fc3a5400700 1 -- 172.21.15.130:0/423917782 >> 172.21.15.130:0/423917782 conn(0x7fc3a0100be0 msgr2=0x7fc3a0103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:23.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.003+0000 7fc3a5400700 1 -- 172.21.15.130:0/423917782 shutdown_connections 2024-05-03T22:11:23.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.003+0000 7fc3a5400700 1 -- 172.21.15.130:0/423917782 wait complete. 2024-05-03T22:11:23.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.004+0000 7fc3a5400700 1 Processor -- start 2024-05-03T22:11:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.004+0000 7fc3a5400700 1 -- start start 2024-05-03T22:11:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.004+0000 7fc3a5400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a0105640 0x7fc3a019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.004+0000 7fc3a5400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3a0106840 0x7fc3a019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.004+0000 7fc3a5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a01071e0 0x7fc3a01a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.004+0000 7fc3a5400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0110f70 con 0x7fc3a01071e0 2024-05-03T22:11:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.004+0000 7fc3a5400700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0110df0 con 0x7fc3a0106840 2024-05-03T22:11:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.004+0000 7fc3a5400700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01110f0 con 0x7fc3a0105640 2024-05-03T22:11:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.004+0000 7fc39fe00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a0105640 0x7fc3a019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.005+0000 7fc39fe00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a0105640 0x7fc3a019b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:51460/0 (socket says 172.21.15.130:51460) 2024-05-03T22:11:23.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.005+0000 7fc39fe00700 1 -- 172.21.15.130:0/970374764 learned_addr learned my addr 172.21.15.130:0/970374764 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.005+0000 7fc3a4a00700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a01071e0 0x7fc3a01a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.005+0000 7fc39f400700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3a0106840 0x7fc3a019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.005+0000 7fc39fe00700 1 -- 172.21.15.130:0/970374764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3a0106840 msgr2=0x7fc3a019bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.005+0000 7fc39fe00700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3a0106840 0x7fc3a019bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.005+0000 7fc39fe00700 1 -- 172.21.15.130:0/970374764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a01071e0 msgr2=0x7fc3a01a2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.005+0000 7fc39fe00700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a01071e0 0x7fc3a01a2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.005+0000 7fc39fe00700 1 -- 172.21.15.130:0/970374764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a01a3330 con 0x7fc3a0105640 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.005+0000 7fc39f400700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3a0106840 0x7fc3a019bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.005+0000 7fc39fe00700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a0105640 0x7fc3a019b6d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc3900047b0 tx=0x7fc390009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.006+0000 7fc39cc00700 1 -- 172.21.15.130:0/970374764 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390027070 con 0x7fc3a0105640 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.006+0000 7fc39cc00700 1 -- 172.21.15.130:0/970374764 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc390022470 con 0x7fc3a0105640 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.006+0000 7fc3a5400700 1 -- 172.21.15.130:0/970374764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a01a35c0 con 0x7fc3a0105640 2024-05-03T22:11:23.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.006+0000 7fc39cc00700 1 -- 172.21.15.130:0/970374764 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39000f6c0 con 0x7fc3a0105640 2024-05-03T22:11:23.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.006+0000 7fc3a5400700 1 -- 172.21.15.130:0/970374764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a01a3a70 con 0x7fc3a0105640 2024-05-03T22:11:23.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.007+0000 7fc3a5400700 1 -- 172.21.15.130:0/970374764 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a006a190 con 0x7fc3a0105640 2024-05-03T22:11:23.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.009+0000 7fc39cc00700 1 -- 172.21.15.130:0/970374764 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc39002a070 con 0x7fc3a0105640 2024-05-03T22:11:23.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.011+0000 7fc39cc00700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc3840b2980 0x7fc3840b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:23.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.011+0000 7fc39cc00700 1 -- 172.21.15.130:0/970374764 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fc3900e3640 con 0x7fc3a0105640 2024-05-03T22:11:23.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.011+0000 7fc39f400700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc3840b2980 0x7fc3840b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:23.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.012+0000 7fc39f400700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc3840b2980 0x7fc3840b4e40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005fd0 tx=0x7fc38c005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:23.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.014+0000 7fc39cc00700 1 -- 172.21.15.130:0/970374764 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc390031070 con 0x7fc3a0105640 2024-05-03T22:11:23.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.260+0000 7fc3a5400700 1 -- 172.21.15.130:0/970374764 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi130=c;smithi130=f;smithi130=i;smithi130=l", "target": ["mon-mgr", ""]}) -- 0x7fc3a0063ae0 con 0x7fc3840b2980 2024-05-03T22:11:23.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.277+0000 7fc39cc00700 1 -- 172.21.15.130:0/970374764 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fc3a0063ae0 con 0x7fc3840b2980 2024-05-03T22:11:23.279 INFO:teuthology.orchestra.run.smithi130.stdout:Scheduled mds.all update... 2024-05-03T22:11:23.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.281+0000 7fc3a5400700 1 -- 172.21.15.130:0/970374764 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc3840b2980 msgr2=0x7fc3840b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:23.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.281+0000 7fc3a5400700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc3840b2980 0x7fc3840b4e40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005fd0 tx=0x7fc38c005dc0 comp rx=0 tx=0).stop 2024-05-03T22:11:23.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.281+0000 7fc3a5400700 1 -- 172.21.15.130:0/970374764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a0105640 msgr2=0x7fc3a019b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:23.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.281+0000 7fc3a5400700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a0105640 0x7fc3a019b6d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc3900047b0 tx=0x7fc390009f90 comp rx=0 tx=0).stop 2024-05-03T22:11:23.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.281+0000 7fc3a5400700 1 -- 172.21.15.130:0/970374764 shutdown_connections 2024-05-03T22:11:23.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.281+0000 7fc3a5400700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc3840b2980 0x7fc3840b4e40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:23.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.281+0000 7fc3a5400700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a01071e0 0x7fc3a01a2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:23.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.281+0000 7fc3a5400700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3a0105640 0x7fc3a019b6d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:23.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.281+0000 7fc3a5400700 1 --2- 172.21.15.130:0/970374764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3a0106840 0x7fc3a019bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:23.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.281+0000 7fc3a5400700 1 -- 172.21.15.130:0/970374764 >> 172.21.15.130:0/970374764 conn(0x7fc3a0100be0 msgr2=0x7fc3a0109c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:23.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.281+0000 7fc3a5400700 1 -- 172.21.15.130:0/970374764 shutdown_connections 2024-05-03T22:11:23.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-05-03T22:11:23.282+0000 7fc3a5400700 1 -- 172.21.15.130:0/970374764 wait complete. 2024-05-03T22:11:24.069 DEBUG:teuthology.orchestra.run.smithi082:mds.a> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.a.service 2024-05-03T22:11:24.077 DEBUG:teuthology.orchestra.run.smithi082:mds.d> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.d.service 2024-05-03T22:11:24.123 DEBUG:teuthology.orchestra.run.smithi082:mds.g> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.g.service 2024-05-03T22:11:24.170 DEBUG:teuthology.orchestra.run.smithi082:mds.j> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.j.service 2024-05-03T22:11:24.216 DEBUG:teuthology.orchestra.run.smithi116:mds.b> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.b.service 2024-05-03T22:11:24.224 DEBUG:teuthology.orchestra.run.smithi116:mds.e> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.e.service 2024-05-03T22:11:24.270 DEBUG:teuthology.orchestra.run.smithi116:mds.h> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.h.service 2024-05-03T22:11:24.316 DEBUG:teuthology.orchestra.run.smithi116:mds.k> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.k.service 2024-05-03T22:11:24.361 DEBUG:teuthology.orchestra.run.smithi130:mds.c> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.c.service 2024-05-03T22:11:24.367 DEBUG:teuthology.orchestra.run.smithi130:mds.f> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.f.service 2024-05-03T22:11:24.412 DEBUG:teuthology.orchestra.run.smithi130:mds.i> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.i.service 2024-05-03T22:11:24.458 DEBUG:teuthology.orchestra.run.smithi130:mds.l> sudo journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.l.service 2024-05-03T22:11:24.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:24 smithi082 ceph-mon[28404]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:24.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:24 smithi082 ceph-mon[28404]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi130=c;smithi130=f;smithi130=i;smithi130=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:11:24.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:24 smithi082 ceph-mon[28404]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi130=c;smithi130=f;smithi130=i;smithi130=l;count:12 2024-05-03T22:11:24.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:24.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:11:24.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:24.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:11:24.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:24.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:24.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:24.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:24.504 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-03T22:11:24.505 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:11:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:24 smithi130 ceph-mon[32417]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:24 smithi130 ceph-mon[32417]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi130=c;smithi130=f;smithi130=i;smithi130=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:11:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:24 smithi130 ceph-mon[32417]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi130=c;smithi130=f;smithi130=i;smithi130=l;count:12 2024-05-03T22:11:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:11:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:11:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:24 smithi116 ceph-mon[31828]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:24 smithi116 ceph-mon[31828]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi130=c;smithi130=f;smithi130=i;smithi130=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:11:24.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:24 smithi116 ceph-mon[31828]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi130=c;smithi130=f;smithi130=i;smithi130=l;count:12 2024-05-03T22:11:24.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:24.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:11:24.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:24.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:11:24.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:24.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:24.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:24.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:24.938 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:11:25.336 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:25 smithi082 ceph-mon[28404]: Deploying daemon mds.l on smithi130 2024-05-03T22:11:25.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:25 smithi130 ceph-mon[32417]: Deploying daemon mds.l on smithi130 2024-05-03T22:11:25.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:25 smithi116 ceph-mon[31828]: Deploying daemon mds.l on smithi130 2024-05-03T22:11:26.386 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:26 smithi130 ceph-mon[32417]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:26.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:26 smithi116 ceph-mon[31828]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:26.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:26 smithi082 ceph-mon[28404]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:26.743 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:11:26 smithi130 systemd[1]: Starting Ceph mds.l for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:11:27.028 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:11:26 smithi130 podman[62919]: 2024-05-03 22:11:26.647218188 +0000 UTC m=+0.032426133 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:11:27.028 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:11:26 smithi130 podman[62919]: 2024-05-03 22:11:26.742484944 +0000 UTC m=+0.127692969 container create 31d8ffe47f9b763a52f353ebd793060218cc1f373788c14090242d2fffb9ffd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:11:27.028 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:11:26 smithi130 podman[62919]: 2024-05-03 22:11:26.980156444 +0000 UTC m=+0.365364446 container init 31d8ffe47f9b763a52f353ebd793060218cc1f373788c14090242d2fffb9ffd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:11:27.028 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:11:26 smithi130 podman[62919]: 2024-05-03 22:11:26.991425084 +0000 UTC m=+0.376633038 container start 31d8ffe47f9b763a52f353ebd793060218cc1f373788c14090242d2fffb9ffd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-03T22:11:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.419+0000 7fd553200700 1 -- 172.21.15.82:0/1540514981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd54c108410 msgr2=0x7fd54c1087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.419+0000 7fd553200700 1 --2- 172.21.15.82:0/1540514981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd54c108410 0x7fd54c1087f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009990 tx=0x7fd53c009ca0 comp rx=0 tx=0).stop 2024-05-03T22:11:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.419+0000 7fd553200700 1 -- 172.21.15.82:0/1540514981 shutdown_connections 2024-05-03T22:11:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.419+0000 7fd553200700 1 --2- 172.21.15.82:0/1540514981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd54c102d60 0x7fd54c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.419+0000 7fd553200700 1 --2- 172.21.15.82:0/1540514981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd54c108410 0x7fd54c1087f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:27.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.419+0000 7fd553200700 1 --2- 172.21.15.82:0/1540514981 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd54c1023a0 0x7fd54c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:27.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.419+0000 7fd553200700 1 -- 172.21.15.82:0/1540514981 >> 172.21.15.82:0/1540514981 conn(0x7fd54c079310 msgr2=0x7fd54c079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:27.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.419+0000 7fd553200700 1 -- 172.21.15.82:0/1540514981 shutdown_connections 2024-05-03T22:11:27.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.419+0000 7fd553200700 1 -- 172.21.15.82:0/1540514981 wait complete. 2024-05-03T22:11:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.420+0000 7fd553200700 1 Processor -- start 2024-05-03T22:11:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.421+0000 7fd553200700 1 -- start start 2024-05-03T22:11:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.421+0000 7fd553200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd54c1023a0 0x7fd54c1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.421+0000 7fd553200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd54c102d60 0x7fd54c1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.421+0000 7fd553200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd54c108410 0x7fd54c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.421+0000 7fd553200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c112410 con 0x7fd54c1023a0 2024-05-03T22:11:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.421+0000 7fd553200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c112290 con 0x7fd54c108410 2024-05-03T22:11:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.421+0000 7fd553200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c112590 con 0x7fd54c102d60 2024-05-03T22:11:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.421+0000 7fd54be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd54c1023a0 0x7fd54c1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.421+0000 7fd54be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd54c1023a0 0x7fd54c1a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51166/0 (socket says 172.21.15.82:51166) 2024-05-03T22:11:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.421+0000 7fd54be00700 1 -- 172.21.15.82:0/2214374674 learned_addr learned my addr 172.21.15.82:0/2214374674 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:11:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.421+0000 7fd551200700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd54c108410 0x7fd54c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.422+0000 7fd543400700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd54c102d60 0x7fd54c1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.422+0000 7fd54be00700 1 -- 172.21.15.82:0/2214374674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd54c102d60 msgr2=0x7fd54c1a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.422+0000 7fd54be00700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd54c102d60 0x7fd54c1a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.422+0000 7fd54be00700 1 -- 172.21.15.82:0/2214374674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd54c108410 msgr2=0x7fd54c19bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.422+0000 7fd54be00700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd54c108410 0x7fd54c19bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.422+0000 7fd54be00700 1 -- 172.21.15.82:0/2214374674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c19c260 con 0x7fd54c1023a0 2024-05-03T22:11:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.422+0000 7fd54be00700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd54c1023a0 0x7fd54c1a1940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd53c006010 tx=0x7fd53c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.422+0000 7fd549600700 1 -- 172.21.15.82:0/2214374674 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c027070 con 0x7fd54c1023a0 2024-05-03T22:11:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.422+0000 7fd553200700 1 -- 172.21.15.82:0/2214374674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c19c4f0 con 0x7fd54c1023a0 2024-05-03T22:11:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.422+0000 7fd549600700 1 -- 172.21.15.82:0/2214374674 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd53c00fb90 con 0x7fd54c1023a0 2024-05-03T22:11:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.422+0000 7fd549600700 1 -- 172.21.15.82:0/2214374674 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0173f0 con 0x7fd54c1023a0 2024-05-03T22:11:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.423+0000 7fd553200700 1 -- 172.21.15.82:0/2214374674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54c1a8810 con 0x7fd54c1023a0 2024-05-03T22:11:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.424+0000 7fd553200700 1 -- 172.21.15.82:0/2214374674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54c103ac0 con 0x7fd54c1023a0 2024-05-03T22:11:27.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.426+0000 7fd549600700 1 -- 172.21.15.82:0/2214374674 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd53c02a070 con 0x7fd54c1023a0 2024-05-03T22:11:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.427+0000 7fd549600700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5300b2900 0x7fd5300b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.428+0000 7fd549600700 1 -- 172.21.15.82:0/2214374674 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fd53c0e2d30 con 0x7fd54c1023a0 2024-05-03T22:11:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.428+0000 7fd543400700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5300b2900 0x7fd5300b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.428+0000 7fd543400700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5300b2900 0x7fd5300b4dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd54c100ae0 tx=0x7fd534009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:27.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.432+0000 7fd549600700 1 -- 172.21.15.82:0/2214374674 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd53c0e8020 con 0x7fd54c1023a0 2024-05-03T22:11:27.527 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:11:27 smithi130 ceph-mds[62937]: -- 172.21.15.130:0/1208545335 <== mon.1 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4506dba40 con 0x55a4506aec00 2024-05-03T22:11:27.527 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:11:27 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l[62933]: starting mds.l at 2024-05-03T22:11:27.527 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:11:27 smithi130 bash[62919]: 31d8ffe47f9b763a52f353ebd793060218cc1f373788c14090242d2fffb9ffd1 2024-05-03T22:11:27.527 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:11:27 smithi130 systemd[1]: Started Ceph mds.l for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:11:27.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.713+0000 7fd553200700 1 -- 172.21.15.82:0/2214374674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd54c06a190 con 0x7fd54c1023a0 2024-05-03T22:11:27.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.714+0000 7fd549600700 1 -- 172.21.15.82:0/2214374674 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7fd53c013070 con 0x7fd54c1023a0 2024-05-03T22:11:27.716 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:11:27.716 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-03T22:11:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 -- 172.21.15.82:0/2214374674 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5300b2900 msgr2=0x7fd5300b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5300b2900 0x7fd5300b4dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd54c100ae0 tx=0x7fd534009040 comp rx=0 tx=0).stop 2024-05-03T22:11:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 -- 172.21.15.82:0/2214374674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd54c1023a0 msgr2=0x7fd54c1a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd54c1023a0 0x7fd54c1a1940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd53c006010 tx=0x7fd53c0057c0 comp rx=0 tx=0).stop 2024-05-03T22:11:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 -- 172.21.15.82:0/2214374674 shutdown_connections 2024-05-03T22:11:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5300b2900 0x7fd5300b4dc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd54c1023a0 0x7fd54c1a1940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd54c108410 0x7fd54c19bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 --2- 172.21.15.82:0/2214374674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd54c102d60 0x7fd54c1a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 -- 172.21.15.82:0/2214374674 >> 172.21.15.82:0/2214374674 conn(0x7fd54c079310 msgr2=0x7fd54c06bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 -- 172.21.15.82:0/2214374674 shutdown_connections 2024-05-03T22:11:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:27.717+0000 7fd553200700 1 -- 172.21.15.82:0/2214374674 wait complete. 2024-05-03T22:11:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 2 2024-05-03T22:11:28.314 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:28.315 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.130:6832/2041703143,v1:172.21.15.130:6833/2041703143] up:boot 2024-05-03T22:11:28.315 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: fsmap 1 up:standby 2024-05-03T22:11:28.315 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T22:11:28.315 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:28.315 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:28.315 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:28.315 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:28.315 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:28.315 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:28.315 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: Deploying daemon mds.k on smithi116 2024-05-03T22:11:28.315 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:28 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2214374674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.130:6832/2041703143,v1:172.21.15.130:6833/2041703143] up:boot 2024-05-03T22:11:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: fsmap 1 up:standby 2024-05-03T22:11:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T22:11:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: Deploying daemon mds.k on smithi116 2024-05-03T22:11:28.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:28 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2214374674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.130:6832/2041703143,v1:172.21.15.130:6833/2041703143] up:boot 2024-05-03T22:11:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: fsmap 1 up:standby 2024-05-03T22:11:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T22:11:28.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:28.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:28.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:28.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:28.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:28.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:28.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: Deploying daemon mds.k on smithi116 2024-05-03T22:11:28.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:28 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2214374674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:30.422 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:30 smithi116 ceph-mon[31828]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:30.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:30 smithi082 ceph-mon[28404]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:30.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:30 smithi130 ceph-mon[32417]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:30.770 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:11:30.969 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:11:30 smithi116 podman[61503]: 2024-05-03 22:11:30.806598656 +0000 UTC m=+0.149507332 container create dc40b64618d5e167e8cf0acc87816c901658002f05e02765ff0c7df70a70dffa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-03T22:11:31.205 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:11:31.436 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:11:31 smithi116 podman[61503]: 2024-05-03 22:11:31.068591006 +0000 UTC m=+0.411499692 container init dc40b64618d5e167e8cf0acc87816c901658002f05e02765ff0c7df70a70dffa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:11:31.436 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:11:31 smithi116 podman[61503]: 2024-05-03 22:11:31.077776563 +0000 UTC m=+0.420685204 container start dc40b64618d5e167e8cf0acc87816c901658002f05e02765ff0c7df70a70dffa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS) 2024-05-03T22:11:31.436 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:11:31 smithi116 ceph-mds[61528]: -- 172.21.15.116:0/3056599189 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f1e33dfa40 con 0x55f1e33b2800 2024-05-03T22:11:31.436 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:11:31 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k[61522]: starting mds.k at 2024-05-03T22:11:31.436 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:11:31 smithi116 bash[61503]: dc40b64618d5e167e8cf0acc87816c901658002f05e02765ff0c7df70a70dffa 2024-05-03T22:11:31.437 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:11:31 smithi116 systemd[1]: Started Ceph mds.k for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:11:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:32 smithi130 ceph-mon[32417]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:32.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:32 smithi130 ceph-mon[32417]: Deploying daemon mds.j on smithi082 2024-05-03T22:11:32.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:32 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] up:boot 2024-05-03T22:11:32.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:32 smithi130 ceph-mon[32417]: fsmap 2 up:standby 2024-05-03T22:11:32.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T22:11:32.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:32 smithi116 ceph-mon[31828]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:32.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:32.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:32.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:32.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:32.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:32.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:32.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:32 smithi116 ceph-mon[31828]: Deploying daemon mds.j on smithi082 2024-05-03T22:11:32.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:32 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] up:boot 2024-05-03T22:11:32.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:32 smithi116 ceph-mon[31828]: fsmap 2 up:standby 2024-05-03T22:11:32.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T22:11:32.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:32 smithi082 ceph-mon[28404]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:32.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:32.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:32.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:32.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:32.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:32.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:32.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:32 smithi082 ceph-mon[28404]: Deploying daemon mds.j on smithi082 2024-05-03T22:11:32.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:32 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] up:boot 2024-05-03T22:11:32.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:32 smithi082 ceph-mon[28404]: fsmap 2 up:standby 2024-05-03T22:11:32.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T22:11:34.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:34 smithi082 ceph-mon[28404]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:34 smithi130 ceph-mon[32417]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:34 smithi116 ceph-mon[31828]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:34.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.797+0000 7f2b95600700 1 -- 172.21.15.82:0/3009503842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b9010a490 msgr2=0x7f2b901169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:34.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.797+0000 7f2b95600700 1 --2- 172.21.15.82:0/3009503842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b9010a490 0x7f2b901169a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800b0a0 tx=0x7f2b8800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:11:34.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.797+0000 7f2b95600700 1 -- 172.21.15.82:0/3009503842 shutdown_connections 2024-05-03T22:11:34.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.797+0000 7f2b95600700 1 --2- 172.21.15.82:0/3009503842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b9010a490 0x7f2b901169a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:34.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.797+0000 7f2b95600700 1 --2- 172.21.15.82:0/3009503842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b9010fb60 0x7f2b9010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:34.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.797+0000 7f2b95600700 1 --2- 172.21.15.82:0/3009503842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b90109ad0 0x7f2b90109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:34.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.797+0000 7f2b95600700 1 -- 172.21.15.82:0/3009503842 >> 172.21.15.82:0/3009503842 conn(0x7f2b90076c70 msgr2=0x7f2b90079090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:34.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.797+0000 7f2b95600700 1 -- 172.21.15.82:0/3009503842 shutdown_connections 2024-05-03T22:11:34.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.797+0000 7f2b95600700 1 -- 172.21.15.82:0/3009503842 wait complete. 2024-05-03T22:11:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.798+0000 7f2b95600700 1 Processor -- start 2024-05-03T22:11:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.798+0000 7f2b95600700 1 -- start start 2024-05-03T22:11:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.799+0000 7f2b95600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b90109ad0 0x7f2b9019ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.799+0000 7f2b95600700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b9010a490 0x7f2b901a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.799+0000 7f2b95600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b9010fb60 0x7f2b901a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.799+0000 7f2b95600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90119bc0 con 0x7f2b90109ad0 2024-05-03T22:11:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.799+0000 7f2b95600700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90119a40 con 0x7f2b9010a490 2024-05-03T22:11:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.799+0000 7f2b95600700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90119d40 con 0x7f2b9010fb60 2024-05-03T22:11:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.799+0000 7f2b8ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b90109ad0 0x7f2b9019ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.799+0000 7f2b8ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b90109ad0 0x7f2b9019ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60114/0 (socket says 172.21.15.82:60114) 2024-05-03T22:11:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.799+0000 7f2b8ea00700 1 -- 172.21.15.82:0/3538985278 learned_addr learned my addr 172.21.15.82:0/3538985278 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:11:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b8ea00700 1 -- 172.21.15.82:0/3538985278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b9010fb60 msgr2=0x7f2b901a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b8ea00700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b9010fb60 0x7f2b901a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b8ea00700 1 -- 172.21.15.82:0/3538985278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b9010a490 msgr2=0x7f2b901a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b8e000700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b9010a490 0x7f2b901a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b8ea00700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b9010a490 0x7f2b901a04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b8ea00700 1 -- 172.21.15.82:0/3538985278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b901a4fc0 con 0x7f2b90109ad0 2024-05-03T22:11:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b8ea00700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b90109ad0 0x7f2b9019ffb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000d980 tx=0x7f2b8000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b87400700 1 -- 172.21.15.82:0/3538985278 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80017070 con 0x7f2b90109ad0 2024-05-03T22:11:34.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b87400700 1 -- 172.21.15.82:0/3538985278 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b80004830 con 0x7f2b90109ad0 2024-05-03T22:11:34.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b95600700 1 -- 172.21.15.82:0/3538985278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b901a52b0 con 0x7f2b90109ad0 2024-05-03T22:11:34.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b87400700 1 -- 172.21.15.82:0/3538985278 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b800053a0 con 0x7f2b90109ad0 2024-05-03T22:11:34.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.800+0000 7f2b95600700 1 -- 172.21.15.82:0/3538985278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b901acb30 con 0x7f2b90109ad0 2024-05-03T22:11:34.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.801+0000 7f2b95600700 1 -- 172.21.15.82:0/3538985278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b9006a190 con 0x7f2b90109ad0 2024-05-03T22:11:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.804+0000 7f2b87400700 1 -- 172.21.15.82:0/3538985278 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2b800049e0 con 0x7f2b90109ad0 2024-05-03T22:11:34.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.805+0000 7f2b87400700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2b740b2880 0x7f2b740b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:34.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.805+0000 7f2b87400700 1 -- 172.21.15.82:0/3538985278 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f2b800e2160 con 0x7f2b90109ad0 2024-05-03T22:11:34.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.805+0000 7f2b8e000700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2b740b2880 0x7f2b740b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:34.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.806+0000 7f2b8e000700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2b740b2880 0x7f2b740b4d40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b90079220 tx=0x7f2b7c005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:34.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:34.808+0000 7f2b87400700 1 -- 172.21.15.82:0/3538985278 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2b80020020 con 0x7f2b90109ad0 2024-05-03T22:11:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.094+0000 7f2b95600700 1 -- 172.21.15.82:0/3538985278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b9002e6d0 con 0x7f2b90109ad0 2024-05-03T22:11:35.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.095+0000 7f2b87400700 1 -- 172.21.15.82:0/3538985278 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7f2b800aa280 con 0x7f2b90109ad0 2024-05-03T22:11:35.097 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:11:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-03T22:11:35.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.098+0000 7f2b95600700 1 -- 172.21.15.82:0/3538985278 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2b740b2880 msgr2=0x7f2b740b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:35.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.098+0000 7f2b95600700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2b740b2880 0x7f2b740b4d40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b90079220 tx=0x7f2b7c005d50 comp rx=0 tx=0).stop 2024-05-03T22:11:35.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.098+0000 7f2b95600700 1 -- 172.21.15.82:0/3538985278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b90109ad0 msgr2=0x7f2b9019ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:35.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.098+0000 7f2b95600700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b90109ad0 0x7f2b9019ffb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000d980 tx=0x7f2b8000dd40 comp rx=0 tx=0).stop 2024-05-03T22:11:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.099+0000 7f2b95600700 1 -- 172.21.15.82:0/3538985278 shutdown_connections 2024-05-03T22:11:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.099+0000 7f2b95600700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2b740b2880 0x7f2b740b4d40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.099+0000 7f2b95600700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b90109ad0 0x7f2b9019ffb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.099+0000 7f2b95600700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b9010fb60 0x7f2b901a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.099+0000 7f2b95600700 1 --2- 172.21.15.82:0/3538985278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b9010a490 0x7f2b901a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.099+0000 7f2b95600700 1 -- 172.21.15.82:0/3538985278 >> 172.21.15.82:0/3538985278 conn(0x7f2b90076c70 msgr2=0x7f2b900772c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.099+0000 7f2b95600700 1 -- 172.21.15.82:0/3538985278 shutdown_connections 2024-05-03T22:11:35.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:35.099+0000 7f2b95600700 1 -- 172.21.15.82:0/3538985278 wait complete. 2024-05-03T22:11:35.102 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2024-05-03T22:11:35.543 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:35 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3538985278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:35.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:35 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3538985278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:35.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:35 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3538985278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:36.425 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:36 smithi082 ceph-mon[28404]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:36 smithi116 ceph-mon[31828]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:36.703 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:11:36 smithi082 podman[66318]: 2024-05-03 22:11:36.523754375 +0000 UTC m=+0.231209213 container create a95ae38a883f7a406c516bd64425972c3f753f8ff2ab0c3e7b75446bd3dc1c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-j, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-03T22:11:36.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:36 smithi130 ceph-mon[32417]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:37.226 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:11:36 smithi082 podman[66318]: 2024-05-03 22:11:36.836336555 +0000 UTC m=+0.543791420 container init a95ae38a883f7a406c516bd64425972c3f753f8ff2ab0c3e7b75446bd3dc1c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-j, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-05-03T22:11:37.226 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:11:36 smithi082 podman[66318]: 2024-05-03 22:11:36.846044924 +0000 UTC m=+0.553499762 container start a95ae38a883f7a406c516bd64425972c3f753f8ff2ab0c3e7b75446bd3dc1c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-j, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-03T22:11:37.226 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:11:36 smithi082 ceph-mds[66336]: -- 172.21.15.82:0/30495252 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b3f8217a40 con 0x55b3f81eac00 2024-05-03T22:11:37.226 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:11:36 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-j[66332]: starting mds.j at 2024-05-03T22:11:37.226 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:11:36 smithi082 bash[66318]: a95ae38a883f7a406c516bd64425972c3f753f8ff2ab0c3e7b75446bd3dc1c85 2024-05-03T22:11:37.227 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:11:36 smithi082 systemd[1]: Started Ceph mds.j for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:11:38.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:11:38.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:38 smithi082 ceph-mon[28404]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:38.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:38.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:38.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:38.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:38.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:38.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:38.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:38 smithi082 ceph-mon[28404]: Deploying daemon mds.d on smithi082 2024-05-03T22:11:38.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:38 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.82:6834/288630872,v1:172.21.15.82:6835/288630872] up:boot 2024-05-03T22:11:38.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:38 smithi082 ceph-mon[28404]: fsmap 3 up:standby 2024-05-03T22:11:38.411 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-03T22:11:38.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:38 smithi116 ceph-mon[31828]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:38.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:38.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:38.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:38.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:38.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:38.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:38.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:38 smithi116 ceph-mon[31828]: Deploying daemon mds.d on smithi082 2024-05-03T22:11:38.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:38 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.82:6834/288630872,v1:172.21.15.82:6835/288630872] up:boot 2024-05-03T22:11:38.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:38 smithi116 ceph-mon[31828]: fsmap 3 up:standby 2024-05-03T22:11:38.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-03T22:11:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:38 smithi130 ceph-mon[32417]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:38.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:38.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:38.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:38.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:38 smithi130 ceph-mon[32417]: Deploying daemon mds.d on smithi082 2024-05-03T22:11:38.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:38 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.82:6834/288630872,v1:172.21.15.82:6835/288630872] up:boot 2024-05-03T22:11:38.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:38 smithi130 ceph-mon[32417]: fsmap 3 up:standby 2024-05-03T22:11:38.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-03T22:11:39.471 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:11:40.259 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:40 smithi082 ceph-mon[28404]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:40.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:40 smithi116 ceph-mon[31828]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:40.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:40 smithi130 ceph-mon[32417]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:40.640 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:11:40 smithi082 systemd[1]: Starting Ceph mds.d for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:11:41.363 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:11:41 smithi082 podman[66712]: 2024-05-03 22:11:41.121429141 +0000 UTC m=+0.034097405 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:11:41.363 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:11:41 smithi082 podman[66712]: 2024-05-03 22:11:41.2521433 +0000 UTC m=+0.164811597 container create 17942a4f5afbd586b93109c0497c1495fdf0164b1653851404a619670070555f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-d, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-05-03T22:11:41.953 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:11:41 smithi082 podman[66712]: 2024-05-03 22:11:41.826025209 +0000 UTC m=+0.738693516 container init 17942a4f5afbd586b93109c0497c1495fdf0164b1653851404a619670070555f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-03T22:11:41.953 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:11:41 smithi082 podman[66712]: 2024-05-03 22:11:41.836821365 +0000 UTC m=+0.749489639 container start 17942a4f5afbd586b93109c0497c1495fdf0164b1653851404a619670070555f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:11:41.953 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:11:41 smithi082 ceph-mds[66753]: -- 172.21.15.82:0/3816766309 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce832afa40 con 0x55ce83282800 2024-05-03T22:11:41.953 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:11:41 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-d[66745]: starting mds.d at 2024-05-03T22:11:42.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.119+0000 7fa509a00700 1 -- 172.21.15.82:0/1515194291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa50410a3a0 msgr2=0x7fa504116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:42.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.119+0000 7fa509a00700 1 --2- 172.21.15.82:0/1515194291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa50410a3a0 0x7fa504116840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00b0a0 tx=0x7fa4fc00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:11:42.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.119+0000 7fa509a00700 1 -- 172.21.15.82:0/1515194291 shutdown_connections 2024-05-03T22:11:42.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.119+0000 7fa509a00700 1 --2- 172.21.15.82:0/1515194291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa50410a3a0 0x7fa504116840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:42.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.119+0000 7fa509a00700 1 --2- 172.21.15.82:0/1515194291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50410e8b0 0x7fa50410ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:42.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.119+0000 7fa509a00700 1 --2- 172.21.15.82:0/1515194291 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5041099e0 0x7fa504109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:42.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.119+0000 7fa509a00700 1 -- 172.21.15.82:0/1515194291 >> 172.21.15.82:0/1515194291 conn(0x7fa504079230 msgr2=0x7fa5041082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:42.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.120+0000 7fa509a00700 1 -- 172.21.15.82:0/1515194291 shutdown_connections 2024-05-03T22:11:42.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.120+0000 7fa509a00700 1 -- 172.21.15.82:0/1515194291 wait complete. 2024-05-03T22:11:42.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.121+0000 7fa509a00700 1 Processor -- start 2024-05-03T22:11:42.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.121+0000 7fa509a00700 1 -- start start 2024-05-03T22:11:42.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.121+0000 7fa509a00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5041099e0 0x7fa50419ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:42.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.121+0000 7fa509a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa50410a3a0 0x7fa5041a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:42.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.121+0000 7fa509a00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50410e8b0 0x7fa5041a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:42.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.121+0000 7fa509a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa504119a90 con 0x7fa50410a3a0 2024-05-03T22:11:42.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.121+0000 7fa509a00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa504119910 con 0x7fa50410e8b0 2024-05-03T22:11:42.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.121+0000 7fa509a00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa504119c10 con 0x7fa5041099e0 2024-05-03T22:11:42.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.121+0000 7fa503400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa50410a3a0 0x7fa5041a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:42.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.121+0000 7fa503400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa50410a3a0 0x7fa5041a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60172/0 (socket says 172.21.15.82:60172) 2024-05-03T22:11:42.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.122+0000 7fa503400700 1 -- 172.21.15.82:0/3995727102 learned_addr learned my addr 172.21.15.82:0/3995727102 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.122+0000 7fa503e00700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5041099e0 0x7fa50419ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.122+0000 7fa509000700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50410e8b0 0x7fa5041a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.122+0000 7fa503400700 1 -- 172.21.15.82:0/3995727102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5041099e0 msgr2=0x7fa50419ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.122+0000 7fa503400700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5041099e0 0x7fa50419ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.122+0000 7fa503400700 1 -- 172.21.15.82:0/3995727102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50410e8b0 msgr2=0x7fa5041a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.122+0000 7fa503400700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50410e8b0 0x7fa5041a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.122+0000 7fa503400700 1 -- 172.21.15.82:0/3995727102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5041a4ec0 con 0x7fa50410a3a0 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.122+0000 7fa503400700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa50410a3a0 0x7fa5041a0440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000c970 tx=0x7fa4f000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.123+0000 7fa500c00700 1 -- 172.21.15.82:0/3995727102 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0007aa0 con 0x7fa50410a3a0 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.123+0000 7fa500c00700 1 -- 172.21.15.82:0/3995727102 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4f0004cc0 con 0x7fa50410a3a0 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.123+0000 7fa509a00700 1 -- 172.21.15.82:0/3995727102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5041a5150 con 0x7fa50410a3a0 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.123+0000 7fa500c00700 1 -- 172.21.15.82:0/3995727102 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0005500 con 0x7fa50410a3a0 2024-05-03T22:11:42.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.123+0000 7fa509a00700 1 -- 172.21.15.82:0/3995727102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5041aca30 con 0x7fa50410a3a0 2024-05-03T22:11:42.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.124+0000 7fa509a00700 1 -- 172.21.15.82:0/3995727102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa50406a190 con 0x7fa50410a3a0 2024-05-03T22:11:42.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.127+0000 7fa500c00700 1 -- 172.21.15.82:0/3995727102 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa4f0007c40 con 0x7fa50410a3a0 2024-05-03T22:11:42.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.128+0000 7fa500c00700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa4e80b2900 0x7fa4e80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:42.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.128+0000 7fa500c00700 1 -- 172.21.15.82:0/3995727102 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fa4f00e1ea0 con 0x7fa50410a3a0 2024-05-03T22:11:42.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.129+0000 7fa503e00700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa4e80b2900 0x7fa4e80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:42.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.129+0000 7fa503e00700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa4e80b2900 0x7fa4e80b4dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4005fd0 tx=0x7fa4f4005ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:42.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.130+0000 7fa500c00700 1 -- 172.21.15.82:0/3995727102 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa4f00aa0e0 con 0x7fa50410a3a0 2024-05-03T22:11:42.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:42 smithi082 ceph-mon[28404]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:42.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.427+0000 7fa509a00700 1 -- 172.21.15.82:0/3995727102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa50402e510 con 0x7fa50410a3a0 2024-05-03T22:11:42.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.428+0000 7fa500c00700 1 -- 172.21.15.82:0/3995727102 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3871 (secure 0 0 0) 0x7fa4f00a99e0 con 0x7fa50410a3a0 2024-05-03T22:11:42.430 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:11:42.431 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-03T22:11:42.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 -- 172.21.15.82:0/3995727102 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa4e80b2900 msgr2=0x7fa4e80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:42.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa4e80b2900 0x7fa4e80b4dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4005fd0 tx=0x7fa4f4005ce0 comp rx=0 tx=0).stop 2024-05-03T22:11:42.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 -- 172.21.15.82:0/3995727102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa50410a3a0 msgr2=0x7fa5041a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:42.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa50410a3a0 0x7fa5041a0440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000c970 tx=0x7fa4f000cd30 comp rx=0 tx=0).stop 2024-05-03T22:11:42.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 -- 172.21.15.82:0/3995727102 shutdown_connections 2024-05-03T22:11:42.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa4e80b2900 0x7fa4e80b4dc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:42.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa50410e8b0 0x7fa5041a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:42.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5041099e0 0x7fa50419ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:42.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 --2- 172.21.15.82:0/3995727102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa50410a3a0 0x7fa5041a0440 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:42.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 -- 172.21.15.82:0/3995727102 >> 172.21.15.82:0/3995727102 conn(0x7fa504079230 msgr2=0x7fa504079890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:42.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 -- 172.21.15.82:0/3995727102 shutdown_connections 2024-05-03T22:11:42.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:42.431+0000 7fa509a00700 1 -- 172.21.15.82:0/3995727102 wait complete. 2024-05-03T22:11:42.434 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 5 2024-05-03T22:11:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:42 smithi116 ceph-mon[31828]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:42 smithi130 ceph-mon[32417]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:42.726 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:11:42 smithi082 bash[66712]: 17942a4f5afbd586b93109c0497c1495fdf0164b1653851404a619670070555f 2024-05-03T22:11:42.727 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:11:42 smithi082 systemd[1]: Started Ceph mds.d for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:11:43.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:43 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.82:6836/2933152339,v1:172.21.15.82:6837/2933152339] up:boot 2024-05-03T22:11:43.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:43 smithi082 ceph-mon[28404]: fsmap 4 up:standby 2024-05-03T22:11:43.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-03T22:11:43.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:43.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:43.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:43 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3995727102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:43.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:43.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:43.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:43.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:43 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.82:6836/2933152339,v1:172.21.15.82:6837/2933152339] up:boot 2024-05-03T22:11:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:43 smithi116 ceph-mon[31828]: fsmap 4 up:standby 2024-05-03T22:11:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-03T22:11:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:43 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3995727102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:43.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:43.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:43.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:43.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:43 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.82:6836/2933152339,v1:172.21.15.82:6837/2933152339] up:boot 2024-05-03T22:11:43.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:43 smithi130 ceph-mon[32417]: fsmap 4 up:standby 2024-05-03T22:11:43.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-03T22:11:43.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:43.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:43.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:43 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3995727102' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:43.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:43.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:43.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:43.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:44 smithi116 ceph-mon[31828]: Deploying daemon mds.e on smithi116 2024-05-03T22:11:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:44 smithi116 ceph-mon[31828]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:44 smithi082 ceph-mon[28404]: Deploying daemon mds.e on smithi116 2024-05-03T22:11:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:44 smithi082 ceph-mon[28404]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:44 smithi130 ceph-mon[32417]: Deploying daemon mds.e on smithi116 2024-05-03T22:11:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:44 smithi130 ceph-mon[32417]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:45.314 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:11:45.769 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:11:45.935 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:11:45 smithi116 systemd[1]: Starting Ceph mds.e for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:11:46.168 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:46 smithi082 ceph-mon[28404]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:46.258 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:46 smithi116 ceph-mon[31828]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:46.259 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:11:45 smithi116 podman[61815]: 2024-05-03 22:11:45.873554789 +0000 UTC m=+0.034440279 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:11:46.259 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:11:45 smithi116 podman[61815]: 2024-05-03 22:11:45.977761309 +0000 UTC m=+0.138646836 container create 53f56e322049dc4c94acee1c7589428e3ae2db553adcd849596389f1b5a15deb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-03T22:11:46.259 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:11:46 smithi116 podman[61815]: 2024-05-03 22:11:46.257274747 +0000 UTC m=+0.418160278 container init 53f56e322049dc4c94acee1c7589428e3ae2db553adcd849596389f1b5a15deb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-03T22:11:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:46 smithi130 ceph-mon[32417]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:46.686 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:11:46 smithi116 podman[61815]: 2024-05-03 22:11:46.267514071 +0000 UTC m=+0.428399568 container start 53f56e322049dc4c94acee1c7589428e3ae2db553adcd849596389f1b5a15deb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-03T22:11:46.686 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:11:46 smithi116 ceph-mds[61834]: -- 172.21.15.116:0/942140011 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5606034eda40 con 0x5606034c0c00 2024-05-03T22:11:46.686 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:11:46 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e[61830]: starting mds.e at 2024-05-03T22:11:46.686 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:11:46 smithi116 bash[61815]: 53f56e322049dc4c94acee1c7589428e3ae2db553adcd849596389f1b5a15deb 2024-05-03T22:11:46.686 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:11:46 smithi116 systemd[1]: Started Ceph mds.e for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:11:47.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:47 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:47.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:47 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:47.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:47 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:47.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:47 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:47.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:47 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:47.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:47 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:47.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:47 smithi082 ceph-mon[28404]: Deploying daemon mds.f on smithi130 2024-05-03T22:11:47.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:47 smithi082 ceph-mon[28404]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:47.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:47 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] up:boot 2024-05-03T22:11:47.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:47 smithi082 ceph-mon[28404]: fsmap 5 up:standby 2024-05-03T22:11:47.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:47 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T22:11:47.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:47 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:47.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:47 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:47.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:47 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:47.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:47 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:47.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:47 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:47.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:47 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:47.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:47 smithi130 ceph-mon[32417]: Deploying daemon mds.f on smithi130 2024-05-03T22:11:47.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:47 smithi130 ceph-mon[32417]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:47.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:47 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] up:boot 2024-05-03T22:11:47.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:47 smithi130 ceph-mon[32417]: fsmap 5 up:standby 2024-05-03T22:11:47.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:47 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T22:11:47.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:47 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:47.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:47 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:47.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:47 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:47.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:47 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:47.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:47 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:47.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:47 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:47.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:47 smithi116 ceph-mon[31828]: Deploying daemon mds.f on smithi130 2024-05-03T22:11:47.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:47 smithi116 ceph-mon[31828]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:47.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:47 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] up:boot 2024-05-03T22:11:47.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:47 smithi116 ceph-mon[31828]: fsmap 5 up:standby 2024-05-03T22:11:47.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:47 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T22:11:48.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.248+0000 7efc3d200700 1 -- 172.21.15.82:0/2105033650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc381055d0 msgr2=0x7efc38105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:48.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.248+0000 7efc3d200700 1 --2- 172.21.15.82:0/2105033650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc381055d0 0x7efc38105a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efc24009990 tx=0x7efc24009ca0 comp rx=0 tx=0).stop 2024-05-03T22:11:48.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.248+0000 7efc3d200700 1 -- 172.21.15.82:0/2105033650 shutdown_connections 2024-05-03T22:11:48.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.248+0000 7efc3d200700 1 --2- 172.21.15.82:0/2105033650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc38105f90 0x7efc381124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:48.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.248+0000 7efc3d200700 1 --2- 172.21.15.82:0/2105033650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc3810b660 0x7efc3810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:48.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.248+0000 7efc3d200700 1 --2- 172.21.15.82:0/2105033650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc381055d0 0x7efc38105a50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:48.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.248+0000 7efc3d200700 1 -- 172.21.15.82:0/2105033650 >> 172.21.15.82:0/2105033650 conn(0x7efc381010c0 msgr2=0x7efc381034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:48.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.248+0000 7efc3d200700 1 -- 172.21.15.82:0/2105033650 shutdown_connections 2024-05-03T22:11:48.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.248+0000 7efc3d200700 1 -- 172.21.15.82:0/2105033650 wait complete. 2024-05-03T22:11:48.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.249+0000 7efc3d200700 1 Processor -- start 2024-05-03T22:11:48.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.249+0000 7efc3d200700 1 -- start start 2024-05-03T22:11:48.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.249+0000 7efc3d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc381055d0 0x7efc381a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:48.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.249+0000 7efc3d200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc38105f90 0x7efc381a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:48.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.249+0000 7efc3d200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc3810b660 0x7efc3819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:48.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.249+0000 7efc3d200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc38115790 con 0x7efc381055d0 2024-05-03T22:11:48.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.249+0000 7efc3d200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efc38115610 con 0x7efc3810b660 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.249+0000 7efc3d200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efc38115910 con 0x7efc38105f90 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.250+0000 7efc37400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc381055d0 0x7efc381a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.250+0000 7efc37400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc381055d0 0x7efc381a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43698/0 (socket says 172.21.15.82:43698) 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.250+0000 7efc37400700 1 -- 172.21.15.82:0/1024692600 learned_addr learned my addr 172.21.15.82:0/1024692600 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.250+0000 7efc36a00700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc38105f90 0x7efc381a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.250+0000 7efc37e00700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc3810b660 0x7efc3819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.250+0000 7efc37400700 1 -- 172.21.15.82:0/1024692600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc38105f90 msgr2=0x7efc381a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.250+0000 7efc37400700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc38105f90 0x7efc381a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.250+0000 7efc37400700 1 -- 172.21.15.82:0/1024692600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc3810b660 msgr2=0x7efc3819bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.250+0000 7efc37400700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc3810b660 0x7efc3819bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.250+0000 7efc37400700 1 -- 172.21.15.82:0/1024692600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3819c410 con 0x7efc381055d0 2024-05-03T22:11:48.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.251+0000 7efc37400700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc381055d0 0x7efc381a1a60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efc2800b500 tx=0x7efc2800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:48.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.251+0000 7efc2fe00700 1 -- 172.21.15.82:0/1024692600 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28015020 con 0x7efc381055d0 2024-05-03T22:11:48.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.251+0000 7efc2fe00700 1 -- 172.21.15.82:0/1024692600 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc28011cc0 con 0x7efc381055d0 2024-05-03T22:11:48.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.251+0000 7efc2fe00700 1 -- 172.21.15.82:0/1024692600 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28010ca0 con 0x7efc381055d0 2024-05-03T22:11:48.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.251+0000 7efc3d200700 1 -- 172.21.15.82:0/1024692600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3819c700 con 0x7efc381055d0 2024-05-03T22:11:48.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.251+0000 7efc3d200700 1 -- 172.21.15.82:0/1024692600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc381a89e0 con 0x7efc381055d0 2024-05-03T22:11:48.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.252+0000 7efc3d200700 1 -- 172.21.15.82:0/1024692600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc38106d10 con 0x7efc381055d0 2024-05-03T22:11:48.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.254+0000 7efc2fe00700 1 -- 172.21.15.82:0/1024692600 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7efc28018020 con 0x7efc381055d0 2024-05-03T22:11:48.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.256+0000 7efc2fe00700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efc1c0b2980 0x7efc1c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:48.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.256+0000 7efc2fe00700 1 -- 172.21.15.82:0/1024692600 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7efc280e15c0 con 0x7efc381055d0 2024-05-03T22:11:48.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.256+0000 7efc36a00700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efc1c0b2980 0x7efc1c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:48.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.257+0000 7efc36a00700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efc1c0b2980 0x7efc1c0b4e40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efc2400b5c0 tx=0x7efc2401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:48.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.261+0000 7efc2fe00700 1 -- 172.21.15.82:0/1024692600 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7efc2801f020 con 0x7efc381055d0 2024-05-03T22:11:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.544+0000 7efc3d200700 1 -- 172.21.15.82:0/1024692600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc3802e510 con 0x7efc381055d0 2024-05-03T22:11:48.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.545+0000 7efc2fe00700 1 -- 172.21.15.82:0/1024692600 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4699 (secure 0 0 0) 0x7efc280a96e0 con 0x7efc381055d0 2024-05-03T22:11:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:11:48.547 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34412,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-03T22:11:48.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 -- 172.21.15.82:0/1024692600 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efc1c0b2980 msgr2=0x7efc1c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:48.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efc1c0b2980 0x7efc1c0b4e40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efc2400b5c0 tx=0x7efc2401a040 comp rx=0 tx=0).stop 2024-05-03T22:11:48.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 -- 172.21.15.82:0/1024692600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc381055d0 msgr2=0x7efc381a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:48.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc381055d0 0x7efc381a1a60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efc2800b500 tx=0x7efc2800b8c0 comp rx=0 tx=0).stop 2024-05-03T22:11:48.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 -- 172.21.15.82:0/1024692600 shutdown_connections 2024-05-03T22:11:48.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efc1c0b2980 0x7efc1c0b4e40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:48.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc381055d0 0x7efc381a1a60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:48.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc3810b660 0x7efc3819bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:48.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 --2- 172.21.15.82:0/1024692600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc38105f90 0x7efc381a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:48.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 -- 172.21.15.82:0/1024692600 >> 172.21.15.82:0/1024692600 conn(0x7efc381010c0 msgr2=0x7efc38102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:48.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 -- 172.21.15.82:0/1024692600 shutdown_connections 2024-05-03T22:11:48.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:48.548+0000 7efc3d200700 1 -- 172.21.15.82:0/1024692600 wait complete. 2024-05-03T22:11:48.551 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 6 2024-05-03T22:11:48.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:48 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1024692600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:48.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:48 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1024692600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:48.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:48 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1024692600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:49.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:49 smithi082 ceph-mon[28404]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:49.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:49 smithi116 ceph-mon[31828]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:49.964 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:49 smithi130 ceph-mon[32417]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:50.277 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:11:50 smithi130 podman[63223]: 2024-05-03 22:11:50.029860153 +0000 UTC m=+0.170790986 container create 64a74029371983a5d775eb18f63ba41170014df640da06a477ca96744d06c0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-03T22:11:50.778 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:11:50 smithi130 podman[63223]: 2024-05-03 22:11:50.283726537 +0000 UTC m=+0.424657392 container init 64a74029371983a5d775eb18f63ba41170014df640da06a477ca96744d06c0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS) 2024-05-03T22:11:50.778 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:11:50 smithi130 podman[63223]: 2024-05-03 22:11:50.29535476 +0000 UTC m=+0.436285593 container start 64a74029371983a5d775eb18f63ba41170014df640da06a477ca96744d06c0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:11:50.778 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:11:50 smithi130 ceph-mds[63249]: -- 172.21.15.130:0/3197134410 <== mon.1 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56410d683a40 con 0x56410d656c00 2024-05-03T22:11:50.778 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:11:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f[63243]: starting mds.f at 2024-05-03T22:11:50.778 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:11:50 smithi130 bash[63223]: 64a74029371983a5d775eb18f63ba41170014df640da06a477ca96744d06c0ac 2024-05-03T22:11:50.779 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:11:50 smithi130 systemd[1]: Started Ceph mds.f for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:11:51.513 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:11:51.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:51.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:51.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:51.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:51.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:51.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:51.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:51 smithi130 ceph-mon[32417]: Deploying daemon mds.c on smithi130 2024-05-03T22:11:51.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:51 smithi130 ceph-mon[32417]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:51.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:51 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.130:6834/710741525,v1:172.21.15.130:6835/710741525] up:boot 2024-05-03T22:11:51.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:51 smithi130 ceph-mon[32417]: fsmap 6 up:standby 2024-05-03T22:11:51.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:51 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T22:11:51.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:51.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:51.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:51.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:51.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:51.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:51.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:51 smithi116 ceph-mon[31828]: Deploying daemon mds.c on smithi130 2024-05-03T22:11:51.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:51 smithi116 ceph-mon[31828]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:51.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:51 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.130:6834/710741525,v1:172.21.15.130:6835/710741525] up:boot 2024-05-03T22:11:51.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:51 smithi116 ceph-mon[31828]: fsmap 6 up:standby 2024-05-03T22:11:51.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:51 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T22:11:51.960 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:11:51.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:51.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:51.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:51.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:51.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:51.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:51.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:51 smithi082 ceph-mon[28404]: Deploying daemon mds.c on smithi130 2024-05-03T22:11:51.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:51 smithi082 ceph-mon[28404]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:51.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:51 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.130:6834/710741525,v1:172.21.15.130:6835/710741525] up:boot 2024-05-03T22:11:51.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:51 smithi082 ceph-mon[28404]: fsmap 6 up:standby 2024-05-03T22:11:51.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:51 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T22:11:53.865 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:53 smithi082 ceph-mon[28404]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:53.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:53 smithi116 ceph-mon[31828]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:53.936 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:53 smithi130 ceph-mon[32417]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:54.261 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:11:53 smithi130 podman[63532]: 2024-05-03 22:11:53.962417526 +0000 UTC m=+0.154570990 container create f877dd61c79c9a6ca2e485f90026fb3d318fdccaf48da62f24b0daaf23cdf594 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:11:54.262 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:11:54 smithi130 podman[63532]: 2024-05-03 22:11:54.256855063 +0000 UTC m=+0.449008567 container init f877dd61c79c9a6ca2e485f90026fb3d318fdccaf48da62f24b0daaf23cdf594 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-03T22:11:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.374+0000 7f086fe00700 1 -- 172.21.15.82:0/2877212807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086810a490 msgr2=0x7f08681169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.374+0000 7f086fe00700 1 --2- 172.21.15.82:0/2877212807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086810a490 0x7f08681169a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f086000b0a0 tx=0x7f086000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:11:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.374+0000 7f086fe00700 1 -- 172.21.15.82:0/2877212807 shutdown_connections 2024-05-03T22:11:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.374+0000 7f086fe00700 1 --2- 172.21.15.82:0/2877212807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086810a490 0x7f08681169a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.374+0000 7f086fe00700 1 --2- 172.21.15.82:0/2877212807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086810fb60 0x7f086810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.374+0000 7f086fe00700 1 --2- 172.21.15.82:0/2877212807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0868109ad0 0x7f0868109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:54.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.374+0000 7f086fe00700 1 -- 172.21.15.82:0/2877212807 >> 172.21.15.82:0/2877212807 conn(0x7f0868076c70 msgr2=0x7f08681082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:54.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.374+0000 7f086fe00700 1 -- 172.21.15.82:0/2877212807 shutdown_connections 2024-05-03T22:11:54.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.374+0000 7f086fe00700 1 -- 172.21.15.82:0/2877212807 wait complete. 2024-05-03T22:11:54.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.375+0000 7f086fe00700 1 Processor -- start 2024-05-03T22:11:54.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.375+0000 7f086fe00700 1 -- start start 2024-05-03T22:11:54.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.376+0000 7f086fe00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0868109ad0 0x7f08681a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:54.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.376+0000 7f086fe00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086810a490 0x7f08681a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:54.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.376+0000 7f086fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086810fb60 0x7f08681a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:54.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.376+0000 7f086fe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0868119bd0 con 0x7f086810fb60 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.376+0000 7f086fe00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0868119a50 con 0x7f086810a490 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.376+0000 7f086fe00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0868119d50 con 0x7f0868109ad0 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.376+0000 7f086de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086810fb60 0x7f08681a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.376+0000 7f086de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086810fb60 0x7f08681a4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46070/0 (socket says 172.21.15.82:46070) 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.376+0000 7f086de00700 1 -- 172.21.15.82:0/4274462366 learned_addr learned my addr 172.21.15.82:0/4274462366 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.376+0000 7f086d400700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0868109ad0 0x7f08681a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.376+0000 7f086ca00700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086810a490 0x7f08681a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f086de00700 1 -- 172.21.15.82:0/4274462366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0868109ad0 msgr2=0x7f08681a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f086de00700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0868109ad0 0x7f08681a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f086de00700 1 -- 172.21.15.82:0/4274462366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086810a490 msgr2=0x7f08681a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f086de00700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086810a490 0x7f08681a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f086de00700 1 -- 172.21.15.82:0/4274462366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08681a50d0 con 0x7f086810fb60 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f086d400700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0868109ad0 0x7f08681a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:11:54.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f086ca00700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086810a490 0x7f08681a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:11:54.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f086de00700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086810fb60 0x7f08681a4990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f086000b070 tx=0x7f0860004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:54.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f0866000700 1 -- 172.21.15.82:0/4274462366 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860021070 con 0x7f086810fb60 2024-05-03T22:11:54.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f0866000700 1 -- 172.21.15.82:0/4274462366 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0860007c00 con 0x7f086810fb60 2024-05-03T22:11:54.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f086fe00700 1 -- 172.21.15.82:0/4274462366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08681a5360 con 0x7f086810fb60 2024-05-03T22:11:54.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f0866000700 1 -- 172.21.15.82:0/4274462366 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860004850 con 0x7f086810fb60 2024-05-03T22:11:54.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.377+0000 7f086fe00700 1 -- 172.21.15.82:0/4274462366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08681acc40 con 0x7f086810fb60 2024-05-03T22:11:54.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.378+0000 7f086fe00700 1 -- 172.21.15.82:0/4274462366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f086806a190 con 0x7f086810fb60 2024-05-03T22:11:54.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.381+0000 7f0866000700 1 -- 172.21.15.82:0/4274462366 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0860003fb0 con 0x7f086810fb60 2024-05-03T22:11:54.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.382+0000 7f0866000700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f08500b2880 0x7f08500b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:11:54.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.382+0000 7f0866000700 1 -- 172.21.15.82:0/4274462366 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f086000f020 con 0x7f086810fb60 2024-05-03T22:11:54.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.382+0000 7f086d400700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f08500b2880 0x7f08500b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:11:54.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.383+0000 7f086d400700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f08500b2880 0x7f08500b4d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f085c005e10 tx=0x7f085c005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:11:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.385+0000 7f0866000700 1 -- 172.21.15.82:0/4274462366 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f086002a020 con 0x7f086810fb60 2024-05-03T22:11:54.527 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:11:54 smithi130 podman[63532]: 2024-05-03 22:11:54.266905029 +0000 UTC m=+0.459058465 container start f877dd61c79c9a6ca2e485f90026fb3d318fdccaf48da62f24b0daaf23cdf594 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-03T22:11:54.527 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:11:54 smithi130 ceph-mds[63551]: -- 172.21.15.130:0/3702786578 <== mon.1 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf1b099a40 con 0x55bf1b06c800 2024-05-03T22:11:54.527 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:11:54 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c[63547]: starting mds.c at 2024-05-03T22:11:54.528 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:11:54 smithi130 bash[63532]: f877dd61c79c9a6ca2e485f90026fb3d318fdccaf48da62f24b0daaf23cdf594 2024-05-03T22:11:54.528 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:11:54 smithi130 systemd[1]: Started Ceph mds.c for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:11:54.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.678+0000 7f086fe00700 1 -- 172.21.15.82:0/4274462366 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f086802e510 con 0x7f086810fb60 2024-05-03T22:11:54.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.679+0000 7f0866000700 1 -- 172.21.15.82:0/4274462366 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6352 (secure 0 0 0) 0x7f086002e3e0 con 0x7f086810fb60 2024-05-03T22:11:54.681 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:11:54.681 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34412,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-03T22:11:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.682+0000 7f086fe00700 1 -- 172.21.15.82:0/4274462366 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f08500b2880 msgr2=0x7f08500b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.682+0000 7f086fe00700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f08500b2880 0x7f08500b4d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f085c005e10 tx=0x7f085c005d60 comp rx=0 tx=0).stop 2024-05-03T22:11:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.682+0000 7f086fe00700 1 -- 172.21.15.82:0/4274462366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086810fb60 msgr2=0x7f08681a4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:11:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.682+0000 7f086fe00700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086810fb60 0x7f08681a4990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f086000b070 tx=0x7f0860004d30 comp rx=0 tx=0).stop 2024-05-03T22:11:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.682+0000 7f086fe00700 1 -- 172.21.15.82:0/4274462366 shutdown_connections 2024-05-03T22:11:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.682+0000 7f086fe00700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f08500b2880 0x7f08500b4d40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.682+0000 7f086fe00700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f086810fb60 0x7f08681a4990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.682+0000 7f086fe00700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0868109ad0 0x7f08681a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.682+0000 7f086fe00700 1 --2- 172.21.15.82:0/4274462366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086810a490 0x7f08681a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:11:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.682+0000 7f086fe00700 1 -- 172.21.15.82:0/4274462366 >> 172.21.15.82:0/4274462366 conn(0x7f0868076c70 msgr2=0x7f0868077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:11:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.683+0000 7f086fe00700 1 -- 172.21.15.82:0/4274462366 shutdown_connections 2024-05-03T22:11:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:11:54.683+0000 7f086fe00700 1 -- 172.21.15.82:0/4274462366 wait complete. 2024-05-03T22:11:54.686 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-05-03T22:11:55.762 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:55.762 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:55.762 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:55.762 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:55.762 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:55.762 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:55.762 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: Deploying daemon mds.h on smithi116 2024-05-03T22:11:55.762 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:55.763 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.130:6836/4246597354,v1:172.21.15.130:6837/4246597354] up:boot 2024-05-03T22:11:55.763 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: fsmap 7 up:standby 2024-05-03T22:11:55.763 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T22:11:55.763 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:55 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/4274462366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: Deploying daemon mds.h on smithi116 2024-05-03T22:11:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.130:6836/4246597354,v1:172.21.15.130:6837/4246597354] up:boot 2024-05-03T22:11:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: fsmap 7 up:standby 2024-05-03T22:11:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T22:11:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:55 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/4274462366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:55.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: Deploying daemon mds.h on smithi116 2024-05-03T22:11:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.130:6836/4246597354,v1:172.21.15.130:6837/4246597354] up:boot 2024-05-03T22:11:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: fsmap 7 up:standby 2024-05-03T22:11:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T22:11:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:55 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/4274462366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:11:57.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:11:57.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:57 smithi116 ceph-mon[31828]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:57.935 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:11:57 smithi116 systemd[1]: Starting Ceph mds.h for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:11:57.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:57 smithi082 ceph-mon[28404]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:11:58.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:57 smithi130 ceph-mon[32417]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:58.343 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:11:58 smithi116 podman[62121]: 2024-05-03 22:11:57.94750616 +0000 UTC m=+0.035892885 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:11:58.343 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:11:58 smithi116 podman[62121]: 2024-05-03 22:11:58.064875078 +0000 UTC m=+0.153261798 container create 409af15ca2d53b437030d02d5369af197cfac4c1461ac0cd19af79723415f83a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-03T22:11:58.343 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:11:58 smithi116 podman[62121]: 2024-05-03 22:11:58.340512602 +0000 UTC m=+0.428899362 container init 409af15ca2d53b437030d02d5369af197cfac4c1461ac0cd19af79723415f83a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430) 2024-05-03T22:11:58.685 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:11:58 smithi116 podman[62121]: 2024-05-03 22:11:58.352141556 +0000 UTC m=+0.440528254 container start 409af15ca2d53b437030d02d5369af197cfac4c1461ac0cd19af79723415f83a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-05-03T22:11:58.686 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:11:58 smithi116 ceph-mds[62140]: -- 172.21.15.116:0/3745655949 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e8bc685a40 con 0x55e8bc658c00 2024-05-03T22:11:58.686 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:11:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h[62136]: starting mds.h at 2024-05-03T22:11:58.686 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:11:58 smithi116 bash[62121]: 409af15ca2d53b437030d02d5369af197cfac4c1461ac0cd19af79723415f83a 2024-05-03T22:11:58.686 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:11:58 smithi116 systemd[1]: Started Ceph mds.h for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:11:59.851 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:59 smithi082 ceph-mon[28404]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:59.851 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:59.852 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:59.852 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:59 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] up:boot 2024-05-03T22:11:59.852 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:59 smithi082 ceph-mon[28404]: fsmap 8 up:standby 2024-05-03T22:11:59.852 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T22:11:59.852 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:59.852 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:59.852 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:59.852 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:59.852 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:11:59 smithi082 ceph-mon[28404]: Deploying daemon mds.i on smithi130 2024-05-03T22:11:59.857 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:59 smithi130 ceph-mon[32417]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:59.858 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:59.858 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:59.858 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:59 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] up:boot 2024-05-03T22:11:59.858 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:59 smithi130 ceph-mon[32417]: fsmap 8 up:standby 2024-05-03T22:11:59.858 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T22:11:59.858 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:59.858 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:59.858 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:59.858 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:59.858 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:11:59 smithi130 ceph-mon[32417]: Deploying daemon mds.i on smithi130 2024-05-03T22:11:59.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:59 smithi116 ceph-mon[31828]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:11:59.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:59.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:59.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:59 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] up:boot 2024-05-03T22:11:59.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:59 smithi116 ceph-mon[31828]: fsmap 8 up:standby 2024-05-03T22:11:59.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T22:11:59.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:11:59.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:11:59.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:11:59.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:11:59.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:11:59 smithi116 ceph-mon[31828]: Deploying daemon mds.i on smithi130 2024-05-03T22:12:00.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.370+0000 7f6d97e00700 1 -- 172.21.15.82:0/2286647062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d901083c0 msgr2=0x7f6d9006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:00.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.370+0000 7f6d97e00700 1 --2- 172.21.15.82:0/2286647062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d901083c0 0x7f6d9006ba40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009990 tx=0x7f6d84009ca0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.370+0000 7f6d97e00700 1 -- 172.21.15.82:0/2286647062 shutdown_connections 2024-05-03T22:12:00.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.370+0000 7f6d97e00700 1 --2- 172.21.15.82:0/2286647062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d901083c0 0x7f6d9006ba40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.370+0000 7f6d97e00700 1 --2- 172.21.15.82:0/2286647062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d90105ed0 0x7f6d90106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.370+0000 7f6d97e00700 1 --2- 172.21.15.82:0/2286647062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d9006bf80 0x7f6d9006c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.370+0000 7f6d97e00700 1 -- 172.21.15.82:0/2286647062 >> 172.21.15.82:0/2286647062 conn(0x7f6d90079310 msgr2=0x7f6d90079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.371+0000 7f6d97e00700 1 -- 172.21.15.82:0/2286647062 shutdown_connections 2024-05-03T22:12:00.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.371+0000 7f6d97e00700 1 -- 172.21.15.82:0/2286647062 wait complete. 2024-05-03T22:12:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.372+0000 7f6d97e00700 1 Processor -- start 2024-05-03T22:12:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.372+0000 7f6d97e00700 1 -- start start 2024-05-03T22:12:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.373+0000 7f6d97e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9006bf80 0x7f6d901a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.373+0000 7f6d97e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d90105ed0 0x7f6d901a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.373+0000 7f6d97e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d901083c0 0x7f6d901a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.373+0000 7f6d97e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6d90119b20 con 0x7f6d9006bf80 2024-05-03T22:12:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.373+0000 7f6d97e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6d901199a0 con 0x7f6d901083c0 2024-05-03T22:12:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.373+0000 7f6d97e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6d90119ca0 con 0x7f6d90105ed0 2024-05-03T22:12:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.373+0000 7f6d95400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9006bf80 0x7f6d901a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.373+0000 7f6d95400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9006bf80 0x7f6d901a0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46092/0 (socket says 172.21.15.82:46092) 2024-05-03T22:12:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.373+0000 7f6d95400700 1 -- 172.21.15.82:0/1540127131 learned_addr learned my addr 172.21.15.82:0/1540127131 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:12:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.373+0000 7f6d94a00700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d90105ed0 0x7f6d901a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.373+0000 7f6d95e00700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d901083c0 0x7f6d901a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.374+0000 7f6d95400700 1 -- 172.21.15.82:0/1540127131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d90105ed0 msgr2=0x7f6d901a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.374+0000 7f6d95400700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d90105ed0 0x7f6d901a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.374+0000 7f6d95400700 1 -- 172.21.15.82:0/1540127131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d901083c0 msgr2=0x7f6d901a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.374+0000 7f6d95400700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d901083c0 0x7f6d901a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.374+0000 7f6d95400700 1 -- 172.21.15.82:0/1540127131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d901a5210 con 0x7f6d9006bf80 2024-05-03T22:12:00.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.374+0000 7f6d95400700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9006bf80 0x7f6d901a0200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6d84000c00 tx=0x7f6d840036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:00.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.374+0000 7f6d8e000700 1 -- 172.21.15.82:0/1540127131 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84027070 con 0x7f6d9006bf80 2024-05-03T22:12:00.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.374+0000 7f6d8e000700 1 -- 172.21.15.82:0/1540127131 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d8400fc80 con 0x7f6d9006bf80 2024-05-03T22:12:00.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.374+0000 7f6d8e000700 1 -- 172.21.15.82:0/1540127131 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84022d60 con 0x7f6d9006bf80 2024-05-03T22:12:00.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.374+0000 7f6d97e00700 1 -- 172.21.15.82:0/1540127131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d901a54a0 con 0x7f6d9006bf80 2024-05-03T22:12:00.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.375+0000 7f6d97e00700 1 -- 172.21.15.82:0/1540127131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d901acd80 con 0x7f6d9006bf80 2024-05-03T22:12:00.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.376+0000 7f6d97e00700 1 -- 172.21.15.82:0/1540127131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d901029b0 con 0x7f6d9006bf80 2024-05-03T22:12:00.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.378+0000 7f6d8e000700 1 -- 172.21.15.82:0/1540127131 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6d8402a070 con 0x7f6d9006bf80 2024-05-03T22:12:00.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.379+0000 7f6d8e000700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d780b2900 0x7f6d780b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:00.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.380+0000 7f6d8e000700 1 -- 172.21.15.82:0/1540127131 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f6d840e2e90 con 0x7f6d9006bf80 2024-05-03T22:12:00.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.380+0000 7f6d94a00700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d780b2900 0x7f6d780b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:00.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.380+0000 7f6d94a00700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d780b2900 0x7f6d780b4dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6d90079c10 tx=0x7f6d7c005eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:00.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.382+0000 7f6d8e000700 1 -- 172.21.15.82:0/1540127131 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6d84031080 con 0x7f6d9006bf80 2024-05-03T22:12:00.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.671+0000 7f6d97e00700 1 -- 172.21.15.82:0/1540127131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d901a1560 con 0x7f6d9006bf80 2024-05-03T22:12:00.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.672+0000 7f6d8e000700 1 -- 172.21.15.82:0/1540127131 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7180 (secure 0 0 0) 0x7f6d84013070 con 0x7f6d9006bf80 2024-05-03T22:12:00.674 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:12:00.675 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34412,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34433,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-03T22:12:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 -- 172.21.15.82:0/1540127131 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d780b2900 msgr2=0x7f6d780b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d780b2900 0x7f6d780b4dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6d90079c10 tx=0x7f6d7c005eb0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 -- 172.21.15.82:0/1540127131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9006bf80 msgr2=0x7f6d901a0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9006bf80 0x7f6d901a0200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6d84000c00 tx=0x7f6d840036f0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 -- 172.21.15.82:0/1540127131 shutdown_connections 2024-05-03T22:12:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d780b2900 0x7f6d780b4dc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9006bf80 0x7f6d901a0200 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d901083c0 0x7f6d901a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 --2- 172.21.15.82:0/1540127131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d90105ed0 0x7f6d901a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 -- 172.21.15.82:0/1540127131 >> 172.21.15.82:0/1540127131 conn(0x7f6d90079310 msgr2=0x7f6d90104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 -- 172.21.15.82:0/1540127131 shutdown_connections 2024-05-03T22:12:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:00.676+0000 7f6d97e00700 1 -- 172.21.15.82:0/1540127131 wait complete. 2024-05-03T22:12:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 9 2024-05-03T22:12:01.705 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:01 smithi130 ceph-mon[32417]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:01.705 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:01 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1540127131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:01.705 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:12:01 smithi130 systemd[1]: Starting Ceph mds.i for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:12:01.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:01 smithi116 ceph-mon[31828]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:01.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:01 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1540127131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:01 smithi082 ceph-mon[28404]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:01 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1540127131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:02.367 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:12:02 smithi130 podman[63835]: 2024-05-03 22:12:01.971816858 +0000 UTC m=+0.034128468 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:12:02.367 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:12:02 smithi130 podman[63835]: 2024-05-03 22:12:02.091490245 +0000 UTC m=+0.153801854 container create aba961ca1bdbcd5bd5d758886f69b72f4f47f94ee60a05ad9ca65a839e032cce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:12:02.367 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:12:02 smithi130 podman[63835]: 2024-05-03 22:12:02.363537521 +0000 UTC m=+0.425849177 container init aba961ca1bdbcd5bd5d758886f69b72f4f47f94ee60a05ad9ca65a839e032cce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:12:02.777 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:12:02 smithi130 podman[63835]: 2024-05-03 22:12:02.374053238 +0000 UTC m=+0.436364838 container start aba961ca1bdbcd5bd5d758886f69b72f4f47f94ee60a05ad9ca65a839e032cce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux ) 2024-05-03T22:12:02.777 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:12:02 smithi130 ceph-mds[63854]: -- 172.21.15.130:0/1496901498 <== mon.1 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a6597bda40 con 0x55a659791000 2024-05-03T22:12:02.777 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:12:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i[63850]: starting mds.i at 2024-05-03T22:12:02.777 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:12:02 smithi130 bash[63835]: aba961ca1bdbcd5bd5d758886f69b72f4f47f94ee60a05ad9ca65a839e032cce 2024-05-03T22:12:02.778 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:12:02 smithi130 systemd[1]: Started Ceph mds.i for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:12:03.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:12:03.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:03 smithi116 ceph-mon[31828]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:03.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:03 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] up:boot 2024-05-03T22:12:03.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:03 smithi116 ceph-mon[31828]: fsmap 9 up:standby 2024-05-03T22:12:03.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:03 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T22:12:03.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:03 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:03.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:03 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:03.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:03 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:03.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:03 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:12:03.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:03 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:12:03.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:03 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:03.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:03 smithi116 ceph-mon[31828]: Deploying daemon mds.g on smithi082 2024-05-03T22:12:03.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:03 smithi082 ceph-mon[28404]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:03.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:03 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] up:boot 2024-05-03T22:12:03.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:03 smithi082 ceph-mon[28404]: fsmap 9 up:standby 2024-05-03T22:12:03.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:03 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T22:12:03.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:03 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:03.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:03 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:03.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:03 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:03.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:03 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:12:03.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:03 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:12:03.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:03 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:03.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:03 smithi082 ceph-mon[28404]: Deploying daemon mds.g on smithi082 2024-05-03T22:12:04.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:03 smithi130 ceph-mon[32417]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:04.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:03 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] up:boot 2024-05-03T22:12:04.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:03 smithi130 ceph-mon[32417]: fsmap 9 up:standby 2024-05-03T22:12:04.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:03 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T22:12:04.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:03 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:04.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:03 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:04.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:03 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:04.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:03 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:12:04.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:03 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:12:04.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:03 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:04.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:03 smithi130 ceph-mon[32417]: Deploying daemon mds.g on smithi082 2024-05-03T22:12:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:12:05.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:05 smithi082 ceph-mon[28404]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:05.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:05 smithi116 ceph-mon[31828]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:06.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:05 smithi130 ceph-mon[32417]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:06.227 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:12:05 smithi082 systemd[1]: Starting Ceph mds.g for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:12:06.977 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:12:06 smithi082 podman[67654]: 2024-05-03 22:12:06.852200085 +0000 UTC m=+0.034828867 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:12:07.275 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:12:06 smithi082 podman[67654]: 2024-05-03 22:12:06.979364825 +0000 UTC m=+0.161993632 container create 5eacb023eee3d5bfdb3cda63defc13c406c8c0062844439f3436a0663c955466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430) 2024-05-03T22:12:07.784 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:07 smithi082 ceph-mon[28404]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:07.784 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:12:07 smithi082 podman[67654]: 2024-05-03 22:12:07.655273691 +0000 UTC m=+0.837902541 container init 5eacb023eee3d5bfdb3cda63defc13c406c8c0062844439f3436a0663c955466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:12:07.785 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:12:07 smithi082 podman[67654]: 2024-05-03 22:12:07.666145661 +0000 UTC m=+0.848774445 container start 5eacb023eee3d5bfdb3cda63defc13c406c8c0062844439f3436a0663c955466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-03T22:12:07.785 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:12:07 smithi082 ceph-mds[67696]: -- 172.21.15.82:0/787029790 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc1f365a40 con 0x55dc1f338800 2024-05-03T22:12:07.785 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:12:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g[67687]: starting mds.g at 2024-05-03T22:12:07.785 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:12:07 smithi082 bash[67654]: 5eacb023eee3d5bfdb3cda63defc13c406c8c0062844439f3436a0663c955466 2024-05-03T22:12:07.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:07 smithi116 ceph-mon[31828]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:08.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:07 smithi130 ceph-mon[32417]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:08.128 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:12:07 smithi082 systemd[1]: Started Ceph mds.g for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:12:08.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.168+0000 7f0fd5c00700 1 -- 172.21.15.82:0/4271831113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd010fea0 msgr2=0x7f0fd0112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:08.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.168+0000 7f0fd5c00700 1 --2- 172.21.15.82:0/4271831113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd010fea0 0x7f0fd0112290 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800b0a0 tx=0x7f0fc800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:12:08.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.168+0000 7f0fd5c00700 1 -- 172.21.15.82:0/4271831113 shutdown_connections 2024-05-03T22:12:08.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.168+0000 7f0fd5c00700 1 --2- 172.21.15.82:0/4271831113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd010fea0 0x7f0fd0112290 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:08.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.168+0000 7f0fd5c00700 1 --2- 172.21.15.82:0/4271831113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fd00756d0 0x7f0fd0075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:08.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.168+0000 7f0fd5c00700 1 --2- 172.21.15.82:0/4271831113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd0075ff0 0x7f0fd010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:08.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.168+0000 7f0fd5c00700 1 -- 172.21.15.82:0/4271831113 >> 172.21.15.82:0/4271831113 conn(0x7f0fd007a600 msgr2=0x7f0fd007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:08.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.168+0000 7f0fd5c00700 1 -- 172.21.15.82:0/4271831113 shutdown_connections 2024-05-03T22:12:08.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.168+0000 7f0fd5c00700 1 -- 172.21.15.82:0/4271831113 wait complete. 2024-05-03T22:12:08.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.169+0000 7f0fd5c00700 1 Processor -- start 2024-05-03T22:12:08.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.169+0000 7f0fd5c00700 1 -- start start 2024-05-03T22:12:08.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fd5c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd00756d0 0x7f0fd01a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:08.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fd5c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fd0075ff0 0x7f0fd01a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:08.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fd5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd010fea0 0x7f0fd019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:08.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fd5c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd0115750 con 0x7f0fd010fea0 2024-05-03T22:12:08.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fd5c00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd01155d0 con 0x7f0fd00756d0 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fd5c00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd01158d0 con 0x7f0fd0075ff0 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fcf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd010fea0 0x7f0fd019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fcf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd010fea0 0x7f0fd019baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50794/0 (socket says 172.21.15.82:50794) 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fcf400700 1 -- 172.21.15.82:0/455041359 learned_addr learned my addr 172.21.15.82:0/455041359 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fcea00700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd00756d0 0x7f0fd01a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fce000700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fd0075ff0 0x7f0fd01a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fcf400700 1 -- 172.21.15.82:0/455041359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fd0075ff0 msgr2=0x7f0fd01a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fcf400700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fd0075ff0 0x7f0fd01a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fcf400700 1 -- 172.21.15.82:0/455041359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd00756d0 msgr2=0x7f0fd01a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.170+0000 7f0fcf400700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd00756d0 0x7f0fd01a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.171+0000 7f0fcf400700 1 -- 172.21.15.82:0/455041359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd019c250 con 0x7f0fd010fea0 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.171+0000 7f0fcf400700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd010fea0 0x7f0fd019baf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800b070 tx=0x7f0fc8004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.171+0000 7f0fc7400700 1 -- 172.21.15.82:0/455041359 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8021070 con 0x7f0fd010fea0 2024-05-03T22:12:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.171+0000 7f0fc7400700 1 -- 172.21.15.82:0/455041359 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0fc8007c80 con 0x7f0fd010fea0 2024-05-03T22:12:08.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.171+0000 7f0fd5c00700 1 -- 172.21.15.82:0/455041359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd019c4e0 con 0x7f0fd010fea0 2024-05-03T22:12:08.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.171+0000 7f0fc7400700 1 -- 172.21.15.82:0/455041359 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc801d450 con 0x7f0fd010fea0 2024-05-03T22:12:08.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.172+0000 7f0fd5c00700 1 -- 172.21.15.82:0/455041359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd01a87b0 con 0x7f0fd010fea0 2024-05-03T22:12:08.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.173+0000 7f0fd5c00700 1 -- 172.21.15.82:0/455041359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd006a190 con 0x7f0fd010fea0 2024-05-03T22:12:08.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.177+0000 7f0fc7400700 1 -- 172.21.15.82:0/455041359 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0fc8004020 con 0x7f0fd010fea0 2024-05-03T22:12:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.178+0000 7f0fc7400700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fb40b2900 0x7f0fb40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.178+0000 7f0fc7400700 1 -- 172.21.15.82:0/455041359 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f0fc800f020 con 0x7f0fd010fea0 2024-05-03T22:12:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.179+0000 7f0fcea00700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fb40b2900 0x7f0fb40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.179+0000 7f0fcea00700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fb40b2900 0x7f0fb40b4dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0005950 tx=0x7f0fc0005eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:08.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.183+0000 7f0fc7400700 1 -- 172.21.15.82:0/455041359 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0fc802a020 con 0x7f0fd010fea0 2024-05-03T22:12:08.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.467+0000 7f0fd5c00700 1 -- 172.21.15.82:0/455041359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fd002e510 con 0x7f0fd010fea0 2024-05-03T22:12:08.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.468+0000 7f0fc7400700 1 -- 172.21.15.82:0/455041359 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8007 (secure 0 0 0) 0x7f0fc80ab5f0 con 0x7f0fd010fea0 2024-05-03T22:12:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:12:08.470 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34412,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34433,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-03T22:12:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.473+0000 7f0fd5c00700 1 -- 172.21.15.82:0/455041359 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fb40b2900 msgr2=0x7f0fb40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.473+0000 7f0fd5c00700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fb40b2900 0x7f0fb40b4dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0005950 tx=0x7f0fc0005eb0 comp rx=0 tx=0).stop 2024-05-03T22:12:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.473+0000 7f0fd5c00700 1 -- 172.21.15.82:0/455041359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd010fea0 msgr2=0x7f0fd019baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.473+0000 7f0fd5c00700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd010fea0 0x7f0fd019baf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800b070 tx=0x7f0fc8004e70 comp rx=0 tx=0).stop 2024-05-03T22:12:08.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.473+0000 7f0fd5c00700 1 -- 172.21.15.82:0/455041359 shutdown_connections 2024-05-03T22:12:08.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.473+0000 7f0fd5c00700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fb40b2900 0x7f0fb40b4dc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:08.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.473+0000 7f0fd5c00700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fd010fea0 0x7f0fd019baf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:08.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.473+0000 7f0fd5c00700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd00756d0 0x7f0fd01a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:08.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.473+0000 7f0fd5c00700 1 --2- 172.21.15.82:0/455041359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fd0075ff0 0x7f0fd01a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:08.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.473+0000 7f0fd5c00700 1 -- 172.21.15.82:0/455041359 >> 172.21.15.82:0/455041359 conn(0x7f0fd007a600 msgr2=0x7f0fd0101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:08.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.474+0000 7f0fd5c00700 1 -- 172.21.15.82:0/455041359 shutdown_connections 2024-05-03T22:12:08.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:08.474+0000 7f0fd5c00700 1 -- 172.21.15.82:0/455041359 wait complete. 2024-05-03T22:12:08.477 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 10 2024-05-03T22:12:09.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:09.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:09.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:09.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:12:09.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:12:09.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:09.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:08 smithi116 ceph-mon[31828]: Deploying daemon mds.a on smithi082 2024-05-03T22:12:09.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:08 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/455041359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:09.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:08 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.82:6838/4287485607,v1:172.21.15.82:6839/4287485607] up:boot 2024-05-03T22:12:09.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:08 smithi116 ceph-mon[31828]: fsmap 10 up:standby 2024-05-03T22:12:09.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T22:12:09.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:09.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:09.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:09.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:12:09.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:12:09.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:09.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:08 smithi082 ceph-mon[28404]: Deploying daemon mds.a on smithi082 2024-05-03T22:12:09.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:08 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/455041359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:09.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:08 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.82:6838/4287485607,v1:172.21.15.82:6839/4287485607] up:boot 2024-05-03T22:12:09.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:08 smithi082 ceph-mon[28404]: fsmap 10 up:standby 2024-05-03T22:12:09.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T22:12:09.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:09.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:09.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:09.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:12:09.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:12:09.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:09.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:08 smithi130 ceph-mon[32417]: Deploying daemon mds.a on smithi082 2024-05-03T22:12:09.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:08 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/455041359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:09.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:08 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.82:6838/4287485607,v1:172.21.15.82:6839/4287485607] up:boot 2024-05-03T22:12:09.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:08 smithi130 ceph-mon[32417]: fsmap 10 up:standby 2024-05-03T22:12:09.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T22:12:10.087 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:09 smithi082 ceph-mon[28404]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:10.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:09 smithi130 ceph-mon[32417]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:09 smithi116 ceph-mon[31828]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:11.428 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:12:12.146 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:11 smithi082 ceph-mon[28404]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:12.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:11 smithi130 ceph-mon[32417]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:12.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:11 smithi116 ceph-mon[31828]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:12.469 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:12:12 smithi082 podman[68055]: 2024-05-03 22:12:12.178885572 +0000 UTC m=+0.161868588 container create 2a132cfa614bc468f7216b45da35a4a4c2c5377e7a4343f7a8c76932642fec3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-03T22:12:12.469 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:12:12 smithi082 podman[68055]: 2024-05-03 22:12:12.465882766 +0000 UTC m=+0.448865789 container init 2a132cfa614bc468f7216b45da35a4a4c2c5377e7a4343f7a8c76932642fec3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD) 2024-05-03T22:12:12.608 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:12:12.726 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:12:12 smithi082 podman[68055]: 2024-05-03 22:12:12.476466313 +0000 UTC m=+0.459449306 container start 2a132cfa614bc468f7216b45da35a4a4c2c5377e7a4343f7a8c76932642fec3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:12:12.726 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:12:12 smithi082 ceph-mds[68095]: -- 172.21.15.82:0/3194598276 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5592f2399a40 con 0x5592f236cc00 2024-05-03T22:12:12.727 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:12:12 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a[68091]: starting mds.a at 2024-05-03T22:12:12.727 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:12:12 smithi082 bash[68055]: 2a132cfa614bc468f7216b45da35a4a4c2c5377e7a4343f7a8c76932642fec3c 2024-05-03T22:12:12.727 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:12:12 smithi082 systemd[1]: Started Ceph mds.a for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:12:13.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:13 smithi116 ceph-mon[31828]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:13.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:13.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:13.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:13.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:12:13.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:12:13.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:13.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:13 smithi116 ceph-mon[31828]: Deploying daemon mds.b on smithi116 2024-05-03T22:12:13.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:13 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.82:6840/1188447125,v1:172.21.15.82:6841/1188447125] up:boot 2024-05-03T22:12:13.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:13 smithi116 ceph-mon[31828]: fsmap 11 up:standby 2024-05-03T22:12:13.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T22:12:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:13 smithi082 ceph-mon[28404]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:12:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:12:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:13 smithi082 ceph-mon[28404]: Deploying daemon mds.b on smithi116 2024-05-03T22:12:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:13 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.82:6840/1188447125,v1:172.21.15.82:6841/1188447125] up:boot 2024-05-03T22:12:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:13 smithi082 ceph-mon[28404]: fsmap 11 up:standby 2024-05-03T22:12:13.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T22:12:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:13 smithi130 ceph-mon[32417]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:12:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:12:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:13 smithi130 ceph-mon[32417]: Deploying daemon mds.b on smithi116 2024-05-03T22:12:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:13 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.82:6840/1188447125,v1:172.21.15.82:6841/1188447125] up:boot 2024-05-03T22:12:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:13 smithi130 ceph-mon[32417]: fsmap 11 up:standby 2024-05-03T22:12:14.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T22:12:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.058+0000 7fa5d4200700 1 -- 172.21.15.82:0/4114535879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5cc0756d0 msgr2=0x7fa5cc075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.058+0000 7fa5d4200700 1 --2- 172.21.15.82:0/4114535879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5cc0756d0 0x7fa5cc075ab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009990 tx=0x7fa5c0009ca0 comp rx=0 tx=0).stop 2024-05-03T22:12:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.058+0000 7fa5d4200700 1 -- 172.21.15.82:0/4114535879 shutdown_connections 2024-05-03T22:12:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.058+0000 7fa5d4200700 1 --2- 172.21.15.82:0/4114535879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5cc0756d0 0x7fa5cc075ab0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.058+0000 7fa5d4200700 1 --2- 172.21.15.82:0/4114535879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5cc10ff10 0x7fa5cc112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.058+0000 7fa5d4200700 1 --2- 172.21.15.82:0/4114535879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5cc075ff0 0x7fa5cc10f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.058+0000 7fa5d4200700 1 -- 172.21.15.82:0/4114535879 >> 172.21.15.82:0/4114535879 conn(0x7fa5cc07a660 msgr2=0x7fa5cc07aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.058+0000 7fa5d4200700 1 -- 172.21.15.82:0/4114535879 shutdown_connections 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.059+0000 7fa5d4200700 1 -- 172.21.15.82:0/4114535879 wait complete. 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.060+0000 7fa5d4200700 1 Processor -- start 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.060+0000 7fa5d4200700 1 -- start start 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.060+0000 7fa5d4200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5cc0756d0 0x7fa5cc1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.060+0000 7fa5d4200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5cc075ff0 0x7fa5cc1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.060+0000 7fa5d4200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5cc10ff10 0x7fa5cc19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.060+0000 7fa5d4200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc115740 con 0x7fa5cc075ff0 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.060+0000 7fa5d4200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc1155c0 con 0x7fa5cc0756d0 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.060+0000 7fa5d4200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc1158c0 con 0x7fa5cc10ff10 2024-05-03T22:12:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.060+0000 7fa5d0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5cc075ff0 0x7fa5cc1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.061+0000 7fa5d0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5cc075ff0 0x7fa5cc1a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47222/0 (socket says 172.21.15.82:47222) 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.061+0000 7fa5d0e00700 1 -- 172.21.15.82:0/2578568274 learned_addr learned my addr 172.21.15.82:0/2578568274 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.061+0000 7fa5d1800700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5cc0756d0 0x7fa5cc1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.061+0000 7fa5d2200700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5cc10ff10 0x7fa5cc19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.061+0000 7fa5d0e00700 1 -- 172.21.15.82:0/2578568274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5cc10ff10 msgr2=0x7fa5cc19bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.061+0000 7fa5d0e00700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5cc10ff10 0x7fa5cc19bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.061+0000 7fa5d0e00700 1 -- 172.21.15.82:0/2578568274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5cc0756d0 msgr2=0x7fa5cc1a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.061+0000 7fa5d0e00700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5cc0756d0 0x7fa5cc1a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.061+0000 7fa5d0e00700 1 -- 172.21.15.82:0/2578568274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc19c260 con 0x7fa5cc075ff0 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.061+0000 7fa5d0e00700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5cc075ff0 0x7fa5cc1a1e80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800d950 tx=0x7fa5b800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.062+0000 7fa5ca000700 1 -- 172.21.15.82:0/2578568274 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8016070 con 0x7fa5cc075ff0 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.062+0000 7fa5ca000700 1 -- 172.21.15.82:0/2578568274 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa5b8010460 con 0x7fa5cc075ff0 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.062+0000 7fa5ca000700 1 -- 172.21.15.82:0/2578568274 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800f620 con 0x7fa5cc075ff0 2024-05-03T22:12:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.062+0000 7fa5d4200700 1 -- 172.21.15.82:0/2578568274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc19c550 con 0x7fa5cc075ff0 2024-05-03T22:12:15.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.062+0000 7fa5d4200700 1 -- 172.21.15.82:0/2578568274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc1a8810 con 0x7fa5cc075ff0 2024-05-03T22:12:15.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.063+0000 7fa5d4200700 1 -- 172.21.15.82:0/2578568274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5cc06a190 con 0x7fa5cc075ff0 2024-05-03T22:12:15.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.065+0000 7fa5ca000700 1 -- 172.21.15.82:0/2578568274 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa5b8019070 con 0x7fa5cc075ff0 2024-05-03T22:12:15.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.066+0000 7fa5ca000700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa5b40b2900 0x7fa5b40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:15.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.067+0000 7fa5ca000700 1 -- 172.21.15.82:0/2578568274 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fa5b80e19a0 con 0x7fa5cc075ff0 2024-05-03T22:12:15.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.067+0000 7fa5d1800700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa5b40b2900 0x7fa5b40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:15.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.067+0000 7fa5d1800700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa5b40b2900 0x7fa5b40b4dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000b5c0 tx=0x7fa5c001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:15.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.071+0000 7fa5ca000700 1 -- 172.21.15.82:0/2578568274 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa5b80a9ac0 con 0x7fa5cc075ff0 2024-05-03T22:12:15.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.355+0000 7fa5d4200700 1 -- 172.21.15.82:0/2578568274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5cc02e510 con 0x7fa5cc075ff0 2024-05-03T22:12:15.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.357+0000 7fa5ca000700 1 -- 172.21.15.82:0/2578568274 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9659 (secure 0 0 0) 0x7fa5b80a93c0 con 0x7fa5cc075ff0 2024-05-03T22:12:15.359 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:12:15.359 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34412,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34433,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-03T22:12:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 -- 172.21.15.82:0/2578568274 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa5b40b2900 msgr2=0x7fa5b40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa5b40b2900 0x7fa5b40b4dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000b5c0 tx=0x7fa5c001a040 comp rx=0 tx=0).stop 2024-05-03T22:12:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 -- 172.21.15.82:0/2578568274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5cc075ff0 msgr2=0x7fa5cc1a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5cc075ff0 0x7fa5cc1a1e80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800d950 tx=0x7fa5b800dd10 comp rx=0 tx=0).stop 2024-05-03T22:12:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 -- 172.21.15.82:0/2578568274 shutdown_connections 2024-05-03T22:12:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa5b40b2900 0x7fa5b40b4dc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:15.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5cc10ff10 0x7fa5cc19bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:15.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5cc0756d0 0x7fa5cc1a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:15.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 --2- 172.21.15.82:0/2578568274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5cc075ff0 0x7fa5cc1a1e80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:15.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 -- 172.21.15.82:0/2578568274 >> 172.21.15.82:0/2578568274 conn(0x7fa5cc07a660 msgr2=0x7fa5cc100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:15.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 -- 172.21.15.82:0/2578568274 shutdown_connections 2024-05-03T22:12:15.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:15.360+0000 7fa5d4200700 1 -- 172.21.15.82:0/2578568274 wait complete. 2024-05-03T22:12:15.366 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 12 2024-05-03T22:12:15.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:15 smithi116 ceph-mon[31828]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:15.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:15 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2578568274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:15.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:15 smithi082 ceph-mon[28404]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:15.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:15 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2578568274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:16.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:15 smithi130 ceph-mon[32417]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:16.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:15 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2578568274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:16.340 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:12:15 smithi116 systemd[1]: Starting Ceph mds.b for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:12:16.666 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:12:16 smithi116 podman[62436]: 2024-05-03 22:12:16.243285647 +0000 UTC m=+0.037219798 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:12:16.666 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:12:16 smithi116 podman[62436]: 2024-05-03 22:12:16.376702648 +0000 UTC m=+0.170636835 container create d5750506c7ddf00b77450fe058ced3f6b164c052d4408f2ddc53a77932502357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD) 2024-05-03T22:12:16.666 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:12:16 smithi116 podman[62436]: 2024-05-03 22:12:16.664427779 +0000 UTC m=+0.458361973 container init d5750506c7ddf00b77450fe058ced3f6b164c052d4408f2ddc53a77932502357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-03T22:12:16.935 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:12:16 smithi116 podman[62436]: 2024-05-03 22:12:16.673700426 +0000 UTC m=+0.467634584 container start d5750506c7ddf00b77450fe058ced3f6b164c052d4408f2ddc53a77932502357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-03T22:12:16.935 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:12:16 smithi116 ceph-mds[62455]: -- 172.21.15.116:0/2944190131 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e025e1fa40 con 0x55e025df2800 2024-05-03T22:12:16.936 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:12:16 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b[62451]: starting mds.b at 2024-05-03T22:12:16.936 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:12:16 smithi116 bash[62436]: d5750506c7ddf00b77450fe058ced3f6b164c052d4408f2ddc53a77932502357 2024-05-03T22:12:16.936 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:12:16 smithi116 systemd[1]: Started Ceph mds.b for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:12:18.148 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:17 smithi116 ceph-mon[31828]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:18.148 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.148 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.149 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.149 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.149 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.149 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:12:18.149 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:17 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] up:boot 2024-05-03T22:12:18.149 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:17 smithi116 ceph-mon[31828]: fsmap 12 up:standby 2024-05-03T22:12:18.149 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T22:12:18.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:17 smithi082 ceph-mon[28404]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:18.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:12:18.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:17 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] up:boot 2024-05-03T22:12:18.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:17 smithi082 ceph-mon[28404]: fsmap 12 up:standby 2024-05-03T22:12:18.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T22:12:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:17 smithi130 ceph-mon[32417]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:12:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:17 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] up:boot 2024-05-03T22:12:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:17 smithi130 ceph-mon[32417]: fsmap 12 up:standby 2024-05-03T22:12:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T22:12:18.311 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:12:19.238 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:12:19.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:19 smithi082 ceph-mon[28404]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:20.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:19 smithi116 ceph-mon[31828]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:20.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:19 smithi130 ceph-mon[32417]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:21.377 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:21 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.377 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:21 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.377 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:21 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.377 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:21 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:21 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.455 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:21 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.455 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:21 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.455 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:21 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:21 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:21 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:21 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:21 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:21.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.687+0000 7fc39dc00700 1 -- 172.21.15.82:0/1120160914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398103fd0 msgr2=0x7fc398108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:21.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.687+0000 7fc39dc00700 1 --2- 172.21.15.82:0/1120160914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398103fd0 0x7fc398108020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3840099c0 tx=0x7fc384009cd0 comp rx=0 tx=0).stop 2024-05-03T22:12:21.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.687+0000 7fc39dc00700 1 -- 172.21.15.82:0/1120160914 shutdown_connections 2024-05-03T22:12:21.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.687+0000 7fc39dc00700 1 --2- 172.21.15.82:0/1120160914 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc398108700 0x7fc3981102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:21.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.687+0000 7fc39dc00700 1 --2- 172.21.15.82:0/1120160914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc398103620 0x7fc398103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:21.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.687+0000 7fc39dc00700 1 --2- 172.21.15.82:0/1120160914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398103fd0 0x7fc398108020 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:21.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.687+0000 7fc39dc00700 1 -- 172.21.15.82:0/1120160914 >> 172.21.15.82:0/1120160914 conn(0x7fc3980feeb0 msgr2=0x7fc3981012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:21.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.688+0000 7fc39dc00700 1 -- 172.21.15.82:0/1120160914 shutdown_connections 2024-05-03T22:12:21.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.688+0000 7fc39dc00700 1 -- 172.21.15.82:0/1120160914 wait complete. 2024-05-03T22:12:21.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.689+0000 7fc39dc00700 1 Processor -- start 2024-05-03T22:12:21.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.690+0000 7fc39dc00700 1 -- start start 2024-05-03T22:12:21.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.690+0000 7fc39dc00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc398103620 0x7fc3980757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:21.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.690+0000 7fc39dc00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc398103fd0 0x7fc398075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:21.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.690+0000 7fc39dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398108700 0x7fc398076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:21.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.690+0000 7fc39dc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3981134f0 con 0x7fc398108700 2024-05-03T22:12:21.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.690+0000 7fc39dc00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc398113370 con 0x7fc398103fd0 2024-05-03T22:12:21.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.690+0000 7fc39dc00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc398113670 con 0x7fc398103620 2024-05-03T22:12:21.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.691+0000 7fc39d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398108700 0x7fc398076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:21.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.691+0000 7fc39d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398108700 0x7fc398076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47228/0 (socket says 172.21.15.82:47228) 2024-05-03T22:12:21.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.691+0000 7fc39d200700 1 -- 172.21.15.82:0/3387972389 learned_addr learned my addr 172.21.15.82:0/3387972389 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:12:21.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.691+0000 7fc397400700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc398103fd0 0x7fc398075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:21.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.691+0000 7fc397e00700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc398103620 0x7fc3980757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:21.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.691+0000 7fc39d200700 1 -- 172.21.15.82:0/3387972389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc398103620 msgr2=0x7fc3980757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:21.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.691+0000 7fc39d200700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc398103620 0x7fc3980757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:21.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.691+0000 7fc39d200700 1 -- 172.21.15.82:0/3387972389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc398103fd0 msgr2=0x7fc398075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:21.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.691+0000 7fc39d200700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc398103fd0 0x7fc398075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:21.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.691+0000 7fc39d200700 1 -- 172.21.15.82:0/3387972389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3981a7fb0 con 0x7fc398108700 2024-05-03T22:12:21.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.692+0000 7fc39d200700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398108700 0x7fc398076220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc39000b970 tx=0x7fc39000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:21.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.692+0000 7fc394c00700 1 -- 172.21.15.82:0/3387972389 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39000d860 con 0x7fc398108700 2024-05-03T22:12:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.692+0000 7fc39dc00700 1 -- 172.21.15.82:0/3387972389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3981a82a0 con 0x7fc398108700 2024-05-03T22:12:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.692+0000 7fc394c00700 1 -- 172.21.15.82:0/3387972389 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc39000e430 con 0x7fc398108700 2024-05-03T22:12:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.692+0000 7fc394c00700 1 -- 172.21.15.82:0/3387972389 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390017660 con 0x7fc398108700 2024-05-03T22:12:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.692+0000 7fc39dc00700 1 -- 172.21.15.82:0/3387972389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3981a87b0 con 0x7fc398108700 2024-05-03T22:12:21.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.693+0000 7fc39dc00700 1 -- 172.21.15.82:0/3387972389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc398104b00 con 0x7fc398108700 2024-05-03T22:12:21.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.697+0000 7fc394c00700 1 -- 172.21.15.82:0/3387972389 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc39000da00 con 0x7fc398108700 2024-05-03T22:12:21.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.698+0000 7fc394c00700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc37c0b2880 0x7fc37c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:21.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.698+0000 7fc394c00700 1 -- 172.21.15.82:0/3387972389 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fc3900e1b10 con 0x7fc398108700 2024-05-03T22:12:21.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.699+0000 7fc397e00700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc37c0b2880 0x7fc37c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:21.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.699+0000 7fc397e00700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc37c0b2880 0x7fc37c0b4d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc388005950 tx=0x7fc38800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:21.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.700+0000 7fc394c00700 1 -- 172.21.15.82:0/3387972389 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc390013030 con 0x7fc398108700 2024-05-03T22:12:21.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.988+0000 7fc39dc00700 1 -- 172.21.15.82:0/3387972389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc398076cd0 con 0x7fc398108700 2024-05-03T22:12:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.989+0000 7fc394c00700 1 -- 172.21.15.82:0/3387972389 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10488 (secure 0 0 0) 0x7fc3900a9cc0 con 0x7fc398108700 2024-05-03T22:12:21.991 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:12:21.991 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34412,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34433,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":34460,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/3254019270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3254019270},{"type":"v1","addr":"172.21.15.116:6839","nonce":3254019270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-03T22:12:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.992+0000 7fc39dc00700 1 -- 172.21.15.82:0/3387972389 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc37c0b2880 msgr2=0x7fc37c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.992+0000 7fc39dc00700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc37c0b2880 0x7fc37c0b4d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc388005950 tx=0x7fc38800a300 comp rx=0 tx=0).stop 2024-05-03T22:12:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.992+0000 7fc39dc00700 1 -- 172.21.15.82:0/3387972389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398108700 msgr2=0x7fc398076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.992+0000 7fc39dc00700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398108700 0x7fc398076220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc39000b970 tx=0x7fc39000bc80 comp rx=0 tx=0).stop 2024-05-03T22:12:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.992+0000 7fc39dc00700 1 -- 172.21.15.82:0/3387972389 shutdown_connections 2024-05-03T22:12:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.992+0000 7fc39dc00700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc37c0b2880 0x7fc37c0b4d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.992+0000 7fc39dc00700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc398108700 0x7fc398076220 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.992+0000 7fc39dc00700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc398103620 0x7fc3980757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.992+0000 7fc39dc00700 1 --2- 172.21.15.82:0/3387972389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc398103fd0 0x7fc398075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:21.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.992+0000 7fc39dc00700 1 -- 172.21.15.82:0/3387972389 >> 172.21.15.82:0/3387972389 conn(0x7fc3980feeb0 msgr2=0x7fc3981002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:21.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.993+0000 7fc39dc00700 1 -- 172.21.15.82:0/3387972389 shutdown_connections 2024-05-03T22:12:21.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:21.993+0000 7fc39dc00700 1 -- 172.21.15.82:0/3387972389 wait complete. 2024-05-03T22:12:21.995 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 13 2024-05-03T22:12:22.419 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:22 smithi082 ceph-mon[28404]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:22.419 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:22.419 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:22.419 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:22 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:22.419 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:22 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3387972389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:22 smithi130 ceph-mon[32417]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:22 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:22 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3387972389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:22 smithi116 ceph-mon[31828]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:22 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:22 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3387972389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:12:22.863 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-03T22:12:23.294 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:12:24.494 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:24 smithi082 ceph-mon[28404]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:24.494 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:24.494 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:12:24.494 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:24.494 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:12:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:24 smithi130 ceph-mon[32417]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:12:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:12:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:24 smithi116 ceph-mon[31828]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:12:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:12:25.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.658+0000 7f7bc6a00700 1 -- 172.21.15.82:0/990694475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc0103750 msgr2=0x7f7bc0103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:25.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.658+0000 7f7bc6a00700 1 --2- 172.21.15.82:0/990694475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc0103750 0x7f7bc0103b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00099c0 tx=0x7f7bb0009cd0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.658+0000 7f7bc6a00700 1 -- 172.21.15.82:0/990694475 shutdown_connections 2024-05-03T22:12:25.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.658+0000 7f7bc6a00700 1 --2- 172.21.15.82:0/990694475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc0103750 0x7f7bc0103b30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.658+0000 7f7bc6a00700 1 --2- 172.21.15.82:0/990694475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bc0108850 0x7f7bc01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.658+0000 7f7bc6a00700 1 --2- 172.21.15.82:0/990694475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc0104100 0x7f7bc0108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.658+0000 7f7bc6a00700 1 -- 172.21.15.82:0/990694475 >> 172.21.15.82:0/990694475 conn(0x7f7bc007a600 msgr2=0x7f7bc007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:25.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.658+0000 7f7bc6a00700 1 -- 172.21.15.82:0/990694475 shutdown_connections 2024-05-03T22:12:25.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.658+0000 7f7bc6a00700 1 -- 172.21.15.82:0/990694475 wait complete. 2024-05-03T22:12:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.660+0000 7f7bc6a00700 1 Processor -- start 2024-05-03T22:12:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.660+0000 7f7bc6a00700 1 -- start start 2024-05-03T22:12:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.660+0000 7f7bc6a00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc0103750 0x7f7bc00757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.660+0000 7f7bc6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc0104100 0x7f7bc0075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.660+0000 7f7bc6a00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bc0108850 0x7f7bc0076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.660+0000 7f7bc6a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc01134d0 con 0x7f7bc0104100 2024-05-03T22:12:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.660+0000 7f7bc6a00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc0113350 con 0x7f7bc0103750 2024-05-03T22:12:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.660+0000 7f7bc6a00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc0113650 con 0x7f7bc0108850 2024-05-03T22:12:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.661+0000 7f7bbf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc0104100 0x7f7bc0075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.661+0000 7f7bbf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc0104100 0x7f7bc0075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55242/0 (socket says 172.21.15.82:55242) 2024-05-03T22:12:25.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.661+0000 7f7bbf400700 1 -- 172.21.15.82:0/1232098961 learned_addr learned my addr 172.21.15.82:0/1232098961 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.661+0000 7f7bbfe00700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc0103750 0x7f7bc00757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.661+0000 7f7bbf400700 1 -- 172.21.15.82:0/1232098961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bc0108850 msgr2=0x7f7bc0076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.661+0000 7f7bbf400700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bc0108850 0x7f7bc0076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.661+0000 7f7bbf400700 1 -- 172.21.15.82:0/1232098961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc0103750 msgr2=0x7f7bc00757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.661+0000 7f7bbf400700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc0103750 0x7f7bc00757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.661+0000 7f7bbf400700 1 -- 172.21.15.82:0/1232098961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc01a7f70 con 0x7f7bc0104100 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.661+0000 7f7bbf400700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc0104100 0x7f7bc0075ce0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00e9a0 tx=0x7f7bac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.662+0000 7f7bbcc00700 1 -- 172.21.15.82:0/1232098961 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac00cbd0 con 0x7f7bc0104100 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.662+0000 7f7bbcc00700 1 -- 172.21.15.82:0/1232098961 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7bac00cd70 con 0x7f7bc0104100 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.662+0000 7f7bbcc00700 1 -- 172.21.15.82:0/1232098961 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac018680 con 0x7f7bc0104100 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.662+0000 7f7bc6a00700 1 -- 172.21.15.82:0/1232098961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc01a8260 con 0x7f7bc0104100 2024-05-03T22:12:25.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.662+0000 7f7bc6a00700 1 -- 172.21.15.82:0/1232098961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc01a8750 con 0x7f7bc0104100 2024-05-03T22:12:25.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.663+0000 7f7bc6a00700 1 -- 172.21.15.82:0/1232098961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc010ba90 con 0x7f7bc0104100 2024-05-03T22:12:25.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.669+0000 7f7bbcc00700 1 -- 172.21.15.82:0/1232098961 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7bac010430 con 0x7f7bc0104100 2024-05-03T22:12:25.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.671+0000 7f7bbcc00700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7ba40b2880 0x7f7ba40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:25.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.671+0000 7f7bbcc00700 1 -- 172.21.15.82:0/1232098961 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f7bac0e2330 con 0x7f7bc0104100 2024-05-03T22:12:25.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.671+0000 7f7bbfe00700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7ba40b2880 0x7f7ba40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:25.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.671+0000 7f7bbcc00700 1 -- 172.21.15.82:0/1232098961 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7bac0e2890 con 0x7f7bc0104100 2024-05-03T22:12:25.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.672+0000 7f7bbfe00700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7ba40b2880 0x7f7ba40b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0000c00 tx=0x7f7bb0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.939+0000 7f7bc6a00700 1 -- 172.21.15.82:0/1232098961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7bc002e5b0 con 0x7f7bc0104100 2024-05-03T22:12:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.940+0000 7f7bbcc00700 1 -- 172.21.15.82:0/1232098961 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7f7bac0aa4f0 con 0x7f7bc0104100 2024-05-03T22:12:25.942 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:12:25.942 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-05-03T22:12:25.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-03T22:12:25.942 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2024-05-03T22:12:25.942 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2024-05-03T22:12:25.942 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-03T22:12:25.942 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-05-03T22:12:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 -- 172.21.15.82:0/1232098961 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7ba40b2880 msgr2=0x7f7ba40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7ba40b2880 0x7f7ba40b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0000c00 tx=0x7f7bb0005fb0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 -- 172.21.15.82:0/1232098961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc0104100 msgr2=0x7f7bc0075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc0104100 0x7f7bc0075ce0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00e9a0 tx=0x7f7bac00ecb0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 -- 172.21.15.82:0/1232098961 shutdown_connections 2024-05-03T22:12:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7ba40b2880 0x7f7ba40b4d40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bc0108850 0x7f7bc0076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bc0103750 0x7f7bc00757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 --2- 172.21.15.82:0/1232098961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bc0104100 0x7f7bc0075ce0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 -- 172.21.15.82:0/1232098961 >> 172.21.15.82:0/1232098961 conn(0x7f7bc007a600 msgr2=0x7f7bc0101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:25.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 -- 172.21.15.82:0/1232098961 shutdown_connections 2024-05-03T22:12:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:25.944+0000 7f7bc6a00700 1 -- 172.21.15.82:0/1232098961 wait complete. 2024-05-03T22:12:26.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:26 smithi082 ceph-mon[28404]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:26.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:26 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:26.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:26 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:26.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:26 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1232098961' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-03T22:12:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:26 smithi116 ceph-mon[31828]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:26 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:26 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:26 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1232098961' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-03T22:12:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:26 smithi130 ceph-mon[32417]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:26 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:26 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:26 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1232098961' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-03T22:12:26.849 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-03T22:12:26.849 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-03T22:12:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:12:27.854 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:27 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:27.854 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:27 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:27.854 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:27 smithi082 ceph-mon[28404]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:27.854 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:27 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:27.854 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:27 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:27.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:27 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:27.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:27 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:27.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:27 smithi116 ceph-mon[31828]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:27.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:27 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:27.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:27 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:28.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:27 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:28.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:27 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:28.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:27 smithi130 ceph-mon[32417]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:28.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:27 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:28.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:27 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:30.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.219+0000 7f898a400700 1 -- 172.21.15.82:0/2522908890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8984108410 msgr2=0x7f89841087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:30.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.219+0000 7f898a400700 1 --2- 172.21.15.82:0/2522908890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8984108410 0x7f89841087f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8974009990 tx=0x7f8974009ca0 comp rx=0 tx=0).stop 2024-05-03T22:12:30.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.219+0000 7f898a400700 1 -- 172.21.15.82:0/2522908890 shutdown_connections 2024-05-03T22:12:30.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.219+0000 7f898a400700 1 --2- 172.21.15.82:0/2522908890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8984108410 0x7f89841087f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:30.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.219+0000 7f898a400700 1 --2- 172.21.15.82:0/2522908890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8984102d60 0x7f898410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:30.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.219+0000 7f898a400700 1 --2- 172.21.15.82:0/2522908890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89841023a0 0x7f8984102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:30.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.219+0000 7f898a400700 1 -- 172.21.15.82:0/2522908890 >> 172.21.15.82:0/2522908890 conn(0x7f8984079350 msgr2=0x7f8984079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:30.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.220+0000 7f898a400700 1 -- 172.21.15.82:0/2522908890 shutdown_connections 2024-05-03T22:12:30.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:29 smithi082 ceph-mon[28404]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:30.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.220+0000 7f898a400700 1 -- 172.21.15.82:0/2522908890 wait complete. 2024-05-03T22:12:30.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.221+0000 7f898a400700 1 Processor -- start 2024-05-03T22:12:30.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.222+0000 7f898a400700 1 -- start start 2024-05-03T22:12:30.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.222+0000 7f898a400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89841023a0 0x7f89841a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:30.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.222+0000 7f898a400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8984102d60 0x7f89841a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.222+0000 7f898a400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8984108410 0x7f89841a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.222+0000 7f898a400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8984112430 con 0x7f8984102d60 2024-05-03T22:12:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.222+0000 7f898a400700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f89841122b0 con 0x7f89841023a0 2024-05-03T22:12:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.222+0000 7f898a400700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f89841125b0 con 0x7f8984108410 2024-05-03T22:12:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8982a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8984102d60 0x7f89841a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8982a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8984102d60 0x7f89841a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55262/0 (socket says 172.21.15.82:55262) 2024-05-03T22:12:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8982a00700 1 -- 172.21.15.82:0/3023498896 learned_addr learned my addr 172.21.15.82:0/3023498896 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:12:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8983400700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89841023a0 0x7f89841a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:30.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8983e00700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8984108410 0x7f89841a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:30.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8982a00700 1 -- 172.21.15.82:0/3023498896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8984108410 msgr2=0x7f89841a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:30.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8982a00700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8984108410 0x7f89841a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:30.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8982a00700 1 -- 172.21.15.82:0/3023498896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89841023a0 msgr2=0x7f89841a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:30.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8982a00700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89841023a0 0x7f89841a02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8982a00700 1 -- 172.21.15.82:0/3023498896 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89841a4fd0 con 0x7f8984102d60 2024-05-03T22:12:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8983e00700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8984108410 0x7f89841a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:12:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.223+0000 7f8983400700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89841023a0 0x7f89841a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:12:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.224+0000 7f8982a00700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8984102d60 0x7f89841a0820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f897000c9b0 tx=0x7f897000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.224+0000 7f897be00700 1 -- 172.21.15.82:0/3023498896 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970007b00 con 0x7f8984102d60 2024-05-03T22:12:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.224+0000 7f897be00700 1 -- 172.21.15.82:0/3023498896 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8970007ca0 con 0x7f8984102d60 2024-05-03T22:12:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.224+0000 7f897be00700 1 -- 172.21.15.82:0/3023498896 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970018660 con 0x7f8984102d60 2024-05-03T22:12:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.224+0000 7f898a400700 1 -- 172.21.15.82:0/3023498896 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89841a52c0 con 0x7f8984102d60 2024-05-03T22:12:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.224+0000 7f898a400700 1 -- 172.21.15.82:0/3023498896 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89841acb40 con 0x7f8984102d60 2024-05-03T22:12:30.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.226+0000 7f898a400700 1 -- 172.21.15.82:0/3023498896 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898406a190 con 0x7f8984102d60 2024-05-03T22:12:30.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.229+0000 7f897be00700 1 -- 172.21.15.82:0/3023498896 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f897000f450 con 0x7f8984102d60 2024-05-03T22:12:30.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.230+0000 7f897be00700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f89680b2900 0x7f89680b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:30.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.231+0000 7f897be00700 1 -- 172.21.15.82:0/3023498896 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f89700e20f0 con 0x7f8984102d60 2024-05-03T22:12:30.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.231+0000 7f8983400700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f89680b2900 0x7f89680b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:30.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.232+0000 7f8983400700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f89680b2900 0x7f89680b4dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f897400b5c0 tx=0x7f897401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:30.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.234+0000 7f897be00700 1 -- 172.21.15.82:0/3023498896 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8970014030 con 0x7f8984102d60 2024-05-03T22:12:30.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:29 smithi130 ceph-mon[32417]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:30.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:29 smithi116 ceph-mon[31828]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.496+0000 7f898a400700 1 -- 172.21.15.82:0/3023498896 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f89841a12f0 con 0x7f8984102d60 2024-05-03T22:12:30.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.947+0000 7f897be00700 1 -- 172.21.15.82:0/3023498896 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7f89841a12f0 con 0x7f8984102d60 2024-05-03T22:12:30.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.952+0000 7f898a400700 1 -- 172.21.15.82:0/3023498896 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f89680b2900 msgr2=0x7f89680b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:30.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.952+0000 7f898a400700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f89680b2900 0x7f89680b4dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f897400b5c0 tx=0x7f897401a040 comp rx=0 tx=0).stop 2024-05-03T22:12:30.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.952+0000 7f898a400700 1 -- 172.21.15.82:0/3023498896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8984102d60 msgr2=0x7f89841a0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:30.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.952+0000 7f898a400700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8984102d60 0x7f89841a0820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f897000c9b0 tx=0x7f897000cd70 comp rx=0 tx=0).stop 2024-05-03T22:12:30.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.953+0000 7f898a400700 1 -- 172.21.15.82:0/3023498896 shutdown_connections 2024-05-03T22:12:30.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.953+0000 7f898a400700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f89680b2900 0x7f89680b4dc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:30.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.953+0000 7f898a400700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8984108410 0x7f89841a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:30.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.953+0000 7f898a400700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89841023a0 0x7f89841a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:30.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.953+0000 7f898a400700 1 --2- 172.21.15.82:0/3023498896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8984102d60 0x7f89841a0820 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:30.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.953+0000 7f898a400700 1 -- 172.21.15.82:0/3023498896 >> 172.21.15.82:0/3023498896 conn(0x7f8984079350 msgr2=0x7f898406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:30.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.953+0000 7f898a400700 1 -- 172.21.15.82:0/3023498896 shutdown_connections 2024-05-03T22:12:30.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:30.953+0000 7f898a400700 1 -- 172.21.15.82:0/3023498896 wait complete. 2024-05-03T22:12:30.958 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2024-05-03T22:12:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:31 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3023498896' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-03T22:12:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:12:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:31 smithi082 ceph-mon[28404]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:31 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3023498896' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-03T22:12:31.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:31 smithi082 ceph-mon[28404]: osdmap e75: 12 total, 12 up, 12 in 2024-05-03T22:12:31.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:31 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3023498896' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-03T22:12:31.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:31.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:31.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:31.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:12:31.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:31.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:31 smithi130 ceph-mon[32417]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:31.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:31 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3023498896' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-03T22:12:31.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:31 smithi130 ceph-mon[32417]: osdmap e75: 12 total, 12 up, 12 in 2024-05-03T22:12:31.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-03T22:12:31.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:31 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3023498896' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-03T22:12:31.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:31.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:31.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:12:31.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:12:31.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:12:31.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:31 smithi116 ceph-mon[31828]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:31.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:31 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3023498896' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-03T22:12:31.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:31 smithi116 ceph-mon[31828]: osdmap e75: 12 total, 12 up, 12 in 2024-05-03T22:12:32.300 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:12:32.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:32 smithi082 ceph-mon[28404]: osdmap e76: 12 total, 12 up, 12 in 2024-05-03T22:12:33.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:32 smithi130 ceph-mon[32417]: osdmap e76: 12 total, 12 up, 12 in 2024-05-03T22:12:33.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:32 smithi116 ceph-mon[31828]: osdmap e76: 12 total, 12 up, 12 in 2024-05-03T22:12:34.072 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:33 smithi082 ceph-mon[28404]: pgmap v364: 33 pgs: 6 active+clean, 15 creating+peering, 12 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:34.072 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:33 smithi082 ceph-mon[28404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:12:34.072 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:33 smithi082 ceph-mon[28404]: osdmap e77: 12 total, 12 up, 12 in 2024-05-03T22:12:34.142 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:33 smithi116 ceph-mon[31828]: pgmap v364: 33 pgs: 6 active+clean, 15 creating+peering, 12 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:34.142 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:33 smithi116 ceph-mon[31828]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:12:34.142 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:33 smithi116 ceph-mon[31828]: osdmap e77: 12 total, 12 up, 12 in 2024-05-03T22:12:34.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:33 smithi130 ceph-mon[32417]: pgmap v364: 33 pgs: 6 active+clean, 15 creating+peering, 12 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:34.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:33 smithi130 ceph-mon[32417]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:12:34.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:33 smithi130 ceph-mon[32417]: osdmap e77: 12 total, 12 up, 12 in 2024-05-03T22:12:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.668+0000 7f8b69800700 1 -- 172.21.15.82:0/338378015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b6410da00 msgr2=0x7f8b6410fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.668+0000 7f8b69800700 1 --2- 172.21.15.82:0/338378015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b6410da00 0x7f8b6410fe70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00b0a0 tx=0x7f8b5c00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:12:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.668+0000 7f8b69800700 1 -- 172.21.15.82:0/338378015 shutdown_connections 2024-05-03T22:12:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.668+0000 7f8b69800700 1 --2- 172.21.15.82:0/338378015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b6410da00 0x7f8b6410fe70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.668+0000 7f8b69800700 1 --2- 172.21.15.82:0/338378015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b641045d0 0x7f8b641049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.668+0000 7f8b69800700 1 --2- 172.21.15.82:0/338378015 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b64104ef0 0x7f8b6410d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.668+0000 7f8b69800700 1 -- 172.21.15.82:0/338378015 >> 172.21.15.82:0/338378015 conn(0x7f8b640fddc0 msgr2=0x7f8b641001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.668+0000 7f8b69800700 1 -- 172.21.15.82:0/338378015 shutdown_connections 2024-05-03T22:12:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.668+0000 7f8b69800700 1 -- 172.21.15.82:0/338378015 wait complete. 2024-05-03T22:12:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.669+0000 7f8b69800700 1 Processor -- start 2024-05-03T22:12:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.669+0000 7f8b69800700 1 -- start start 2024-05-03T22:12:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.669+0000 7f8b69800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b641045d0 0x7f8b641a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.669+0000 7f8b69800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b64104ef0 0x7f8b641a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.669+0000 7f8b69800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b6410da00 0x7f8b6419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.669+0000 7f8b69800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641134c0 con 0x7f8b641045d0 2024-05-03T22:12:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.669+0000 7f8b69800700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64113340 con 0x7f8b64104ef0 2024-05-03T22:12:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.669+0000 7f8b69800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64113640 con 0x7f8b6410da00 2024-05-03T22:12:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.670+0000 7f8b63e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b641045d0 0x7f8b641a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.670+0000 7f8b63e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b641045d0 0x7f8b641a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54606/0 (socket says 172.21.15.82:54606) 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.670+0000 7f8b63e00700 1 -- 172.21.15.82:0/3680166260 learned_addr learned my addr 172.21.15.82:0/3680166260 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.670+0000 7f8b68e00700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b6410da00 0x7f8b6419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.670+0000 7f8b63400700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b64104ef0 0x7f8b641a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.670+0000 7f8b63e00700 1 -- 172.21.15.82:0/3680166260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b6410da00 msgr2=0x7f8b6419ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.670+0000 7f8b63e00700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b6410da00 0x7f8b6419ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.670+0000 7f8b63e00700 1 -- 172.21.15.82:0/3680166260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b64104ef0 msgr2=0x7f8b641a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.670+0000 7f8b63e00700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b64104ef0 0x7f8b641a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.670+0000 7f8b63e00700 1 -- 172.21.15.82:0/3680166260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6419c180 con 0x7f8b641045d0 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.670+0000 7f8b68e00700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b6410da00 0x7f8b6419ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.671+0000 7f8b63e00700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b641045d0 0x7f8b641a1860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400c970 tx=0x7f8b5400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.671+0000 7f8b60c00700 1 -- 172.21.15.82:0/3680166260 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54007aa0 con 0x7f8b641045d0 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.671+0000 7f8b60c00700 1 -- 172.21.15.82:0/3680166260 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b54004cc0 con 0x7f8b641045d0 2024-05-03T22:12:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.671+0000 7f8b69800700 1 -- 172.21.15.82:0/3680166260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6419c470 con 0x7f8b641045d0 2024-05-03T22:12:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.671+0000 7f8b60c00700 1 -- 172.21.15.82:0/3680166260 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54005500 con 0x7f8b641045d0 2024-05-03T22:12:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.671+0000 7f8b69800700 1 -- 172.21.15.82:0/3680166260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b641a8730 con 0x7f8b641045d0 2024-05-03T22:12:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.673+0000 7f8b69800700 1 -- 172.21.15.82:0/3680166260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b6406a190 con 0x7f8b641045d0 2024-05-03T22:12:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.675+0000 7f8b60c00700 1 -- 172.21.15.82:0/3680166260 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8b54007c40 con 0x7f8b641045d0 2024-05-03T22:12:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.677+0000 7f8b60c00700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8b480b2880 0x7f8b480b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.677+0000 7f8b60c00700 1 -- 172.21.15.82:0/3680166260 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7f8b540e1e10 con 0x7f8b641045d0 2024-05-03T22:12:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.677+0000 7f8b63400700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8b480b2880 0x7f8b480b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.677+0000 7f8b63400700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8b480b2880 0x7f8b480b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b50005950 tx=0x7f8b500058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:34.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.687+0000 7f8b60c00700 1 -- 172.21.15.82:0/3680166260 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8b540e5030 con 0x7f8b641045d0 2024-05-03T22:12:34.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.923+0000 7f8b69800700 1 -- 172.21.15.82:0/3680166260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f8b6419cf50 con 0x7f8b641045d0 2024-05-03T22:12:34.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.968+0000 7f8b60c00700 1 -- 172.21.15.82:0/3680166260 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v78) ==== 171+0+0 (secure 0 0 0) 0x7f8b540a9e50 con 0x7f8b641045d0 2024-05-03T22:12:34.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.971+0000 7f8b69800700 1 -- 172.21.15.82:0/3680166260 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8b480b2880 msgr2=0x7f8b480b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:34.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.971+0000 7f8b69800700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8b480b2880 0x7f8b480b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b50005950 tx=0x7f8b500058e0 comp rx=0 tx=0).stop 2024-05-03T22:12:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.971+0000 7f8b69800700 1 -- 172.21.15.82:0/3680166260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b641045d0 msgr2=0x7f8b641a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.971+0000 7f8b69800700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b641045d0 0x7f8b641a1860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400c970 tx=0x7f8b5400cd30 comp rx=0 tx=0).stop 2024-05-03T22:12:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.972+0000 7f8b69800700 1 -- 172.21.15.82:0/3680166260 shutdown_connections 2024-05-03T22:12:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.972+0000 7f8b69800700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8b480b2880 0x7f8b480b4d40 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b50005950 tx=0x7f8b500058e0 comp rx=0 tx=0).stop 2024-05-03T22:12:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.972+0000 7f8b69800700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b641045d0 0x7f8b641a1860 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.972+0000 7f8b69800700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b6410da00 0x7f8b6419ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.972+0000 7f8b69800700 1 --2- 172.21.15.82:0/3680166260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b64104ef0 0x7f8b641a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.972+0000 7f8b69800700 1 -- 172.21.15.82:0/3680166260 >> 172.21.15.82:0/3680166260 conn(0x7f8b640fddc0 msgr2=0x7f8b640fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:34.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.972+0000 7f8b69800700 1 -- 172.21.15.82:0/3680166260 shutdown_connections 2024-05-03T22:12:34.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:34.972+0000 7f8b69800700 1 -- 172.21.15.82:0/3680166260 wait complete. 2024-05-03T22:12:34.978 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2024-05-03T22:12:35.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:34 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3680166260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-03T22:12:35.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:34 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3680166260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-03T22:12:35.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:34 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3680166260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-03T22:12:36.038 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-03T22:12:36.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:35 smithi082 ceph-mon[28404]: pgmap v366: 33 pgs: 10 active+clean, 15 creating+peering, 8 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:36.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:35 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3680166260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-03T22:12:36.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:35 smithi082 ceph-mon[28404]: osdmap e78: 12 total, 12 up, 12 in 2024-05-03T22:12:36.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:35 smithi130 ceph-mon[32417]: pgmap v366: 33 pgs: 10 active+clean, 15 creating+peering, 8 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:36.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:35 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3680166260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-03T22:12:36.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:35 smithi130 ceph-mon[32417]: osdmap e78: 12 total, 12 up, 12 in 2024-05-03T22:12:36.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:35 smithi116 ceph-mon[31828]: pgmap v366: 33 pgs: 10 active+clean, 15 creating+peering, 8 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:36.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:35 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3680166260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-03T22:12:36.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:35 smithi116 ceph-mon[31828]: osdmap e78: 12 total, 12 up, 12 in 2024-05-03T22:12:36.446 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:12:37.160 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:36 smithi082 ceph-mon[28404]: osdmap e79: 12 total, 12 up, 12 in 2024-05-03T22:12:37.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:36 smithi130 ceph-mon[32417]: osdmap e79: 12 total, 12 up, 12 in 2024-05-03T22:12:37.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:36 smithi116 ceph-mon[31828]: osdmap e79: 12 total, 12 up, 12 in 2024-05-03T22:12:38.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:38 smithi130 ceph-mon[32417]: pgmap v369: 97 pgs: 43 active+clean, 15 creating+peering, 39 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:38.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:38 smithi130 ceph-mon[32417]: osdmap e80: 12 total, 12 up, 12 in 2024-05-03T22:12:38.403 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:38 smithi082 ceph-mon[28404]: pgmap v369: 97 pgs: 43 active+clean, 15 creating+peering, 39 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:38.403 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:38 smithi082 ceph-mon[28404]: osdmap e80: 12 total, 12 up, 12 in 2024-05-03T22:12:38.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:38 smithi116 ceph-mon[31828]: pgmap v369: 97 pgs: 43 active+clean, 15 creating+peering, 39 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:38.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:38 smithi116 ceph-mon[31828]: osdmap e80: 12 total, 12 up, 12 in 2024-05-03T22:12:38.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.963+0000 7f1530e00700 1 -- 172.21.15.82:0/1836522650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f152c109ad0 msgr2=0x7f152c109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:38.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.963+0000 7f1530e00700 1 --2- 172.21.15.82:0/1836522650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f152c109ad0 0x7f152c109f50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1518009990 tx=0x7f1518009ca0 comp rx=0 tx=0).stop 2024-05-03T22:12:38.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.964+0000 7f1530e00700 1 -- 172.21.15.82:0/1836522650 shutdown_connections 2024-05-03T22:12:38.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.964+0000 7f1530e00700 1 --2- 172.21.15.82:0/1836522650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f152c10a490 0x7f152c1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:38.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.964+0000 7f1530e00700 1 --2- 172.21.15.82:0/1836522650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f152c10fb60 0x7f152c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.964+0000 7f1530e00700 1 --2- 172.21.15.82:0/1836522650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f152c109ad0 0x7f152c109f50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.964+0000 7f1530e00700 1 -- 172.21.15.82:0/1836522650 >> 172.21.15.82:0/1836522650 conn(0x7f152c076c70 msgr2=0x7f152c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.964+0000 7f1530e00700 1 -- 172.21.15.82:0/1836522650 shutdown_connections 2024-05-03T22:12:38.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.964+0000 7f1530e00700 1 -- 172.21.15.82:0/1836522650 wait complete. 2024-05-03T22:12:38.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.965+0000 7f1530e00700 1 Processor -- start 2024-05-03T22:12:38.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.965+0000 7f1530e00700 1 -- start start 2024-05-03T22:12:38.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.965+0000 7f1530e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f152c109ad0 0x7f152c1a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:38.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.965+0000 7f1530e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f152c10a490 0x7f152c1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.965+0000 7f1530e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f152c10fb60 0x7f152c1a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.965+0000 7f1530e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f152c119c00 con 0x7f152c10fb60 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.965+0000 7f1530e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f152c119a80 con 0x7f152c10a490 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.965+0000 7f1530e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f152c119d80 con 0x7f152c109ad0 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.966+0000 7f152a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f152c10fb60 0x7f152c1a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.966+0000 7f152a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f152c10fb60 0x7f152c1a4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54630/0 (socket says 172.21.15.82:54630) 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.966+0000 7f152a800700 1 -- 172.21.15.82:0/2334474613 learned_addr learned my addr 172.21.15.82:0/2334474613 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.966+0000 7f1529400700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f152c10a490 0x7f152c1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.966+0000 7f1529e00700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f152c109ad0 0x7f152c1a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.966+0000 7f152a800700 1 -- 172.21.15.82:0/2334474613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f152c109ad0 msgr2=0x7f152c1a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.966+0000 7f152a800700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f152c109ad0 0x7f152c1a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:38.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.966+0000 7f152a800700 1 -- 172.21.15.82:0/2334474613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f152c10a490 msgr2=0x7f152c1a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:38.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.966+0000 7f152a800700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f152c10a490 0x7f152c1a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:38.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.966+0000 7f152a800700 1 -- 172.21.15.82:0/2334474613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152c1a5140 con 0x7f152c10fb60 2024-05-03T22:12:38.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.967+0000 7f152a800700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f152c10fb60 0x7f152c1a4a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1524007d70 tx=0x7f152400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:38.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.967+0000 7f1522a00700 1 -- 172.21.15.82:0/2334474613 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1524016020 con 0x7f152c10fb60 2024-05-03T22:12:38.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.967+0000 7f1522a00700 1 -- 172.21.15.82:0/2334474613 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f152400ad40 con 0x7f152c10fb60 2024-05-03T22:12:38.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.967+0000 7f1530e00700 1 -- 172.21.15.82:0/2334474613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152c1a5430 con 0x7f152c10fb60 2024-05-03T22:12:38.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.967+0000 7f1522a00700 1 -- 172.21.15.82:0/2334474613 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15240115e0 con 0x7f152c10fb60 2024-05-03T22:12:38.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.967+0000 7f1530e00700 1 -- 172.21.15.82:0/2334474613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f152c1accb0 con 0x7f152c10fb60 2024-05-03T22:12:38.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.968+0000 7f1530e00700 1 -- 172.21.15.82:0/2334474613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f152c112060 con 0x7f152c10fb60 2024-05-03T22:12:38.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.971+0000 7f1522a00700 1 -- 172.21.15.82:0/2334474613 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1524019020 con 0x7f152c10fb60 2024-05-03T22:12:38.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.972+0000 7f1522a00700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15100b2880 0x7f15100b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:38.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.972+0000 7f1522a00700 1 -- 172.21.15.82:0/2334474613 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f15240e25a0 con 0x7f152c10fb60 2024-05-03T22:12:38.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.972+0000 7f1529e00700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15100b2880 0x7f15100b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:38.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.973+0000 7f1529e00700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15100b2880 0x7f15100b4d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f151c005fd0 tx=0x7f151c005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:38.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:38.975+0000 7f1522a00700 1 -- 172.21.15.82:0/2334474613 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1524020020 con 0x7f152c10fb60 2024-05-03T22:12:39.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:39 smithi082 ceph-mon[28404]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:12:39.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:39.268+0000 7f1530e00700 1 -- 172.21.15.82:0/2334474613 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f152c111a40 con 0x7f152c10fb60 2024-05-03T22:12:39.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:39 smithi130 ceph-mon[32417]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:12:39.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:39 smithi116 ceph-mon[31828]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:12:40.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.035+0000 7f1522a00700 1 -- 172.21.15.82:0/2334474613 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f1524055e20 con 0x7f152c10fb60 2024-05-03T22:12:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.040+0000 7f1530e00700 1 -- 172.21.15.82:0/2334474613 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15100b2880 msgr2=0x7f15100b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.040+0000 7f1530e00700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15100b2880 0x7f15100b4d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f151c005fd0 tx=0x7f151c005d90 comp rx=0 tx=0).stop 2024-05-03T22:12:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.040+0000 7f1530e00700 1 -- 172.21.15.82:0/2334474613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f152c10fb60 msgr2=0x7f152c1a4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.040+0000 7f1530e00700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f152c10fb60 0x7f152c1a4a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1524007d70 tx=0x7f152400a340 comp rx=0 tx=0).stop 2024-05-03T22:12:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.041+0000 7f1530e00700 1 -- 172.21.15.82:0/2334474613 shutdown_connections 2024-05-03T22:12:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.041+0000 7f1530e00700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15100b2880 0x7f15100b4d40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.041+0000 7f1530e00700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f152c10fb60 0x7f152c1a4a00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.041+0000 7f1530e00700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f152c109ad0 0x7f152c1a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.041+0000 7f1530e00700 1 --2- 172.21.15.82:0/2334474613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f152c10a490 0x7f152c1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.041+0000 7f1530e00700 1 -- 172.21.15.82:0/2334474613 >> 172.21.15.82:0/2334474613 conn(0x7f152c076c70 msgr2=0x7f152c077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:40.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.041+0000 7f1530e00700 1 -- 172.21.15.82:0/2334474613 shutdown_connections 2024-05-03T22:12:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:40.041+0000 7f1530e00700 1 -- 172.21.15.82:0/2334474613 wait complete. 2024-05-03T22:12:40.043 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 2 and data pool 3 2024-05-03T22:12:40.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:40 smithi130 ceph-mon[32417]: pgmap v371: 97 pgs: 73 active+clean, 9 creating+peering, 15 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:40.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:40 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2334474613' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-03T22:12:40.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:40 smithi130 ceph-mon[32417]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-03T22:12:40.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:40 smithi116 ceph-mon[31828]: pgmap v371: 97 pgs: 73 active+clean, 9 creating+peering, 15 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:40.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:40 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2334474613' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-03T22:12:40.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:40 smithi116 ceph-mon[31828]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-03T22:12:40.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:40 smithi082 ceph-mon[28404]: pgmap v371: 97 pgs: 73 active+clean, 9 creating+peering, 15 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:40.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:40 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2334474613' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-03T22:12:40.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:40 smithi082 ceph-mon[28404]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-03T22:12:41.084 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-03T22:12:41.085 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-03T22:12:41.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:41 smithi130 ceph-mon[32417]: osdmap e81: 12 total, 12 up, 12 in 2024-05-03T22:12:41.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:41 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2334474613' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-03T22:12:41.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:41 smithi130 ceph-mon[32417]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-03T22:12:41.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:41 smithi130 ceph-mon[32417]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-03T22:12:41.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:41 smithi116 ceph-mon[31828]: osdmap e81: 12 total, 12 up, 12 in 2024-05-03T22:12:41.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:41 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2334474613' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-03T22:12:41.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:41 smithi116 ceph-mon[31828]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-03T22:12:41.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:41 smithi116 ceph-mon[31828]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-03T22:12:41.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:41 smithi082 ceph-mon[28404]: osdmap e81: 12 total, 12 up, 12 in 2024-05-03T22:12:41.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:41 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2334474613' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-03T22:12:41.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:41 smithi082 ceph-mon[28404]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-03T22:12:41.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:41 smithi082 ceph-mon[28404]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-03T22:12:41.517 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:12:42.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:42 smithi082 ceph-mon[28404]: pgmap v373: 97 pgs: 97 active+clean; 578 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 910 B/s wr, 1 op/s 2024-05-03T22:12:42.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:42 smithi082 ceph-mon[28404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-03T22:12:42.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:42 smithi082 ceph-mon[28404]: Cluster is now healthy 2024-05-03T22:12:42.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:42 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] up:active 2024-05-03T22:12:42.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:42 smithi082 ceph-mon[28404]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:12:42.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:42 smithi082 ceph-mon[28404]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:12:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:42 smithi116 ceph-mon[31828]: pgmap v373: 97 pgs: 97 active+clean; 578 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 910 B/s wr, 1 op/s 2024-05-03T22:12:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:42 smithi116 ceph-mon[31828]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-03T22:12:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:42 smithi116 ceph-mon[31828]: Cluster is now healthy 2024-05-03T22:12:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:42 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] up:active 2024-05-03T22:12:42.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:42 smithi116 ceph-mon[31828]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:12:42.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:42 smithi116 ceph-mon[31828]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:12:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:42 smithi130 ceph-mon[32417]: pgmap v373: 97 pgs: 97 active+clean; 578 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 910 B/s wr, 1 op/s 2024-05-03T22:12:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:42 smithi130 ceph-mon[32417]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-03T22:12:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:42 smithi130 ceph-mon[32417]: Cluster is now healthy 2024-05-03T22:12:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:42 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] up:active 2024-05-03T22:12:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:42 smithi130 ceph-mon[32417]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:12:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:42 smithi130 ceph-mon[32417]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:12:43.185 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:12:42 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b[62451]: 2024-05-03T22:12:42.724+0000 7f4291a00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-03T22:12:44.083 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:44 smithi082 ceph-mon[28404]: pgmap v374: 97 pgs: 97 active+clean; 578 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-05-03T22:12:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.105+0000 7fbed2800700 1 -- 172.21.15.82:0/1482561540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc109540 msgr2=0x7fbecc109920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.105+0000 7fbed2800700 1 --2- 172.21.15.82:0/1482561540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc109540 0x7fbecc109920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0099c0 tx=0x7fbebc009cd0 comp rx=0 tx=0).stop 2024-05-03T22:12:44.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.105+0000 7fbed2800700 1 -- 172.21.15.82:0/1482561540 shutdown_connections 2024-05-03T22:12:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.105+0000 7fbed2800700 1 --2- 172.21.15.82:0/1482561540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc109540 0x7fbecc109920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.105+0000 7fbed2800700 1 --2- 172.21.15.82:0/1482561540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbecc103f20 0x7fbecc110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.105+0000 7fbed2800700 1 --2- 172.21.15.82:0/1482561540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc103560 0x7fbecc1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.105+0000 7fbed2800700 1 -- 172.21.15.82:0/1482561540 >> 172.21.15.82:0/1482561540 conn(0x7fbecc07a660 msgr2=0x7fbecc07aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.105+0000 7fbed2800700 1 -- 172.21.15.82:0/1482561540 shutdown_connections 2024-05-03T22:12:44.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.105+0000 7fbed2800700 1 -- 172.21.15.82:0/1482561540 wait complete. 2024-05-03T22:12:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.106+0000 7fbed2800700 1 Processor -- start 2024-05-03T22:12:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.107+0000 7fbed2800700 1 -- start start 2024-05-03T22:12:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.107+0000 7fbed2800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc103560 0x7fbecc0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.107+0000 7fbed2800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc103f20 0x7fbecc075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.107+0000 7fbed2800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbecc109540 0x7fbecc076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.107+0000 7fbed2800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc113500 con 0x7fbecc103560 2024-05-03T22:12:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.107+0000 7fbed2800700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc113380 con 0x7fbecc109540 2024-05-03T22:12:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.107+0000 7fbed2800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc113680 con 0x7fbecc103f20 2024-05-03T22:12:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.107+0000 7fbecb400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc103560 0x7fbecc0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.107+0000 7fbecb400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc103560 0x7fbecc0757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57104/0 (socket says 172.21.15.82:57104) 2024-05-03T22:12:44.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.107+0000 7fbecb400700 1 -- 172.21.15.82:0/2966512067 learned_addr learned my addr 172.21.15.82:0/2966512067 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:12:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbecaa00700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc103f20 0x7fbecc075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:44.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbecbe00700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbecc109540 0x7fbecc076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbecb400700 1 -- 172.21.15.82:0/2966512067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc103f20 msgr2=0x7fbecc075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbecb400700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc103f20 0x7fbecc075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbecb400700 1 -- 172.21.15.82:0/2966512067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbecc109540 msgr2=0x7fbecc076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbecb400700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbecc109540 0x7fbecc076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbecb400700 1 -- 172.21.15.82:0/2966512067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc1a7f10 con 0x7fbecc103560 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbecbe00700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbecc109540 0x7fbecc076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbecb400700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc103560 0x7fbecc0757a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbebc000c00 tx=0x7fbebc00f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbec3e00700 1 -- 172.21.15.82:0/2966512067 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00f940 con 0x7fbecc103560 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbec3e00700 1 -- 172.21.15.82:0/2966512067 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbebc004830 con 0x7fbecc103560 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbed2800700 1 -- 172.21.15.82:0/2966512067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbecc1a81a0 con 0x7fbecc103560 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.108+0000 7fbec3e00700 1 -- 172.21.15.82:0/2966512067 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0054b0 con 0x7fbecc103560 2024-05-03T22:12:44.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.109+0000 7fbed2800700 1 -- 172.21.15.82:0/2966512067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbecc1a85f0 con 0x7fbecc103560 2024-05-03T22:12:44.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.110+0000 7fbed2800700 1 -- 172.21.15.82:0/2966512067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbecc10b9d0 con 0x7fbecc103560 2024-05-03T22:12:44.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.112+0000 7fbec3e00700 1 -- 172.21.15.82:0/2966512067 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fbebc029060 con 0x7fbecc103560 2024-05-03T22:12:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.113+0000 7fbec3e00700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fbeb00b2900 0x7fbeb00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.113+0000 7fbec3e00700 1 -- 172.21.15.82:0/2966512067 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fbebc0e2c70 con 0x7fbecc103560 2024-05-03T22:12:44.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.114+0000 7fbecaa00700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fbeb00b2900 0x7fbeb00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:44.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.114+0000 7fbecaa00700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fbeb00b2900 0x7fbeb00b4dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8005950 tx=0x7fbeb80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:44.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.118+0000 7fbec3e00700 1 -- 172.21.15.82:0/2966512067 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fbebc013070 con 0x7fbecc103560 2024-05-03T22:12:44.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:44.364+0000 7fbed2800700 1 -- 172.21.15.82:0/2966512067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fbecc02e510 con 0x7fbecc103560 2024-05-03T22:12:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:44 smithi116 ceph-mon[31828]: pgmap v374: 97 pgs: 97 active+clean; 578 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-05-03T22:12:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:44 smithi130 ceph-mon[32417]: pgmap v374: 97 pgs: 97 active+clean; 578 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-05-03T22:12:45.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.045+0000 7fbec3e00700 1 -- 172.21.15.82:0/2966512067 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v82) ==== 157+0+0 (secure 0 0 0) 0x7fbebc0aaad0 con 0x7fbecc103560 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.050+0000 7fbed2800700 1 -- 172.21.15.82:0/2966512067 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fbeb00b2900 msgr2=0x7fbeb00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.050+0000 7fbed2800700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fbeb00b2900 0x7fbeb00b4dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8005950 tx=0x7fbeb80058e0 comp rx=0 tx=0).stop 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.051+0000 7fbed2800700 1 -- 172.21.15.82:0/2966512067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc103560 msgr2=0x7fbecc0757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.051+0000 7fbed2800700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc103560 0x7fbecc0757a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbebc000c00 tx=0x7fbebc00f510 comp rx=0 tx=0).stop 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.051+0000 7fbed2800700 1 -- 172.21.15.82:0/2966512067 shutdown_connections 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.051+0000 7fbed2800700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fbeb00b2900 0x7fbeb00b4dc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.051+0000 7fbed2800700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbecc103560 0x7fbecc0757a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.051+0000 7fbed2800700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbecc109540 0x7fbecc076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.051+0000 7fbed2800700 1 --2- 172.21.15.82:0/2966512067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbecc103f20 0x7fbecc075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.051+0000 7fbed2800700 1 -- 172.21.15.82:0/2966512067 >> 172.21.15.82:0/2966512067 conn(0x7fbecc07a660 msgr2=0x7fbecc1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.051+0000 7fbed2800700 1 -- 172.21.15.82:0/2966512067 shutdown_connections 2024-05-03T22:12:45.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:45.051+0000 7fbed2800700 1 -- 172.21.15.82:0/2966512067 wait complete. 2024-05-03T22:12:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:45 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2966512067' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-03T22:12:45.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:45 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2966512067' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-03T22:12:45.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:45 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2966512067' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-03T22:12:46.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-03T22:12:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:46 smithi116 ceph-mon[31828]: pgmap v375: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:12:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:46 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2966512067' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-03T22:12:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:46 smithi116 ceph-mon[31828]: osdmap e82: 12 total, 12 up, 12 in 2024-05-03T22:12:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:46 smithi082 ceph-mon[28404]: pgmap v375: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:12:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:46 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2966512067' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-03T22:12:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:46 smithi082 ceph-mon[28404]: osdmap e82: 12 total, 12 up, 12 in 2024-05-03T22:12:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:46 smithi130 ceph-mon[32417]: pgmap v375: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:12:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:46 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2966512067' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-03T22:12:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:46 smithi130 ceph-mon[32417]: osdmap e82: 12 total, 12 up, 12 in 2024-05-03T22:12:46.628 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:12:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:48 smithi116 ceph-mon[31828]: pgmap v377: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:12:48.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:48 smithi082 ceph-mon[28404]: pgmap v377: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:12:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:48 smithi130 ceph-mon[32417]: pgmap v377: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:12:49.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.071+0000 7fe25ba00700 1 -- 172.21.15.82:0/824875164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2540756d0 msgr2=0x7fe254075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:49.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.071+0000 7fe25ba00700 1 --2- 172.21.15.82:0/824875164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2540756d0 0x7fe254075ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe248009990 tx=0x7fe248009ca0 comp rx=0 tx=0).stop 2024-05-03T22:12:49.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.071+0000 7fe25ba00700 1 -- 172.21.15.82:0/824875164 shutdown_connections 2024-05-03T22:12:49.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.071+0000 7fe25ba00700 1 --2- 172.21.15.82:0/824875164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2540756d0 0x7fe254075ab0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:49.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.071+0000 7fe25ba00700 1 --2- 172.21.15.82:0/824875164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25410ff00 0x7fe2541122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:49.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.071+0000 7fe25ba00700 1 --2- 172.21.15.82:0/824875164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe254075ff0 0x7fe25410f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:49.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.071+0000 7fe25ba00700 1 -- 172.21.15.82:0/824875164 >> 172.21.15.82:0/824875164 conn(0x7fe25407a570 msgr2=0x7fe25407a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:49.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.071+0000 7fe25ba00700 1 -- 172.21.15.82:0/824875164 shutdown_connections 2024-05-03T22:12:49.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.071+0000 7fe25ba00700 1 -- 172.21.15.82:0/824875164 wait complete. 2024-05-03T22:12:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.072+0000 7fe25ba00700 1 Processor -- start 2024-05-03T22:12:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.072+0000 7fe25ba00700 1 -- start start 2024-05-03T22:12:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.073+0000 7fe25ba00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2540756d0 0x7fe2541a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.073+0000 7fe25ba00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe254075ff0 0x7fe2541a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.073+0000 7fe25ba00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25410ff00 0x7fe25419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.073+0000 7fe25ba00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541157d0 con 0x7fe254075ff0 2024-05-03T22:12:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.073+0000 7fe25ba00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe254115650 con 0x7fe2540756d0 2024-05-03T22:12:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.073+0000 7fe25ba00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe254115950 con 0x7fe25410ff00 2024-05-03T22:12:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.073+0000 7fe253e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe254075ff0 0x7fe2541a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.073+0000 7fe253e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe254075ff0 0x7fe2541a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57114/0 (socket says 172.21.15.82:57114) 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.073+0000 7fe253e00700 1 -- 172.21.15.82:0/1044592660 learned_addr learned my addr 172.21.15.82:0/1044592660 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.073+0000 7fe259000700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2540756d0 0x7fe2541a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.073+0000 7fe259a00700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25410ff00 0x7fe25419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.074+0000 7fe253e00700 1 -- 172.21.15.82:0/1044592660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25410ff00 msgr2=0x7fe25419baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.074+0000 7fe253e00700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25410ff00 0x7fe25419baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.074+0000 7fe253e00700 1 -- 172.21.15.82:0/1044592660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2540756d0 msgr2=0x7fe2541a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.074+0000 7fe253e00700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2540756d0 0x7fe2541a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.074+0000 7fe253e00700 1 -- 172.21.15.82:0/1044592660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25419c250 con 0x7fe254075ff0 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.074+0000 7fe253e00700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe254075ff0 0x7fe2541a1e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe24000c920 tx=0x7fe24000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.074+0000 7fe251600700 1 -- 172.21.15.82:0/1044592660 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240007b00 con 0x7fe254075ff0 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.074+0000 7fe251600700 1 -- 172.21.15.82:0/1044592660 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe240004cc0 con 0x7fe254075ff0 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.074+0000 7fe25ba00700 1 -- 172.21.15.82:0/1044592660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25419c540 con 0x7fe254075ff0 2024-05-03T22:12:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.074+0000 7fe251600700 1 -- 172.21.15.82:0/1044592660 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2400054f0 con 0x7fe254075ff0 2024-05-03T22:12:49.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.074+0000 7fe25ba00700 1 -- 172.21.15.82:0/1044592660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2541a87b0 con 0x7fe254075ff0 2024-05-03T22:12:49.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.076+0000 7fe25ba00700 1 -- 172.21.15.82:0/1044592660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2540519e0 con 0x7fe254075ff0 2024-05-03T22:12:49.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.078+0000 7fe251600700 1 -- 172.21.15.82:0/1044592660 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe240007ca0 con 0x7fe254075ff0 2024-05-03T22:12:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.079+0000 7fe251600700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe23c0b29b0 0x7fe23c0b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.079+0000 7fe251600700 1 -- 172.21.15.82:0/1044592660 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8277+0+0 (secure 0 0 0) 0x7fe2400e1e70 con 0x7fe254075ff0 2024-05-03T22:12:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.080+0000 7fe259000700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe23c0b29b0 0x7fe23c0b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.080+0000 7fe259000700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe23c0b29b0 0x7fe23c0b4e70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe24800b5c0 tx=0x7fe24801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.084+0000 7fe251600700 1 -- 172.21.15.82:0/1044592660 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe240014030 con 0x7fe254075ff0 2024-05-03T22:12:49.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:49.321+0000 7fe25ba00700 1 -- 172.21.15.82:0/1044592660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe25402e510 con 0x7fe254075ff0 2024-05-03T22:12:50.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:50 smithi116 ceph-mon[31828]: pgmap v378: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-03T22:12:50.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:50 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1044592660' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-03T22:12:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:50 smithi082 ceph-mon[28404]: pgmap v378: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-03T22:12:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:50 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1044592660' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-03T22:12:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:50 smithi130 ceph-mon[32417]: pgmap v378: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-03T22:12:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:50 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1044592660' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-03T22:12:51.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.087+0000 7fe251600700 1 -- 172.21.15.82:0/1044592660 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v84) ==== 228+0+0 (secure 0 0 0) 0x7fe2400a9b00 con 0x7fe254075ff0 2024-05-03T22:12:51.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.091+0000 7fe25ba00700 1 -- 172.21.15.82:0/1044592660 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe23c0b29b0 msgr2=0x7fe23c0b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:51.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.091+0000 7fe25ba00700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe23c0b29b0 0x7fe23c0b4e70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe24800b5c0 tx=0x7fe24801a040 comp rx=0 tx=0).stop 2024-05-03T22:12:51.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.091+0000 7fe25ba00700 1 -- 172.21.15.82:0/1044592660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe254075ff0 msgr2=0x7fe2541a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:51.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.091+0000 7fe25ba00700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe254075ff0 0x7fe2541a1e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe24000c920 tx=0x7fe24000cce0 comp rx=0 tx=0).stop 2024-05-03T22:12:51.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.092+0000 7fe25ba00700 1 -- 172.21.15.82:0/1044592660 shutdown_connections 2024-05-03T22:12:51.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.092+0000 7fe25ba00700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe23c0b29b0 0x7fe23c0b4e70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:51.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.092+0000 7fe25ba00700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe25410ff00 0x7fe25419baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:51.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.092+0000 7fe25ba00700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2540756d0 0x7fe2541a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:51.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.092+0000 7fe25ba00700 1 --2- 172.21.15.82:0/1044592660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe254075ff0 0x7fe2541a1e20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:51.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.092+0000 7fe25ba00700 1 -- 172.21.15.82:0/1044592660 >> 172.21.15.82:0/1044592660 conn(0x7fe25407a570 msgr2=0x7fe254100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:51.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.092+0000 7fe25ba00700 1 -- 172.21.15.82:0/1044592660 shutdown_connections 2024-05-03T22:12:51.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:51.092+0000 7fe25ba00700 1 -- 172.21.15.82:0/1044592660 wait complete. 2024-05-03T22:12:51.096 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data_ec' created 2024-05-03T22:12:51.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:51 smithi116 ceph-mon[31828]: osdmap e83: 12 total, 12 up, 12 in 2024-05-03T22:12:51.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:51 smithi082 ceph-mon[28404]: osdmap e83: 12 total, 12 up, 12 in 2024-05-03T22:12:51.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:51 smithi130 ceph-mon[32417]: osdmap e83: 12 total, 12 up, 12 in 2024-05-03T22:12:52.238 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-03T22:12:52.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:52 smithi116 ceph-mon[31828]: pgmap v380: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T22:12:52.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:52 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1044592660' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-03T22:12:52.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:52 smithi116 ceph-mon[31828]: osdmap e84: 12 total, 12 up, 12 in 2024-05-03T22:12:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:52 smithi082 ceph-mon[28404]: pgmap v380: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T22:12:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:52 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1044592660' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-03T22:12:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:52 smithi082 ceph-mon[28404]: osdmap e84: 12 total, 12 up, 12 in 2024-05-03T22:12:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:52 smithi130 ceph-mon[32417]: pgmap v380: 97 pgs: 97 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-03T22:12:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:52 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1044592660' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-03T22:12:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:52 smithi130 ceph-mon[32417]: osdmap e84: 12 total, 12 up, 12 in 2024-05-03T22:12:52.652 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:12:53.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:53 smithi082 ceph-mon[28404]: osdmap e85: 12 total, 12 up, 12 in 2024-05-03T22:12:53.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:53 smithi116 ceph-mon[31828]: osdmap e85: 12 total, 12 up, 12 in 2024-05-03T22:12:53.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:53 smithi130 ceph-mon[32417]: osdmap e85: 12 total, 12 up, 12 in 2024-05-03T22:12:54.429 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:54 smithi130 ceph-mon[32417]: pgmap v383: 129 pgs: 18 creating+peering, 12 unknown, 99 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:54.429 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:54 smithi130 ceph-mon[32417]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:12:54.429 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:54 smithi130 ceph-mon[32417]: osdmap e86: 12 total, 12 up, 12 in 2024-05-03T22:12:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:54 smithi116 ceph-mon[31828]: pgmap v383: 129 pgs: 18 creating+peering, 12 unknown, 99 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:54 smithi116 ceph-mon[31828]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:12:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:54 smithi116 ceph-mon[31828]: osdmap e86: 12 total, 12 up, 12 in 2024-05-03T22:12:54.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:54 smithi082 ceph-mon[28404]: pgmap v383: 129 pgs: 18 creating+peering, 12 unknown, 99 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:54.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:54 smithi082 ceph-mon[28404]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:12:54.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:54 smithi082 ceph-mon[28404]: osdmap e86: 12 total, 12 up, 12 in 2024-05-03T22:12:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.172+0000 7f6239000700 1 -- 172.21.15.82:0/3127716807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62341055c0 msgr2=0x7f6234105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.172+0000 7f6239000700 1 --2- 172.21.15.82:0/3127716807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62341055c0 0x7f6234105a40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f62200099c0 tx=0x7f6220009cd0 comp rx=0 tx=0).stop 2024-05-03T22:12:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.173+0000 7f6239000700 1 -- 172.21.15.82:0/3127716807 shutdown_connections 2024-05-03T22:12:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.173+0000 7f6239000700 1 --2- 172.21.15.82:0/3127716807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6234105f80 0x7f6234112440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.173+0000 7f6239000700 1 --2- 172.21.15.82:0/3127716807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f623410b670 0x7f623410ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.173+0000 7f6239000700 1 --2- 172.21.15.82:0/3127716807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62341055c0 0x7f6234105a40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.173+0000 7f6239000700 1 -- 172.21.15.82:0/3127716807 >> 172.21.15.82:0/3127716807 conn(0x7f62341010d0 msgr2=0x7f62341034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.173+0000 7f6239000700 1 -- 172.21.15.82:0/3127716807 shutdown_connections 2024-05-03T22:12:55.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.173+0000 7f6239000700 1 -- 172.21.15.82:0/3127716807 wait complete. 2024-05-03T22:12:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.174+0000 7f6239000700 1 Processor -- start 2024-05-03T22:12:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.174+0000 7f6239000700 1 -- start start 2024-05-03T22:12:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.174+0000 7f6239000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62341055c0 0x7f62341a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.174+0000 7f6239000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6234105f80 0x7f62341a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.174+0000 7f6239000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f623410b670 0x7f623419b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.174+0000 7f6239000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6234115620 con 0x7f62341055c0 2024-05-03T22:12:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.174+0000 7f6239000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f62341154a0 con 0x7f6234105f80 2024-05-03T22:12:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.174+0000 7f6239000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f62341157a0 con 0x7f623410b670 2024-05-03T22:12:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.175+0000 7f6233400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62341055c0 0x7f62341a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.175+0000 7f6233400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62341055c0 0x7f62341a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41206/0 (socket says 172.21.15.82:41206) 2024-05-03T22:12:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.175+0000 7f6233400700 1 -- 172.21.15.82:0/856455793 learned_addr learned my addr 172.21.15.82:0/856455793 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:12:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.175+0000 7f6233e00700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f623410b670 0x7f623419b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.175+0000 7f6232a00700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6234105f80 0x7f62341a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.175+0000 7f6233400700 1 -- 172.21.15.82:0/856455793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f623410b670 msgr2=0x7f623419b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.175+0000 7f6233400700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f623410b670 0x7f623419b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.175+0000 7f6233400700 1 -- 172.21.15.82:0/856455793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6234105f80 msgr2=0x7f62341a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.175+0000 7f6233400700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6234105f80 0x7f62341a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.175+0000 7f6233400700 1 -- 172.21.15.82:0/856455793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623419c0a0 con 0x7f62341055c0 2024-05-03T22:12:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.175+0000 7f6232a00700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6234105f80 0x7f62341a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:12:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.176+0000 7f6233400700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62341055c0 0x7f62341a1730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f622400c920 tx=0x7f622400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.176+0000 7f622be00700 1 -- 172.21.15.82:0/856455793 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6224007b00 con 0x7f62341055c0 2024-05-03T22:12:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.176+0000 7f622be00700 1 -- 172.21.15.82:0/856455793 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6224004cc0 con 0x7f62341055c0 2024-05-03T22:12:55.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.176+0000 7f622be00700 1 -- 172.21.15.82:0/856455793 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62240054f0 con 0x7f62341055c0 2024-05-03T22:12:55.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.176+0000 7f6239000700 1 -- 172.21.15.82:0/856455793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623419c390 con 0x7f62341055c0 2024-05-03T22:12:55.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.176+0000 7f6239000700 1 -- 172.21.15.82:0/856455793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62341a8600 con 0x7f62341055c0 2024-05-03T22:12:55.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.177+0000 7f6239000700 1 -- 172.21.15.82:0/856455793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f623406a190 con 0x7f62341055c0 2024-05-03T22:12:55.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.181+0000 7f622be00700 1 -- 172.21.15.82:0/856455793 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6224007ca0 con 0x7f62341055c0 2024-05-03T22:12:55.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.183+0000 7f622be00700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f62180b2900 0x7f62180b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:12:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.183+0000 7f622be00700 1 -- 172.21.15.82:0/856455793 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8770+0+0 (secure 0 0 0) 0x7f62240e2440 con 0x7f62341055c0 2024-05-03T22:12:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.183+0000 7f6232a00700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f62180b2900 0x7f62180b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:12:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.184+0000 7f6232a00700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f62180b2900 0x7f62180b4dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f62200058e0 tx=0x7f622001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:12:55.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.186+0000 7f622be00700 1 -- 172.21.15.82:0/856455793 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6224014030 con 0x7f62341055c0 2024-05-03T22:12:55.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:55.415+0000 7f6239000700 1 -- 172.21.15.82:0/856455793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f623402e510 con 0x7f62341055c0 2024-05-03T22:12:56.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.136+0000 7f622be00700 1 -- 172.21.15.82:0/856455793 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v87) ==== 169+0+0 (secure 0 0 0) 0x7f62240a9f60 con 0x7f62341055c0 2024-05-03T22:12:56.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 -- 172.21.15.82:0/856455793 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f62180b2900 msgr2=0x7f62180b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:56.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f62180b2900 0x7f62180b4dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f62200058e0 tx=0x7f622001a040 comp rx=0 tx=0).stop 2024-05-03T22:12:56.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 -- 172.21.15.82:0/856455793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62341055c0 msgr2=0x7f62341a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:12:56.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62341055c0 0x7f62341a1730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f622400c920 tx=0x7f622400cce0 comp rx=0 tx=0).stop 2024-05-03T22:12:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 -- 172.21.15.82:0/856455793 shutdown_connections 2024-05-03T22:12:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f62180b2900 0x7f62180b4dc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62341055c0 0x7f62341a1730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f623410b670 0x7f623419b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 --2- 172.21.15.82:0/856455793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6234105f80 0x7f62341a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:12:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 -- 172.21.15.82:0/856455793 >> 172.21.15.82:0/856455793 conn(0x7f62341010d0 msgr2=0x7f62341028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:12:56.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 -- 172.21.15.82:0/856455793 shutdown_connections 2024-05-03T22:12:56.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:12:56.142+0000 7f6239000700 1 -- 172.21.15.82:0/856455793 wait complete. 2024-05-03T22:12:56.146 INFO:teuthology.orchestra.run.smithi082.stderr:set pool 4 allow_ec_overwrites to true 2024-05-03T22:12:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:56 smithi116 ceph-mon[31828]: pgmap v385: 129 pgs: 18 creating+peering, 4 unknown, 107 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:56 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/856455793' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-03T22:12:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:56 smithi082 ceph-mon[28404]: pgmap v385: 129 pgs: 18 creating+peering, 4 unknown, 107 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:56 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/856455793' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-03T22:12:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:56 smithi130 ceph-mon[32417]: pgmap v385: 129 pgs: 18 creating+peering, 4 unknown, 107 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:56 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/856455793' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-03T22:12:57.223 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-03T22:12:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:57 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/856455793' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-03T22:12:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:57 smithi116 ceph-mon[31828]: osdmap e87: 12 total, 12 up, 12 in 2024-05-03T22:12:57.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:57 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/856455793' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-03T22:12:57.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:57 smithi082 ceph-mon[28404]: osdmap e87: 12 total, 12 up, 12 in 2024-05-03T22:12:57.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:57 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/856455793' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-03T22:12:57.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:57 smithi130 ceph-mon[32417]: osdmap e87: 12 total, 12 up, 12 in 2024-05-03T22:12:57.683 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:12:58.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:12:58 smithi116 ceph-mon[31828]: pgmap v387: 129 pgs: 11 creating+peering, 118 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:58.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:12:58 smithi082 ceph-mon[28404]: pgmap v387: 129 pgs: 11 creating+peering, 118 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:12:58.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:12:58 smithi130 ceph-mon[32417]: pgmap v387: 129 pgs: 11 creating+peering, 118 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:00.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:00 smithi082 ceph-mon[28404]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.313+0000 7ffb7ca00700 1 -- 172.21.15.82:0/1901374531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb78105f90 msgr2=0x7ffb781124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.313+0000 7ffb7ca00700 1 --2- 172.21.15.82:0/1901374531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb78105f90 0x7ffb781124a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000b0a0 tx=0x7ffb7000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:13:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.313+0000 7ffb7ca00700 1 -- 172.21.15.82:0/1901374531 shutdown_connections 2024-05-03T22:13:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.313+0000 7ffb7ca00700 1 --2- 172.21.15.82:0/1901374531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb78105f90 0x7ffb781124a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.313+0000 7ffb7ca00700 1 --2- 172.21.15.82:0/1901374531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7810b660 0x7ffb7810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.313+0000 7ffb7ca00700 1 --2- 172.21.15.82:0/1901374531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb781055d0 0x7ffb78105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:00.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.313+0000 7ffb7ca00700 1 -- 172.21.15.82:0/1901374531 >> 172.21.15.82:0/1901374531 conn(0x7ffb781010c0 msgr2=0x7ffb781034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.314+0000 7ffb7ca00700 1 -- 172.21.15.82:0/1901374531 shutdown_connections 2024-05-03T22:13:00.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.314+0000 7ffb7ca00700 1 -- 172.21.15.82:0/1901374531 wait complete. 2024-05-03T22:13:00.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.315+0000 7ffb7ca00700 1 Processor -- start 2024-05-03T22:13:00.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.315+0000 7ffb7ca00700 1 -- start start 2024-05-03T22:13:00.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb7ca00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb781055d0 0x7ffb781a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb7ca00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb78105f90 0x7ffb781a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb7ca00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7810b660 0x7ffb7819b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb7ca00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb78115680 con 0x7ffb781055d0 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb7ca00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ffb78115500 con 0x7ffb78105f90 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb7ca00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffb78115800 con 0x7ffb7810b660 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb76800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb781055d0 0x7ffb781a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb76800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb781055d0 0x7ffb781a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41220/0 (socket says 172.21.15.82:41220) 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb76800700 1 -- 172.21.15.82:0/3813083485 learned_addr learned my addr 172.21.15.82:0/3813083485 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb6fe00700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb78105f90 0x7ffb781a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb77200700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7810b660 0x7ffb7819b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb76800700 1 -- 172.21.15.82:0/3813083485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7810b660 msgr2=0x7ffb7819b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb76800700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7810b660 0x7ffb7819b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:00.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb76800700 1 -- 172.21.15.82:0/3813083485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb78105f90 msgr2=0x7ffb781a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:00.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb76800700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb78105f90 0x7ffb781a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:00.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb76800700 1 -- 172.21.15.82:0/3813083485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7819c060 con 0x7ffb781055d0 2024-05-03T22:13:00.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.316+0000 7ffb6fe00700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb78105f90 0x7ffb781a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:13:00.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.317+0000 7ffb76800700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb781055d0 0x7ffb781a16b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800d980 tx=0x7ffb6800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:00.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.317+0000 7ffb6f400700 1 -- 172.21.15.82:0/3813083485 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb68017070 con 0x7ffb781055d0 2024-05-03T22:13:00.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.317+0000 7ffb6f400700 1 -- 172.21.15.82:0/3813083485 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb68010460 con 0x7ffb781055d0 2024-05-03T22:13:00.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.317+0000 7ffb6f400700 1 -- 172.21.15.82:0/3813083485 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800de60 con 0x7ffb781055d0 2024-05-03T22:13:00.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.317+0000 7ffb7ca00700 1 -- 172.21.15.82:0/3813083485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7819c2f0 con 0x7ffb781055d0 2024-05-03T22:13:00.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.317+0000 7ffb7ca00700 1 -- 172.21.15.82:0/3813083485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb781a8510 con 0x7ffb781055d0 2024-05-03T22:13:00.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.318+0000 7ffb7ca00700 1 -- 172.21.15.82:0/3813083485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb78106d10 con 0x7ffb781055d0 2024-05-03T22:13:00.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.321+0000 7ffb6f400700 1 -- 172.21.15.82:0/3813083485 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ffb680108c0 con 0x7ffb781055d0 2024-05-03T22:13:00.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.322+0000 7ffb6f400700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb5c0b2900 0x7ffb5c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:00.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.322+0000 7ffb6f400700 1 -- 172.21.15.82:0/3813083485 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8770+0+0 (secure 0 0 0) 0x7ffb680e1fe0 con 0x7ffb781055d0 2024-05-03T22:13:00.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.322+0000 7ffb6fe00700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb5c0b2900 0x7ffb5c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:00.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.323+0000 7ffb6fe00700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb5c0b2900 0x7ffb5c0b4dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffb60005fd0 tx=0x7ffb60005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:00.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.325+0000 7ffb6f400700 1 -- 172.21.15.82:0/3813083485 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ffb680a9b00 con 0x7ffb781055d0 2024-05-03T22:13:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:00 smithi116 ceph-mon[31828]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:00 smithi130 ceph-mon[32417]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:00.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:00.608+0000 7ffb7ca00700 1 -- 172.21.15.82:0/3813083485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7ffb7802e510 con 0x7ffb781055d0 2024-05-03T22:13:01.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.190+0000 7ffb6f400700 1 -- 172.21.15.82:0/3813083485 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7ffb680a9400 con 0x7ffb781055d0 2024-05-03T22:13:01.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 -- 172.21.15.82:0/3813083485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb5c0b2900 msgr2=0x7ffb5c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb5c0b2900 0x7ffb5c0b4dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffb60005fd0 tx=0x7ffb60005e20 comp rx=0 tx=0).stop 2024-05-03T22:13:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 -- 172.21.15.82:0/3813083485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb781055d0 msgr2=0x7ffb781a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb781055d0 0x7ffb781a16b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800d980 tx=0x7ffb6800dd40 comp rx=0 tx=0).stop 2024-05-03T22:13:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 -- 172.21.15.82:0/3813083485 shutdown_connections 2024-05-03T22:13:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb5c0b2900 0x7ffb5c0b4dc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb781055d0 0x7ffb781a16b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7810b660 0x7ffb7819b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 --2- 172.21.15.82:0/3813083485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb78105f90 0x7ffb781a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 -- 172.21.15.82:0/3813083485 >> 172.21.15.82:0/3813083485 conn(0x7ffb781010c0 msgr2=0x7ffb78102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:01.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 -- 172.21.15.82:0/3813083485 shutdown_connections 2024-05-03T22:13:01.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:01.194+0000 7ffb7ca00700 1 -- 172.21.15.82:0/3813083485 wait complete. 2024-05-03T22:13:01.197 INFO:teuthology.orchestra.run.smithi082.stderr:added data pool 4 to fsmap 2024-05-03T22:13:01.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:01 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3813083485' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-03T22:13:01.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:01 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3813083485' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-03T22:13:01.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:01 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3813083485' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-03T22:13:02.267 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:13:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:02 smithi116 ceph-mon[31828]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:02 smithi116 ceph-mon[31828]: osdmap e88: 12 total, 12 up, 12 in 2024-05-03T22:13:02.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:02 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3813083485' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-03T22:13:02.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:02 smithi116 ceph-mon[31828]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:13:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:02 smithi082 ceph-mon[28404]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:02 smithi082 ceph-mon[28404]: osdmap e88: 12 total, 12 up, 12 in 2024-05-03T22:13:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:02 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3813083485' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-03T22:13:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:02 smithi082 ceph-mon[28404]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:13:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:02 smithi130 ceph-mon[32417]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:02 smithi130 ceph-mon[32417]: osdmap e88: 12 total, 12 up, 12 in 2024-05-03T22:13:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:02 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3813083485' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-03T22:13:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:02 smithi130 ceph-mon[32417]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:13:02.721 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:03.408 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:03 smithi082 ceph-mon[28404]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-03T22:13:03.408 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:03 smithi082 ceph-mon[28404]: Cluster is now healthy 2024-05-03T22:13:03.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:03 smithi130 ceph-mon[32417]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-03T22:13:03.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:03 smithi130 ceph-mon[32417]: Cluster is now healthy 2024-05-03T22:13:03.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:03 smithi116 ceph-mon[31828]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-03T22:13:03.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:03 smithi116 ceph-mon[31828]: Cluster is now healthy 2024-05-03T22:13:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:04 smithi130 ceph-mon[32417]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:04.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:04 smithi082 ceph-mon[28404]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:04.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:04 smithi116 ceph-mon[31828]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.171+0000 7f17a3c00700 1 -- 172.21.15.82:0/2775096978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179c114670 msgr2=0x7f179c116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.171+0000 7f17a3c00700 1 --2- 172.21.15.82:0/2775096978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179c114670 0x7f179c116a60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f179400b0a0 tx=0x7f179400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:13:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.171+0000 7f17a3c00700 1 -- 172.21.15.82:0/2775096978 shutdown_connections 2024-05-03T22:13:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.171+0000 7f17a3c00700 1 --2- 172.21.15.82:0/2775096978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179c114670 0x7f179c116a60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.171+0000 7f17a3c00700 1 --2- 172.21.15.82:0/2775096978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f179c0756d0 0x7f179c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.172+0000 7f17a3c00700 1 --2- 172.21.15.82:0/2775096978 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179c075ff0 0x7f179c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:05.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.172+0000 7f17a3c00700 1 -- 172.21.15.82:0/2775096978 >> 172.21.15.82:0/2775096978 conn(0x7f179c07a650 msgr2=0x7f179c07aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.172+0000 7f17a3c00700 1 -- 172.21.15.82:0/2775096978 shutdown_connections 2024-05-03T22:13:05.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.172+0000 7f17a3c00700 1 -- 172.21.15.82:0/2775096978 wait complete. 2024-05-03T22:13:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.173+0000 7f17a3c00700 1 Processor -- start 2024-05-03T22:13:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.173+0000 7f17a3c00700 1 -- start start 2024-05-03T22:13:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.173+0000 7f17a3c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179c0756d0 0x7f179c1a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.173+0000 7f17a3c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179c075ff0 0x7f179c1a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.173+0000 7f17a3c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f179c114670 0x7f179c1a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:05.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a3c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f179c119b20 con 0x7f179c0756d0 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a3c00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f179c1199a0 con 0x7f179c114670 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a3c00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f179c119ca0 con 0x7f179c075ff0 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a1200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179c0756d0 0x7f179c1a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a1200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179c0756d0 0x7f179c1a0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50648/0 (socket says 172.21.15.82:50648) 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a1200700 1 -- 172.21.15.82:0/3448168385 learned_addr learned my addr 172.21.15.82:0/3448168385 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a1c00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f179c114670 0x7f179c1a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f179be00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179c075ff0 0x7f179c1a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a1200700 1 -- 172.21.15.82:0/3448168385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179c075ff0 msgr2=0x7f179c1a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a1200700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179c075ff0 0x7f179c1a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a1200700 1 -- 172.21.15.82:0/3448168385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f179c114670 msgr2=0x7f179c1a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a1200700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f179c114670 0x7f179c1a4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a1200700 1 -- 172.21.15.82:0/3448168385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179c1a5040 con 0x7f179c0756d0 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f17a1c00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f179c114670 0x7f179c1a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:13:05.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.174+0000 7f179be00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179c075ff0 0x7f179c1a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:13:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.175+0000 7f17a1200700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179c0756d0 0x7f179c1a0030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f179000c920 tx=0x7f179000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.175+0000 7f1799600700 1 -- 172.21.15.82:0/3448168385 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1790007b00 con 0x7f179c0756d0 2024-05-03T22:13:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.175+0000 7f1799600700 1 -- 172.21.15.82:0/3448168385 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1790004cc0 con 0x7f179c0756d0 2024-05-03T22:13:05.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.175+0000 7f1799600700 1 -- 172.21.15.82:0/3448168385 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17900054f0 con 0x7f179c0756d0 2024-05-03T22:13:05.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.175+0000 7f17a3c00700 1 -- 172.21.15.82:0/3448168385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f179c1a52d0 con 0x7f179c0756d0 2024-05-03T22:13:05.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.175+0000 7f17a3c00700 1 -- 172.21.15.82:0/3448168385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f179c1acbb0 con 0x7f179c0756d0 2024-05-03T22:13:05.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.176+0000 7f17a3c00700 1 -- 172.21.15.82:0/3448168385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f179c06a190 con 0x7f179c0756d0 2024-05-03T22:13:05.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.178+0000 7f1799600700 1 -- 172.21.15.82:0/3448168385 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1790007ca0 con 0x7f179c0756d0 2024-05-03T22:13:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.180+0000 7f1799600700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f17840b2900 0x7f17840b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.180+0000 7f1799600700 1 -- 172.21.15.82:0/3448168385 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f17900e2450 con 0x7f179c0756d0 2024-05-03T22:13:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.180+0000 7f179be00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f17840b2900 0x7f17840b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.181+0000 7f179be00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f17840b2900 0x7f17840b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1788005fd0 tx=0x7f1788005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:05.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.183+0000 7f1799600700 1 -- 172.21.15.82:0/3448168385 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1790014030 con 0x7f179c0756d0 2024-05-03T22:13:05.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.464+0000 7f17a3c00700 1 -- 172.21.15.82:0/3448168385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f179c1a1390 con 0x7f179c0756d0 2024-05-03T22:13:05.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.466+0000 7f1799600700 1 -- 172.21.15.82:0/3448168385 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11806 (secure 0 0 0) 0x7f17900a9f50 con 0x7f179c0756d0 2024-05-03T22:13:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:13:05.469 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34412,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34433,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-03T22:12:39.270198+0000","modified":"2024-05-03T22:13:00.610689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34460":{"gid":34460,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6839/3254019270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3254019270},{"type":"v1","addr":"172.21.15.116:6839","nonce":3254019270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34460,"qdb_cluster":[34460]},"id":1}]} 2024-05-03T22:13:05.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.470+0000 7f17a3c00700 1 -- 172.21.15.82:0/3448168385 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f17840b2900 msgr2=0x7f17840b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:05.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.470+0000 7f17a3c00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f17840b2900 0x7f17840b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1788005fd0 tx=0x7f1788005d40 comp rx=0 tx=0).stop 2024-05-03T22:13:05.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.470+0000 7f17a3c00700 1 -- 172.21.15.82:0/3448168385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179c0756d0 msgr2=0x7f179c1a0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:05.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.470+0000 7f17a3c00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179c0756d0 0x7f179c1a0030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f179000c920 tx=0x7f179000cce0 comp rx=0 tx=0).stop 2024-05-03T22:13:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.471+0000 7f17a3c00700 1 -- 172.21.15.82:0/3448168385 shutdown_connections 2024-05-03T22:13:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.471+0000 7f17a3c00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f17840b2900 0x7f17840b4dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.471+0000 7f17a3c00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f179c0756d0 0x7f179c1a0030 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.471+0000 7f17a3c00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f179c114670 0x7f179c1a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.471+0000 7f17a3c00700 1 --2- 172.21.15.82:0/3448168385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179c075ff0 0x7f179c1a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.471+0000 7f17a3c00700 1 -- 172.21.15.82:0/3448168385 >> 172.21.15.82:0/3448168385 conn(0x7f179c07a650 msgr2=0x7f179c110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.471+0000 7f17a3c00700 1 -- 172.21.15.82:0/3448168385 shutdown_connections 2024-05-03T22:13:05.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:05.471+0000 7f17a3c00700 1 -- 172.21.15.82:0/3448168385 wait complete. 2024-05-03T22:13:05.474 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-05-03T22:13:06.475 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:13:06.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:06 smithi130 ceph-mon[32417]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:06.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:06 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3448168385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:13:06.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:06 smithi082 ceph-mon[28404]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:06.552 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:06 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3448168385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:13:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:06 smithi116 ceph-mon[31828]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:06 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3448168385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:13:06.934 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:08 smithi082 ceph-mon[28404]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:08.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:08 smithi130 ceph-mon[32417]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:08 smithi116 ceph-mon[31828]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.452+0000 7fec9b200700 1 -- 172.21.15.82:0/2859970103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9410fb60 msgr2=0x7fec9410ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.452+0000 7fec9b200700 1 --2- 172.21.15.82:0/2859970103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9410fb60 0x7fec9410ff40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fec84009990 tx=0x7fec84009ca0 comp rx=0 tx=0).stop 2024-05-03T22:13:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.452+0000 7fec9b200700 1 -- 172.21.15.82:0/2859970103 shutdown_connections 2024-05-03T22:13:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.452+0000 7fec9b200700 1 --2- 172.21.15.82:0/2859970103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9410fb60 0x7fec9410ff40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.452+0000 7fec9b200700 1 --2- 172.21.15.82:0/2859970103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec9410a490 0x7fec941169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.452+0000 7fec9b200700 1 --2- 172.21.15.82:0/2859970103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec94109ad0 0x7fec94109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.452+0000 7fec9b200700 1 -- 172.21.15.82:0/2859970103 >> 172.21.15.82:0/2859970103 conn(0x7fec94076c70 msgr2=0x7fec94079090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.452+0000 7fec9b200700 1 -- 172.21.15.82:0/2859970103 shutdown_connections 2024-05-03T22:13:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.452+0000 7fec9b200700 1 -- 172.21.15.82:0/2859970103 wait complete. 2024-05-03T22:13:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.453+0000 7fec9b200700 1 Processor -- start 2024-05-03T22:13:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.454+0000 7fec9b200700 1 -- start start 2024-05-03T22:13:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.454+0000 7fec9b200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec94109ad0 0x7fec941a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.454+0000 7fec9b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9410a490 0x7fec941a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.454+0000 7fec9b200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec9410fb60 0x7fec941a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.454+0000 7fec9b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec94119b80 con 0x7fec9410a490 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.454+0000 7fec9b200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fec94119a00 con 0x7fec94109ad0 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.454+0000 7fec9b200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fec94119d00 con 0x7fec9410fb60 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.454+0000 7fec93400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9410a490 0x7fec941a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.454+0000 7fec93400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9410a490 0x7fec941a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50672/0 (socket says 172.21.15.82:50672) 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.454+0000 7fec93400700 1 -- 172.21.15.82:0/3331234713 learned_addr learned my addr 172.21.15.82:0/3331234713 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec93e00700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec94109ad0 0x7fec941a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec99200700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec9410fb60 0x7fec941a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec93400700 1 -- 172.21.15.82:0/3331234713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec9410fb60 msgr2=0x7fec941a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec93400700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec9410fb60 0x7fec941a4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec93400700 1 -- 172.21.15.82:0/3331234713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec94109ad0 msgr2=0x7fec941a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec93400700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec94109ad0 0x7fec941a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec93400700 1 -- 172.21.15.82:0/3331234713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec941a50c0 con 0x7fec9410a490 2024-05-03T22:13:09.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec93400700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9410a490 0x7fec941a05f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fec8000e9c0 tx=0x7fec8000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:09.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec90c00700 1 -- 172.21.15.82:0/3331234713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8000cbd0 con 0x7fec9410a490 2024-05-03T22:13:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec90c00700 1 -- 172.21.15.82:0/3331234713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec8000cd70 con 0x7fec9410a490 2024-05-03T22:13:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec90c00700 1 -- 172.21.15.82:0/3331234713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80005610 con 0x7fec9410a490 2024-05-03T22:13:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.455+0000 7fec9b200700 1 -- 172.21.15.82:0/3331234713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec941a53b0 con 0x7fec9410a490 2024-05-03T22:13:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.456+0000 7fec9b200700 1 -- 172.21.15.82:0/3331234713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec941acc30 con 0x7fec9410a490 2024-05-03T22:13:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.457+0000 7fec9b200700 1 -- 172.21.15.82:0/3331234713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec94112060 con 0x7fec9410a490 2024-05-03T22:13:09.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.461+0000 7fec90c00700 1 -- 172.21.15.82:0/3331234713 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fec80004750 con 0x7fec9410a490 2024-05-03T22:13:09.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.462+0000 7fec90c00700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fec780b2900 0x7fec780b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:09.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.462+0000 7fec90c00700 1 -- 172.21.15.82:0/3331234713 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fec800e2a50 con 0x7fec9410a490 2024-05-03T22:13:09.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.462+0000 7fec93e00700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fec780b2900 0x7fec780b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:09.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.463+0000 7fec93e00700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fec780b2900 0x7fec780b4dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fec8400b2e0 tx=0x7fec8401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:09.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.465+0000 7fec90c00700 1 -- 172.21.15.82:0/3331234713 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fec80054d70 con 0x7fec9410a490 2024-05-03T22:13:09.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.694+0000 7fec9b200700 1 -- 172.21.15.82:0/3331234713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec94111a40 con 0x7fec9410a490 2024-05-03T22:13:09.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.700+0000 7fec90c00700 1 -- 172.21.15.82:0/3331234713 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24116 (secure 0 0 0) 0x7fec800aa530 con 0x7fec9410a490 2024-05-03T22:13:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:13:09.703 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:13:00.610473+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:12:30.512363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:12:34.936483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:12:50.095758+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:13:09.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.703+0000 7fec9b200700 1 -- 172.21.15.82:0/3331234713 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fec780b2900 msgr2=0x7fec780b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:09.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.703+0000 7fec9b200700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fec780b2900 0x7fec780b4dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fec8400b2e0 tx=0x7fec8401a040 comp rx=0 tx=0).stop 2024-05-03T22:13:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.703+0000 7fec9b200700 1 -- 172.21.15.82:0/3331234713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9410a490 msgr2=0x7fec941a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.703+0000 7fec9b200700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9410a490 0x7fec941a05f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fec8000e9c0 tx=0x7fec8000ed80 comp rx=0 tx=0).stop 2024-05-03T22:13:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.704+0000 7fec9b200700 1 -- 172.21.15.82:0/3331234713 shutdown_connections 2024-05-03T22:13:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.704+0000 7fec9b200700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fec780b2900 0x7fec780b4dc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.704+0000 7fec9b200700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec9410fb60 0x7fec941a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.704+0000 7fec9b200700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec94109ad0 0x7fec941a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.704+0000 7fec9b200700 1 --2- 172.21.15.82:0/3331234713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9410a490 0x7fec941a05f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.704+0000 7fec9b200700 1 -- 172.21.15.82:0/3331234713 >> 172.21.15.82:0/3331234713 conn(0x7fec94076c70 msgr2=0x7fec940775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.704+0000 7fec9b200700 1 -- 172.21.15.82:0/3331234713 shutdown_connections 2024-05-03T22:13:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:09.704+0000 7fec9b200700 1 -- 172.21.15.82:0/3331234713 wait complete. 2024-05-03T22:13:10.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:10 smithi130 ceph-mon[32417]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:10.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:10 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3331234713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:10 smithi116 ceph-mon[31828]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:10 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3331234713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:10 smithi082 ceph-mon[28404]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:10 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3331234713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:11.075 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:13:11.514 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:12 smithi082 ceph-mon[28404]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:12 smithi130 ceph-mon[32417]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:12 smithi116 ceph-mon[31828]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.015+0000 7f1328800700 1 -- 172.21.15.82:0/1369995760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f132010b6c0 msgr2=0x7f132010baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.015+0000 7f1328800700 1 --2- 172.21.15.82:0/1369995760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f132010b6c0 0x7f132010baa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1314009990 tx=0x7f1314009ca0 comp rx=0 tx=0).stop 2024-05-03T22:13:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.015+0000 7f1328800700 1 -- 172.21.15.82:0/1369995760 shutdown_connections 2024-05-03T22:13:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.015+0000 7f1328800700 1 --2- 172.21.15.82:0/1369995760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f132010b6c0 0x7f132010baa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:14.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.015+0000 7f1328800700 1 --2- 172.21.15.82:0/1369995760 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1320106080 0x7f1320112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:14.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.015+0000 7f1328800700 1 --2- 172.21.15.82:0/1369995760 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13201056c0 0x7f1320105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:14.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.015+0000 7f1328800700 1 -- 172.21.15.82:0/1369995760 >> 172.21.15.82:0/1369995760 conn(0x7f1320101170 msgr2=0x7f1320103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:14.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.015+0000 7f1328800700 1 -- 172.21.15.82:0/1369995760 shutdown_connections 2024-05-03T22:13:14.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.015+0000 7f1328800700 1 -- 172.21.15.82:0/1369995760 wait complete. 2024-05-03T22:13:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.016+0000 7f1328800700 1 Processor -- start 2024-05-03T22:13:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.016+0000 7f1328800700 1 -- start start 2024-05-03T22:13:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.017+0000 7f1328800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13201056c0 0x7f13201a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.017+0000 7f1328800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1320106080 0x7f13201a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.017+0000 7f1328800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f132010b6c0 0x7f132019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.017+0000 7f1328800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1320115770 con 0x7f132010b6c0 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.017+0000 7f1328800700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f13201155f0 con 0x7f1320106080 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.017+0000 7f1328800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13201158f0 con 0x7f13201056c0 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.017+0000 7f1326800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f132010b6c0 0x7f132019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.017+0000 7f1326800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f132010b6c0 0x7f132019baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47452/0 (socket says 172.21.15.82:47452) 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.017+0000 7f1326800700 1 -- 172.21.15.82:0/2853943217 learned_addr learned my addr 172.21.15.82:0/2853943217 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.017+0000 7f1325e00700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13201056c0 0x7f13201a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.018+0000 7f1325400700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1320106080 0x7f13201a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.018+0000 7f1326800700 1 -- 172.21.15.82:0/2853943217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13201056c0 msgr2=0x7f13201a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.018+0000 7f1326800700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13201056c0 0x7f13201a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.018+0000 7f1326800700 1 -- 172.21.15.82:0/2853943217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1320106080 msgr2=0x7f13201a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.018+0000 7f1326800700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1320106080 0x7f13201a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:14.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.018+0000 7f1326800700 1 -- 172.21.15.82:0/2853943217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132019c250 con 0x7f132010b6c0 2024-05-03T22:13:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.018+0000 7f1326800700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f132010b6c0 0x7f132019baf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f131c007ee0 tx=0x7f131c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.018+0000 7f131aa00700 1 -- 172.21.15.82:0/2853943217 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c00dbd0 con 0x7f132010b6c0 2024-05-03T22:13:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.018+0000 7f131aa00700 1 -- 172.21.15.82:0/2853943217 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f131c00dd70 con 0x7f132010b6c0 2024-05-03T22:13:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.018+0000 7f131aa00700 1 -- 172.21.15.82:0/2853943217 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c0058d0 con 0x7f132010b6c0 2024-05-03T22:13:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.019+0000 7f1328800700 1 -- 172.21.15.82:0/2853943217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132019c540 con 0x7f132010b6c0 2024-05-03T22:13:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.019+0000 7f1328800700 1 -- 172.21.15.82:0/2853943217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13201a87b0 con 0x7f132010b6c0 2024-05-03T22:13:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.020+0000 7f1328800700 1 -- 172.21.15.82:0/2853943217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132006a190 con 0x7f132010b6c0 2024-05-03T22:13:14.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.022+0000 7f131aa00700 1 -- 172.21.15.82:0/2853943217 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f131c01a020 con 0x7f132010b6c0 2024-05-03T22:13:14.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.024+0000 7f131aa00700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13080b2880 0x7f13080b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:14.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.024+0000 7f131aa00700 1 -- 172.21.15.82:0/2853943217 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f131c0e22e0 con 0x7f132010b6c0 2024-05-03T22:13:14.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.024+0000 7f1325e00700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13080b2880 0x7f13080b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:14.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.025+0000 7f1325e00700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13080b2880 0x7f13080b4d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1314003760 tx=0x7f131401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:14.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.026+0000 7f131aa00700 1 -- 172.21.15.82:0/2853943217 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f131c010070 con 0x7f132010b6c0 2024-05-03T22:13:14.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.259+0000 7f1328800700 1 -- 172.21.15.82:0/2853943217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f132002e510 con 0x7f132010b6c0 2024-05-03T22:13:14.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.261+0000 7f131aa00700 1 -- 172.21.15.82:0/2853943217 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24116 (secure 0 0 0) 0x7f131c0a9dc0 con 0x7f132010b6c0 2024-05-03T22:13:14.264 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:13:14.264 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:13:00.610473+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:12:30.512363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:12:34.936483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:12:50.095758+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:13:14.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.266+0000 7f1328800700 1 -- 172.21.15.82:0/2853943217 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13080b2880 msgr2=0x7f13080b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:14.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.266+0000 7f1328800700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13080b2880 0x7f13080b4d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1314003760 tx=0x7f131401a040 comp rx=0 tx=0).stop 2024-05-03T22:13:14.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.266+0000 7f1328800700 1 -- 172.21.15.82:0/2853943217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f132010b6c0 msgr2=0x7f132019baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:14.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.266+0000 7f1328800700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f132010b6c0 0x7f132019baf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f131c007ee0 tx=0x7f131c00d3b0 comp rx=0 tx=0).stop 2024-05-03T22:13:14.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.266+0000 7f1328800700 1 -- 172.21.15.82:0/2853943217 shutdown_connections 2024-05-03T22:13:14.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.266+0000 7f1328800700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13080b2880 0x7f13080b4d40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:14.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.266+0000 7f1328800700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f132010b6c0 0x7f132019baf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:14.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.266+0000 7f1328800700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13201056c0 0x7f13201a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:14.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.266+0000 7f1328800700 1 --2- 172.21.15.82:0/2853943217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1320106080 0x7f13201a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:14.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.266+0000 7f1328800700 1 -- 172.21.15.82:0/2853943217 >> 172.21.15.82:0/2853943217 conn(0x7f1320101170 msgr2=0x7f1320101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:14.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.267+0000 7f1328800700 1 -- 172.21.15.82:0/2853943217 shutdown_connections 2024-05-03T22:13:14.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:14.267+0000 7f1328800700 1 -- 172.21.15.82:0/2853943217 wait complete. 2024-05-03T22:13:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:14 smithi130 ceph-mon[32417]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:14 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2853943217' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:14.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:14 smithi116 ceph-mon[31828]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:14.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:14 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2853943217' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:14 smithi082 ceph-mon[28404]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:14 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2853943217' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:15.249 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:13:15.698 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:16.394 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:16 smithi082 ceph-mon[28404]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:16 smithi130 ceph-mon[32417]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:16.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:16 smithi116 ceph-mon[31828]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:18.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.234+0000 7ff36d200700 1 -- 172.21.15.82:0/1588203154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff368102180 msgr2=0x7ff368102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:18.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.234+0000 7ff36d200700 1 --2- 172.21.15.82:0/1588203154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff368102180 0x7ff368102560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff358009990 tx=0x7ff358009ca0 comp rx=0 tx=0).stop 2024-05-03T22:13:18.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.234+0000 7ff36d200700 1 -- 172.21.15.82:0/1588203154 shutdown_connections 2024-05-03T22:13:18.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.234+0000 7ff36d200700 1 --2- 172.21.15.82:0/1588203154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff368102180 0x7ff368102560 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:18.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.234+0000 7ff36d200700 1 --2- 172.21.15.82:0/1588203154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff36810fd30 0x7ff368112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:18.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.234+0000 7ff36d200700 1 --2- 172.21.15.82:0/1588203154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff368102b30 0x7ff36810f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:18.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.234+0000 7ff36d200700 1 -- 172.21.15.82:0/1588203154 >> 172.21.15.82:0/1588203154 conn(0x7ff3680fddc0 msgr2=0x7ff3681001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:18.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.234+0000 7ff36d200700 1 -- 172.21.15.82:0/1588203154 shutdown_connections 2024-05-03T22:13:18.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.234+0000 7ff36d200700 1 -- 172.21.15.82:0/1588203154 wait complete. 2024-05-03T22:13:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.235+0000 7ff36d200700 1 Processor -- start 2024-05-03T22:13:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.235+0000 7ff36d200700 1 -- start start 2024-05-03T22:13:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.235+0000 7ff36d200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff368102180 0x7ff3681a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.235+0000 7ff36d200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff368102b30 0x7ff3681a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.235+0000 7ff36d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff36810fd30 0x7ff36819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.235+0000 7ff36d200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff3681156b0 con 0x7ff36810fd30 2024-05-03T22:13:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.235+0000 7ff36d200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff368115530 con 0x7ff368102180 2024-05-03T22:13:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.235+0000 7ff36d200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff368115830 con 0x7ff368102b30 2024-05-03T22:13:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.236+0000 7ff367e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff36810fd30 0x7ff36819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.236+0000 7ff367e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff36810fd30 0x7ff36819bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47466/0 (socket says 172.21.15.82:47466) 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.236+0000 7ff367e00700 1 -- 172.21.15.82:0/2815057867 learned_addr learned my addr 172.21.15.82:0/2815057867 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.236+0000 7ff367400700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff368102180 0x7ff3681a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.236+0000 7ff35ea00700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff368102b30 0x7ff3681a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.236+0000 7ff367e00700 1 -- 172.21.15.82:0/2815057867 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff368102b30 msgr2=0x7ff3681a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.236+0000 7ff367e00700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff368102b30 0x7ff3681a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.236+0000 7ff367e00700 1 -- 172.21.15.82:0/2815057867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff368102180 msgr2=0x7ff3681a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.236+0000 7ff367e00700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff368102180 0x7ff3681a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.236+0000 7ff367e00700 1 -- 172.21.15.82:0/2815057867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36819c210 con 0x7ff36810fd30 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.237+0000 7ff367e00700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff36810fd30 0x7ff36819bab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff3600094f0 tx=0x7ff36000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.237+0000 7ff364c00700 1 -- 172.21.15.82:0/2815057867 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36000ddd0 con 0x7ff36810fd30 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.237+0000 7ff364c00700 1 -- 172.21.15.82:0/2815057867 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff360009e20 con 0x7ff36810fd30 2024-05-03T22:13:18.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.237+0000 7ff36d200700 1 -- 172.21.15.82:0/2815057867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36819c500 con 0x7ff36810fd30 2024-05-03T22:13:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.237+0000 7ff364c00700 1 -- 172.21.15.82:0/2815057867 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360015400 con 0x7ff36810fd30 2024-05-03T22:13:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.237+0000 7ff36d200700 1 -- 172.21.15.82:0/2815057867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3681a8770 con 0x7ff36810fd30 2024-05-03T22:13:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.238+0000 7ff36d200700 1 -- 172.21.15.82:0/2815057867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff36806a190 con 0x7ff36810fd30 2024-05-03T22:13:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.241+0000 7ff364c00700 1 -- 172.21.15.82:0/2815057867 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff360004dd0 con 0x7ff36810fd30 2024-05-03T22:13:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.242+0000 7ff364c00700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff34c0b2900 0x7ff34c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.242+0000 7ff364c00700 1 -- 172.21.15.82:0/2815057867 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7ff3600e2600 con 0x7ff36810fd30 2024-05-03T22:13:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.242+0000 7ff367400700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff34c0b2900 0x7ff34c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.243+0000 7ff367400700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff34c0b2900 0x7ff34c0b4dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff358003760 tx=0x7ff35800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.245+0000 7ff364c00700 1 -- 172.21.15.82:0/2815057867 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff360010070 con 0x7ff36810fd30 2024-05-03T22:13:18.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.526+0000 7ff36d200700 1 -- 172.21.15.82:0/2815057867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff36819cf90 con 0x7ff36810fd30 2024-05-03T22:13:18.528 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:18 smithi082 ceph-mon[28404]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:18.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.528+0000 7ff364c00700 1 -- 172.21.15.82:0/2815057867 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11806 (secure 0 0 0) 0x7ff3600aa080 con 0x7ff36810fd30 2024-05-03T22:13:18.530 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:13:18.530 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34412,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34433,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-03T22:12:39.270198+0000","modified":"2024-05-03T22:13:00.610689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34460":{"gid":34460,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6839/3254019270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3254019270},{"type":"v1","addr":"172.21.15.116:6839","nonce":3254019270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34460,"qdb_cluster":[34460]},"id":1}]} 2024-05-03T22:13:18.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 -- 172.21.15.82:0/2815057867 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff34c0b2900 msgr2=0x7ff34c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff34c0b2900 0x7ff34c0b4dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff358003760 tx=0x7ff35800b540 comp rx=0 tx=0).stop 2024-05-03T22:13:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 -- 172.21.15.82:0/2815057867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff36810fd30 msgr2=0x7ff36819bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff36810fd30 0x7ff36819bab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff3600094f0 tx=0x7ff36000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:13:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 -- 172.21.15.82:0/2815057867 shutdown_connections 2024-05-03T22:13:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff34c0b2900 0x7ff34c0b4dc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff36810fd30 0x7ff36819bab0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff368102180 0x7ff3681a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 --2- 172.21.15.82:0/2815057867 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff368102b30 0x7ff3681a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 -- 172.21.15.82:0/2815057867 >> 172.21.15.82:0/2815057867 conn(0x7ff3680fddc0 msgr2=0x7ff3681001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 -- 172.21.15.82:0/2815057867 shutdown_connections 2024-05-03T22:13:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:18.531+0000 7ff36d200700 1 -- 172.21.15.82:0/2815057867 wait complete. 2024-05-03T22:13:18.535 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-05-03T22:13:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:18 smithi116 ceph-mon[31828]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:18 smithi130 ceph-mon[32417]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:19.426 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:13:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:19 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2815057867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:13:19.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:19 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2815057867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:13:19.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:19 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2815057867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:13:19.861 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:20.550 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:20 smithi082 ceph-mon[28404]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:20 smithi116 ceph-mon[31828]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:20 smithi130 ceph-mon[32417]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:22.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.325+0000 7fa0d2c00700 1 -- 172.21.15.82:0/4010909503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0cc06bf50 msgr2=0x7fa0cc06c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:22.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.325+0000 7fa0d2c00700 1 --2- 172.21.15.82:0/4010909503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0cc06bf50 0x7fa0cc06c3d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009990 tx=0x7fa0b8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:13:22.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.325+0000 7fa0d2c00700 1 -- 172.21.15.82:0/4010909503 shutdown_connections 2024-05-03T22:13:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.325+0000 7fa0d2c00700 1 --2- 172.21.15.82:0/4010909503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc10fc60 0x7fa0cc112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.325+0000 7fa0d2c00700 1 --2- 172.21.15.82:0/4010909503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0cc104360 0x7fa0cc06ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.325+0000 7fa0d2c00700 1 --2- 172.21.15.82:0/4010909503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0cc06bf50 0x7fa0cc06c3d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.325+0000 7fa0d2c00700 1 -- 172.21.15.82:0/4010909503 >> 172.21.15.82:0/4010909503 conn(0x7fa0cc0791e0 msgr2=0x7fa0cc0795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.325+0000 7fa0d2c00700 1 -- 172.21.15.82:0/4010909503 shutdown_connections 2024-05-03T22:13:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.325+0000 7fa0d2c00700 1 -- 172.21.15.82:0/4010909503 wait complete. 2024-05-03T22:13:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.326+0000 7fa0d2c00700 1 Processor -- start 2024-05-03T22:13:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.327+0000 7fa0d2c00700 1 -- start start 2024-05-03T22:13:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.327+0000 7fa0d2c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0cc06bf50 0x7fa0cc1a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.327+0000 7fa0d2c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc104360 0x7fa0cc1a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.327+0000 7fa0d2c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0cc10fc60 0x7fa0cc19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.327+0000 7fa0d2c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc115690 con 0x7fa0cc06bf50 2024-05-03T22:13:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.327+0000 7fa0d2c00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc115510 con 0x7fa0cc104360 2024-05-03T22:13:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.327+0000 7fa0d2c00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc115810 con 0x7fa0cc10fc60 2024-05-03T22:13:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.327+0000 7fa0d1800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0cc06bf50 0x7fa0cc1a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.327+0000 7fa0d1800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0cc06bf50 0x7fa0cc1a17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47480/0 (socket says 172.21.15.82:47480) 2024-05-03T22:13:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.327+0000 7fa0d1800700 1 -- 172.21.15.82:0/2142709900 learned_addr learned my addr 172.21.15.82:0/2142709900 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.328+0000 7fa0d2200700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0cc10fc60 0x7fa0cc19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.328+0000 7fa0d0e00700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc104360 0x7fa0cc1a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.328+0000 7fa0d1800700 1 -- 172.21.15.82:0/2142709900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0cc10fc60 msgr2=0x7fa0cc19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.328+0000 7fa0d1800700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0cc10fc60 0x7fa0cc19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.328+0000 7fa0d1800700 1 -- 172.21.15.82:0/2142709900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc104360 msgr2=0x7fa0cc1a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.328+0000 7fa0d1800700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc104360 0x7fa0cc1a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.328+0000 7fa0d1800700 1 -- 172.21.15.82:0/2142709900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0cc19c110 con 0x7fa0cc06bf50 2024-05-03T22:13:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.328+0000 7fa0d1800700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0cc06bf50 0x7fa0cc1a17f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000d950 tx=0x7fa0c000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.328+0000 7fa0ca000700 1 -- 172.21.15.82:0/2142709900 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0016070 con 0x7fa0cc06bf50 2024-05-03T22:13:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.328+0000 7fa0ca000700 1 -- 172.21.15.82:0/2142709900 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0c0010460 con 0x7fa0cc06bf50 2024-05-03T22:13:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.329+0000 7fa0d2c00700 1 -- 172.21.15.82:0/2142709900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0cc19c400 con 0x7fa0cc06bf50 2024-05-03T22:13:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.329+0000 7fa0ca000700 1 -- 172.21.15.82:0/2142709900 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000f620 con 0x7fa0cc06bf50 2024-05-03T22:13:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.329+0000 7fa0d2c00700 1 -- 172.21.15.82:0/2142709900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0cc1a86c0 con 0x7fa0cc06bf50 2024-05-03T22:13:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.330+0000 7fa0d2c00700 1 -- 172.21.15.82:0/2142709900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0cc06a190 con 0x7fa0cc06bf50 2024-05-03T22:13:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.332+0000 7fa0ca000700 1 -- 172.21.15.82:0/2142709900 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa0c0019070 con 0x7fa0cc06bf50 2024-05-03T22:13:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.334+0000 7fa0ca000700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0b40b2900 0x7fa0b40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:22.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.334+0000 7fa0ca000700 1 -- 172.21.15.82:0/2142709900 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fa0c00e2120 con 0x7fa0cc06bf50 2024-05-03T22:13:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.334+0000 7fa0d0e00700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0b40b2900 0x7fa0b40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.335+0000 7fa0d0e00700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0b40b2900 0x7fa0b40b4dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800b5c0 tx=0x7fa0b801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:22.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.336+0000 7fa0ca000700 1 -- 172.21.15.82:0/2142709900 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa0c00a9ba0 con 0x7fa0cc06bf50 2024-05-03T22:13:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:22 smithi082 ceph-mon[28404]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.575+0000 7fa0d2c00700 1 -- 172.21.15.82:0/2142709900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0cc1a88f0 con 0x7fa0cc06bf50 2024-05-03T22:13:22.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.580+0000 7fa0ca000700 1 -- 172.21.15.82:0/2142709900 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24116 (secure 0 0 0) 0x7fa0c00a94a0 con 0x7fa0cc06bf50 2024-05-03T22:13:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:13:22.582 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:13:00.610473+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:12:30.512363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:12:34.936483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:12:50.095758+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:13:22.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 -- 172.21.15.82:0/2142709900 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0b40b2900 msgr2=0x7fa0b40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:22.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0b40b2900 0x7fa0b40b4dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800b5c0 tx=0x7fa0b801a040 comp rx=0 tx=0).stop 2024-05-03T22:13:22.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 -- 172.21.15.82:0/2142709900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0cc06bf50 msgr2=0x7fa0cc1a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:22.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0cc06bf50 0x7fa0cc1a17f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000d950 tx=0x7fa0c000dd10 comp rx=0 tx=0).stop 2024-05-03T22:13:22.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 -- 172.21.15.82:0/2142709900 shutdown_connections 2024-05-03T22:13:22.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0b40b2900 0x7fa0b40b4dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:22.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0cc06bf50 0x7fa0cc1a17f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:22.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0cc10fc60 0x7fa0cc19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:22.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 --2- 172.21.15.82:0/2142709900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc104360 0x7fa0cc1a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:22.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 -- 172.21.15.82:0/2142709900 >> 172.21.15.82:0/2142709900 conn(0x7fa0cc0791e0 msgr2=0x7fa0cc101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:22.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 -- 172.21.15.82:0/2142709900 shutdown_connections 2024-05-03T22:13:22.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:22.583+0000 7fa0d2c00700 1 -- 172.21.15.82:0/2142709900 wait complete. 2024-05-03T22:13:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:22 smithi116 ceph-mon[31828]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:22 smithi130 ceph-mon[32417]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:23.477 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-03T22:12:39.270198+0000', 'modified': '2024-05-03T22:13:00.610689+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34460': {'gid': 34460, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.116:6839/3254019270', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 3254019270}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 3254019270}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 34460, 'qdb_cluster': [34460]} 2024-05-03T22:13:23.477 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-03T22:13:23.477 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-03T22:13:23.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:23 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2142709900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:23.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:23 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2142709900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:23.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:23 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2142709900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:23.915 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:24.588 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:24 smithi082 ceph-mon[28404]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:24.679 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:24 smithi130 ceph-mon[32417]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:24 smithi116 ceph-mon[31828]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:26.420 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:26 smithi082 ceph-mon[28404]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:26.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.445+0000 7fa8d6200700 1 -- 172.21.15.82:0/2014837023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8d010fea0 msgr2=0x7fa8d0112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:26.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.445+0000 7fa8d6200700 1 --2- 172.21.15.82:0/2014837023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8d010fea0 0x7fa8d0112290 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009990 tx=0x7fa8c8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.446+0000 7fa8d6200700 1 -- 172.21.15.82:0/2014837023 shutdown_connections 2024-05-03T22:13:26.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.446+0000 7fa8d6200700 1 --2- 172.21.15.82:0/2014837023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8d010fea0 0x7fa8d0112290 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.446+0000 7fa8d6200700 1 --2- 172.21.15.82:0/2014837023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8d00756d0 0x7fa8d0075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.446+0000 7fa8d6200700 1 --2- 172.21.15.82:0/2014837023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8d0075ff0 0x7fa8d010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.446+0000 7fa8d6200700 1 -- 172.21.15.82:0/2014837023 >> 172.21.15.82:0/2014837023 conn(0x7fa8d007a600 msgr2=0x7fa8d007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:26.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.446+0000 7fa8d6200700 1 -- 172.21.15.82:0/2014837023 shutdown_connections 2024-05-03T22:13:26.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.446+0000 7fa8d6200700 1 -- 172.21.15.82:0/2014837023 wait complete. 2024-05-03T22:13:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.447+0000 7fa8d6200700 1 Processor -- start 2024-05-03T22:13:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.447+0000 7fa8d6200700 1 -- start start 2024-05-03T22:13:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.447+0000 7fa8d6200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8d00756d0 0x7fa8d01a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.447+0000 7fa8d6200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8d0075ff0 0x7fa8d01a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.447+0000 7fa8d6200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8d010fea0 0x7fa8d019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.447+0000 7fa8d6200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d01157b0 con 0x7fa8d00756d0 2024-05-03T22:13:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.447+0000 7fa8d6200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d0115630 con 0x7fa8d0075ff0 2024-05-03T22:13:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.447+0000 7fa8d6200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d0115930 con 0x7fa8d010fea0 2024-05-03T22:13:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.448+0000 7fa8cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8d00756d0 0x7fa8d01a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.448+0000 7fa8cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8d00756d0 0x7fa8d01a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58336/0 (socket says 172.21.15.82:58336) 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.448+0000 7fa8cf400700 1 -- 172.21.15.82:0/3056268523 learned_addr learned my addr 172.21.15.82:0/3056268523 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.448+0000 7fa8cea00700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8d0075ff0 0x7fa8d01a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.448+0000 7fa8cfe00700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8d010fea0 0x7fa8d019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.448+0000 7fa8cf400700 1 -- 172.21.15.82:0/3056268523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8d010fea0 msgr2=0x7fa8d019bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.448+0000 7fa8cf400700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8d010fea0 0x7fa8d019bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.448+0000 7fa8cf400700 1 -- 172.21.15.82:0/3056268523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8d0075ff0 msgr2=0x7fa8d01a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.448+0000 7fa8cf400700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8d0075ff0 0x7fa8d01a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.448+0000 7fa8cf400700 1 -- 172.21.15.82:0/3056268523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d019c290 con 0x7fa8d00756d0 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.448+0000 7fa8cea00700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8d0075ff0 0x7fa8d01a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.449+0000 7fa8cf400700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8d00756d0 0x7fa8d01a1920 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000ba50 tx=0x7fa8c000be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.449+0000 7fa8c7e00700 1 -- 172.21.15.82:0/3056268523 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0019070 con 0x7fa8d00756d0 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.449+0000 7fa8c7e00700 1 -- 172.21.15.82:0/3056268523 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8c0014440 con 0x7fa8d00756d0 2024-05-03T22:13:26.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.449+0000 7fa8c7e00700 1 -- 172.21.15.82:0/3056268523 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00075d0 con 0x7fa8d00756d0 2024-05-03T22:13:26.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.449+0000 7fa8d6200700 1 -- 172.21.15.82:0/3056268523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d019c580 con 0x7fa8d00756d0 2024-05-03T22:13:26.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.449+0000 7fa8d6200700 1 -- 172.21.15.82:0/3056268523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d01a87f0 con 0x7fa8d00756d0 2024-05-03T22:13:26.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.453+0000 7fa8c7e00700 1 -- 172.21.15.82:0/3056268523 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa8c001c070 con 0x7fa8d00756d0 2024-05-03T22:13:26.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.454+0000 7fa8e0c33b80 1 Processor -- start 2024-05-03T22:13:26.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.454+0000 7fa8e0c33b80 1 -- start start 2024-05-03T22:13:26.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.454+0000 7fa8c7e00700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa8b40b2900 0x7fa8b40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.454+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb9760 0x55fd6ceb9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.454+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceba080 0x55fd6ceb4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.454+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceb5580 0x55fd6ceb59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.454+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fd6ce079d0 con 0x55fd6ceb9760 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.454+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fd6cda5710 con 0x55fd6ceb5580 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.454+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fd6ce03990 con 0x55fd6ceba080 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.454+0000 7fa8c7e00700 1 -- 172.21.15.82:0/3056268523 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fa8c00e1b30 con 0x7fa8d00756d0 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.455+0000 7fa8cfe00700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa8b40b2900 0x7fa8b40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.455+0000 7fa8cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb9760 0x55fd6ceb9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.455+0000 7fa8cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb9760 0x55fd6ceb9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58338/0 (socket says 172.21.15.82:58338) 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.455+0000 7fa8cf400700 1 -- 172.21.15.82:0/537064312 learned_addr learned my addr 172.21.15.82:0/537064312 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.455+0000 7fa8cfe00700 1 --2- 172.21.15.82:0/537064312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceb5580 0x55fd6ceb59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.455+0000 7fa8cea00700 1 --2- 172.21.15.82:0/537064312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceba080 0x55fd6ceb4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.455+0000 7fa8cf400700 1 -- 172.21.15.82:0/537064312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceba080 msgr2=0x55fd6ceb4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.455+0000 7fa8cf400700 1 --2- 172.21.15.82:0/537064312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceba080 0x55fd6ceb4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.455+0000 7fa8cf400700 1 -- 172.21.15.82:0/537064312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceb5580 msgr2=0x55fd6ceb59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:13:26.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.455+0000 7fa8cf400700 1 --2- 172.21.15.82:0/537064312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceb5580 0x55fd6ceb59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.455+0000 7fa8cf400700 1 -- 172.21.15.82:0/537064312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd6cd54880 con 0x55fd6ceb9760 2024-05-03T22:13:26.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.456+0000 7fa8cfe00700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa8b40b2900 0x7fa8b40b4dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8005b40 tx=0x7fa8c8004950 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:26.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.456+0000 7fa8cf400700 1 --2- 172.21.15.82:0/537064312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb9760 0x55fd6ceb9b40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00a4f30 tx=0x7fa8c00a8880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11b9757506f4f3f server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:26.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.456+0000 7fa8c4c00700 1 -- 172.21.15.82:0/537064312 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000f160 con 0x55fd6ceb9760 2024-05-03T22:13:26.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.456+0000 7fa8c4c00700 1 -- 172.21.15.82:0/537064312 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8c00a89c0 con 0x55fd6ceb9760 2024-05-03T22:13:26.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.456+0000 7fa8c4c00700 1 -- 172.21.15.82:0/537064312 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000f590 con 0x55fd6ceb9760 2024-05-03T22:13:26.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.457+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/537064312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb9760 msgr2=0x55fd6ceb9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:26.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.457+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/537064312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb9760 0x55fd6ceb9b40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00a4f30 tx=0x7fa8c00a8880 comp rx=0 tx=0).stop 2024-05-03T22:13:26.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.457+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/537064312 shutdown_connections 2024-05-03T22:13:26.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.457+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/537064312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb9760 0x55fd6ceb9b40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.457+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/537064312 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceb5580 0x55fd6ceb59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.457+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/537064312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceba080 0x55fd6ceb4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.457+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/537064312 >> 172.21.15.82:0/537064312 conn(0x55fd6cde3b10 msgr2=0x55fd6ceaf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.457+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/537064312 shutdown_connections 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.457+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/537064312 wait complete. 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.458+0000 7fa8e0c33b80 1 -- start start 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.458+0000 7fa8e0c33b80 1 Processor -- start 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cec0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceb9760 0x55fd6cebe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceba080 0x55fd6cebe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fd6cec1c50 con 0x55fd6ceb5580 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fd6cd6dad0 con 0x55fd6ceba080 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fd6cec1dd0 con 0x55fd6ceb9760 2024-05-03T22:13:26.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8e0c33b80 10 client.0 _ll_register_callbacks cb 0x55fd6cdaec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cec0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cec0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58348/0 (socket says 172.21.15.82:58348) 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cf400700 1 -- 172.21.15.82:0/2044749393 learned_addr learned my addr 172.21.15.82:0/2044749393 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cea00700 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceb9760 0x55fd6cebe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cfe00700 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceba080 0x55fd6cebe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cf400700 1 -- 172.21.15.82:0/2044749393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceb9760 msgr2=0x55fd6cebe1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cf400700 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceb9760 0x55fd6cebe1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cf400700 1 -- 172.21.15.82:0/2044749393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceba080 msgr2=0x55fd6cebe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cf400700 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceba080 0x55fd6cebe6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cf400700 1 -- 172.21.15.82:0/2044749393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd6cdcd3d0 con 0x55fd6ceb5580 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cea00700 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceb9760 0x55fd6cebe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.459+0000 7fa8cfe00700 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceba080 0x55fd6cebe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.460+0000 7fa8cf400700 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cec0da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000ba20 tx=0x7fa8c00ad310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496c6529311a8ac3 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:26.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.460+0000 7fa8b9600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:13:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.460+0000 7fa8b9600700 1 -- 172.21.15.82:0/2044749393 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00a8eb0 con 0x55fd6ceb5580 2024-05-03T22:13:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.460+0000 7fa8b9600700 1 -- 172.21.15.82:0/2044749393 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fa8c00187f0 con 0x55fd6ceb5580 2024-05-03T22:13:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.460+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/2044749393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c00a89c0 con 0x55fd6ceb5580 2024-05-03T22:13:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.460+0000 7fa8b9600700 1 -- 172.21.15.82:0/2044749393 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fa8c0014a50 con 0x55fd6ceb5580 2024-05-03T22:13:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.460+0000 7fa8e0c33b80 10 client.14703 fetch_fsmap learned FSMap version 17 2024-05-03T22:13:26.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.460+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/2044749393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55fd6cecc420 con 0x55fd6ceb5580 2024-05-03T22:13:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.461+0000 7fa8b9600700 1 -- 172.21.15.82:0/2044749393 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8c00a89c0 con 0x55fd6ceb5580 2024-05-03T22:13:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.461+0000 7fa8b9600700 1 -- 172.21.15.82:0/2044749393 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fa8c0018200 con 0x55fd6ceb5580 2024-05-03T22:13:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.461+0000 7fa8e0c33b80 10 client.14703 fetch_fsmap finished waiting for FSMap version 17 2024-05-03T22:13:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.461+0000 7fa8e0c33b80 10 client.14703 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:13:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.461+0000 7fa8e0c33b80 20 client.14703 populate_metadata read hostname 'smithi082' 2024-05-03T22:13:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.461+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x55fd6cece610 0x55fd6cecfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.461+0000 7fa8e0c33b80 4 client.14703 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:13:26.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.461+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/2044749393 --> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd6ce82180 con 0x55fd6cece610 2024-05-03T22:13:26.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.462+0000 7fa8cea00700 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x55fd6cece610 0x55fd6cecfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.463+0000 7fa8cea00700 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x55fd6cece610 0x55fd6cecfa80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98bc1d1d6948eb3d server_cookie=37ec7650aae66314 in_seq=0 out_seq=0 2024-05-03T22:13:26.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.463+0000 7fa8b9600700 10 client.14703 ms_handle_connect on v2:172.21.15.116:6838/3254019270 2024-05-03T22:13:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8b9600700 1 -- 172.21.15.82:0/2044749393 <== mds.0 v2:172.21.15.116:6838/3254019270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fd6ce82180 con 0x55fd6cece610 2024-05-03T22:13:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8b9600700 10 client.14703 handle_command_reply: tid=0 2024-05-03T22:13:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8e0c33b80 1 client.14703 shutdown 2024-05-03T22:13:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/2044749393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 msgr2=0x55fd6cec0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cec0da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000ba20 tx=0x7fa8c00ad310 comp rx=0 tx=0).stop 2024-05-03T22:13:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/2044749393 shutdown_connections 2024-05-03T22:13:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x55fd6cece610 0x55fd6cecfa80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cec0da0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceba080 0x55fd6cebe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/2044749393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceb9760 0x55fd6cebe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/2044749393 >> 172.21.15.82:0/2044749393 conn(0x55fd6cde3b10 msgr2=0x55fd6cebad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.465+0000 7fa8b9600700 0 client.14703 ms_handle_reset on v2:172.21.15.116:6838/3254019270 2024-05-03T22:13:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.466+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/2044749393 shutdown_connections 2024-05-03T22:13:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.466+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/2044749393 wait complete. 2024-05-03T22:13:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.466+0000 7fa8e0c33b80 20 client.14703 trim_cache size 0 max 16384 2024-05-03T22:13:26.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.488+0000 7fa8e0c33b80 1 Processor -- start 2024-05-03T22:13:26.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.489+0000 7fa8e0c33b80 1 -- start start 2024-05-03T22:13:26.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.489+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebe720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.489+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceb9760 0x55fd6cecd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.489+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceba080 0x55fd6ceaf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.489+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fd6cecddc0 con 0x55fd6ceb5580 2024-05-03T22:13:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.489+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fd6cece490 con 0x55fd6ceb9760 2024-05-03T22:13:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.489+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fd6ceceb60 con 0x55fd6ceba080 2024-05-03T22:13:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.489+0000 7fa8cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.489+0000 7fa8cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebe720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58364/0 (socket says 172.21.15.82:58364) 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.489+0000 7fa8cf400700 1 -- 172.21.15.82:0/3375379988 learned_addr learned my addr 172.21.15.82:0/3375379988 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.490+0000 7fa8cea00700 1 --2- 172.21.15.82:0/3375379988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceb9760 0x55fd6cecd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.490+0000 7fa8cf400700 1 -- 172.21.15.82:0/3375379988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceba080 msgr2=0x55fd6ceaf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.490+0000 7fa8cfe00700 1 --2- 172.21.15.82:0/3375379988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceba080 0x55fd6ceaf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.490+0000 7fa8cf400700 1 --2- 172.21.15.82:0/3375379988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceba080 0x55fd6ceaf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.490+0000 7fa8cf400700 1 -- 172.21.15.82:0/3375379988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceb9760 msgr2=0x55fd6cecd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.490+0000 7fa8cf400700 1 --2- 172.21.15.82:0/3375379988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceb9760 0x55fd6cecd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.490+0000 7fa8cf400700 1 -- 172.21.15.82:0/3375379988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd6ceb9e80 con 0x55fd6ceb5580 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.490+0000 7fa8cf400700 1 --2- 172.21.15.82:0/3375379988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebe720 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000f490 tx=0x7fa8c00a8880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6a1948e19cff15 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.490+0000 7fa8bbe00700 1 -- 172.21.15.82:0/3375379988 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00a8620 con 0x55fd6ceb5580 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.490+0000 7fa8bbe00700 1 -- 172.21.15.82:0/3375379988 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8c00c8070 con 0x55fd6ceb5580 2024-05-03T22:13:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.490+0000 7fa8bbe00700 1 -- 172.21.15.82:0/3375379988 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00df410 con 0x55fd6ceb5580 2024-05-03T22:13:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.491+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/3375379988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 msgr2=0x55fd6cebe720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.491+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/3375379988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebe720 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000f490 tx=0x7fa8c00a8880 comp rx=0 tx=0).stop 2024-05-03T22:13:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.491+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/3375379988 shutdown_connections 2024-05-03T22:13:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.491+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/3375379988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebe720 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.491+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/3375379988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceba080 0x55fd6ceaf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.491+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/3375379988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceb9760 0x55fd6cecd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.491+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/3375379988 >> 172.21.15.82:0/3375379988 conn(0x55fd6cde3b10 msgr2=0x55fd6cebcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.491+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/3375379988 shutdown_connections 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.491+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/3375379988 wait complete. 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.492+0000 7fa8e0c33b80 1 -- start start 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.492+0000 7fa8e0c33b80 1 Processor -- start 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceb9760 0x55fd6ced8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8e0c33b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceba080 0x55fd6ced9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fd6cecf900 con 0x55fd6ceb5580 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fd6cecf230 con 0x55fd6ceba080 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8e0c33b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55fd6cecffd0 con 0x55fd6ceb9760 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8e0c33b80 10 client.0 _ll_register_callbacks cb 0x55fd6cdaec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58374/0 (socket says 172.21.15.82:58374) 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8cf400700 1 -- 172.21.15.82:0/111129810 learned_addr learned my addr 172.21.15.82:0/111129810 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8cfe00700 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceba080 0x55fd6ced9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8cea00700 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceb9760 0x55fd6ced8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8cf400700 1 -- 172.21.15.82:0/111129810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceb9760 msgr2=0x55fd6ced8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8cf400700 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceb9760 0x55fd6ced8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8cf400700 1 -- 172.21.15.82:0/111129810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceba080 msgr2=0x55fd6ced9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8cf400700 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceba080 0x55fd6ced9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.493+0000 7fa8cf400700 1 -- 172.21.15.82:0/111129810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd6ceb28c0 con 0x55fd6ceb5580 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.494+0000 7fa8cf400700 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebbb60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00a4ee0 tx=0x7fa8c00a86d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68eaedb28b8cc0f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.494+0000 7fa8b9600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.494+0000 7fa8b9600700 1 -- 172.21.15.82:0/111129810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00b6060 con 0x55fd6ceb5580 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.494+0000 7fa8b9600700 1 -- 172.21.15.82:0/111129810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fa8c00b1920 con 0x55fd6ceb5580 2024-05-03T22:13:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.494+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/111129810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8c00c8070 con 0x55fd6ceb5580 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.494+0000 7fa8b9600700 1 -- 172.21.15.82:0/111129810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fa8c00b1d10 con 0x55fd6ceb5580 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.494+0000 7fa8e0c33b80 10 client.14709 fetch_fsmap learned FSMap version 17 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.494+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/111129810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55fd6ceb28c0 con 0x55fd6ceb5580 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.494+0000 7fa8b9600700 1 -- 172.21.15.82:0/111129810 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8c00c8070 con 0x55fd6ceb5580 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.495+0000 7fa8b9600700 1 -- 172.21.15.82:0/111129810 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fa8c00b9080 con 0x55fd6ceb5580 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.495+0000 7fa8e0c33b80 10 client.14709 fetch_fsmap finished waiting for FSMap version 17 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.495+0000 7fa8e0c33b80 10 client.14709 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.495+0000 7fa8e0c33b80 20 client.14709 populate_metadata read hostname 'smithi082' 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.495+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x55fd6cf468b0 0x55fd6cf455c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.495+0000 7fa8e0c33b80 4 client.14709 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.495+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/111129810 --> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] -- command(tid 0: {"prefix": "status"}) -- 0x55fd6ce153b0 con 0x55fd6cf468b0 2024-05-03T22:13:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.496+0000 7fa8cea00700 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x55fd6cf468b0 0x55fd6cf455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.496+0000 7fa8cea00700 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x55fd6cf468b0 0x55fd6cf455c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81061dffed20ba3e server_cookie=5cefbd518b3122e in_seq=0 out_seq=0 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.496+0000 7fa8b9600700 10 client.14709 ms_handle_connect on v2:172.21.15.116:6838/3254019270 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8b9600700 1 -- 172.21.15.82:0/111129810 <== mds.0 v2:172.21.15.116:6838/3254019270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fd6ce153b0 con 0x55fd6cf468b0 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8b9600700 10 client.14709 handle_command_reply: tid=0 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8e0c33b80 1 client.14709 shutdown 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/111129810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 msgr2=0x55fd6cebbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebbb60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00a4ee0 tx=0x7fa8c00a86d0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/111129810 shutdown_connections 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x55fd6cf468b0 0x55fd6cf455c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fd6ceb5580 0x55fd6cebbb60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fd6ceba080 0x55fd6ced9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8e0c33b80 1 --2- 172.21.15.82:0/111129810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fd6ceb9760 0x55fd6ced8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8b9600700 0 client.14709 ms_handle_reset on v2:172.21.15.116:6838/3254019270 2024-05-03T22:13:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/111129810 >> 172.21.15.82:0/111129810 conn(0x55fd6cde3b10 msgr2=0x55fd6ceb83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/111129810 shutdown_connections 2024-05-03T22:13:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.497+0000 7fa8e0c33b80 1 -- 172.21.15.82:0/111129810 wait complete. 2024-05-03T22:13:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.498+0000 7fa8e0c33b80 20 client.14709 trim_cache size 0 max 16384 2024-05-03T22:13:26.503 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:13:26.503 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:13:26.503 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-05-03T22:13:26.503 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 34460, 2024-05-03T22:13:26.503 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-03T22:13:26.504 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-03T22:13:26.504 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-03T22:13:26.504 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 46.459143670000003, 2024-05-03T22:13:26.504 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 17, 2024-05-03T22:13:26.504 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2024-05-03T22:13:26.504 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 88, 2024-05-03T22:13:26.504 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 69.774352339000004 2024-05-03T22:13:26.504 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.498+0000 7fa8d6200700 1 -- 172.21.15.82:0/3056268523 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa8b40b2900 msgr2=0x7fa8b40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.498+0000 7fa8d6200700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa8b40b2900 0x7fa8b40b4dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8005b40 tx=0x7fa8c8004950 comp rx=0 tx=0).stop 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.498+0000 7fa8d6200700 1 -- 172.21.15.82:0/3056268523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8d00756d0 msgr2=0x7fa8d01a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.498+0000 7fa8d6200700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8d00756d0 0x7fa8d01a1920 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000ba50 tx=0x7fa8c000be10 comp rx=0 tx=0).stop 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.498+0000 7fa8d6200700 1 -- 172.21.15.82:0/3056268523 shutdown_connections 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.498+0000 7fa8d6200700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa8b40b2900 0x7fa8b40b4dc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.498+0000 7fa8d6200700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8d00756d0 0x7fa8d01a1920 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.498+0000 7fa8d6200700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8d010fea0 0x7fa8d019bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.498+0000 7fa8d6200700 1 --2- 172.21.15.82:0/3056268523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8d0075ff0 0x7fa8d01a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.498+0000 7fa8d6200700 1 -- 172.21.15.82:0/3056268523 >> 172.21.15.82:0/3056268523 conn(0x7fa8d007a600 msgr2=0x7fa8d0100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.499+0000 7fa8d6200700 1 -- 172.21.15.82:0/3056268523 shutdown_connections 2024-05-03T22:13:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:26.499+0000 7fa8d6200700 1 -- 172.21.15.82:0/3056268523 wait complete. 2024-05-03T22:13:26.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:26 smithi116 ceph-mon[31828]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:26.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:26 smithi130 ceph-mon[32417]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:27.433 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-03T22:13:27.433 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:13:27.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-03T22:13:27.889 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:28.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:28 smithi116 ceph-mon[31828]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:28 smithi082 ceph-mon[28404]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:28.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:28 smithi130 ceph-mon[32417]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:30.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.242+0000 7f46fee00700 1 -- 172.21.15.82:0/3629124465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f806b180 msgr2=0x7f46f806b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:30.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.242+0000 7f46fee00700 1 --2- 172.21.15.82:0/3629124465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f806b180 0x7f46f806b600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009990 tx=0x7f46e0009ca0 comp rx=0 tx=0).stop 2024-05-03T22:13:30.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.242+0000 7f46fee00700 1 -- 172.21.15.82:0/3629124465 shutdown_connections 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.242+0000 7f46fee00700 1 --2- 172.21.15.82:0/3629124465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46f806bb40 0x7f46f8110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.242+0000 7f46fee00700 1 --2- 172.21.15.82:0/3629124465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46f8109510 0x7f46f81098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.242+0000 7f46fee00700 1 --2- 172.21.15.82:0/3629124465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f806b180 0x7f46f806b600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.242+0000 7f46fee00700 1 -- 172.21.15.82:0/3629124465 >> 172.21.15.82:0/3629124465 conn(0x7f46f8079350 msgr2=0x7f46f8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.242+0000 7f46fee00700 1 -- 172.21.15.82:0/3629124465 shutdown_connections 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.242+0000 7f46fee00700 1 -- 172.21.15.82:0/3629124465 wait complete. 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.243+0000 7f46fee00700 1 Processor -- start 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.243+0000 7f46fee00700 1 -- start start 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.244+0000 7f46fee00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46f806b180 0x7f46f81a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.244+0000 7f46fee00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f806bb40 0x7f46f81a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.244+0000 7f46fee00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46f8109510 0x7f46f819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:30.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.244+0000 7f46fee00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46f8113560 con 0x7f46f806bb40 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.244+0000 7f46fee00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f46f81133e0 con 0x7f46f806b180 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.244+0000 7f46fee00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f46f81136e0 con 0x7f46f8109510 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.244+0000 7f46ef400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f806bb40 0x7f46f81a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.244+0000 7f46ef400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f806bb40 0x7f46f81a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58392/0 (socket says 172.21.15.82:58392) 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.244+0000 7f46ef400700 1 -- 172.21.15.82:0/4176550852 learned_addr learned my addr 172.21.15.82:0/4176550852 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.244+0000 7f46fce00700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46f8109510 0x7f46f819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.244+0000 7f46f7e00700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46f806b180 0x7f46f81a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46ef400700 1 -- 172.21.15.82:0/4176550852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46f8109510 msgr2=0x7f46f819bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46ef400700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46f8109510 0x7f46f819bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46ef400700 1 -- 172.21.15.82:0/4176550852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46f806b180 msgr2=0x7f46f81a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46ef400700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46f806b180 0x7f46f81a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:30.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46ef400700 1 -- 172.21.15.82:0/4176550852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f819c400 con 0x7f46f806bb40 2024-05-03T22:13:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46f7e00700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46f806b180 0x7f46f81a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:13:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46ef400700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f806bb40 0x7f46f81a1f90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f46e000b650 tx=0x7f46e00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46f5600700 1 -- 172.21.15.82:0/4176550852 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0027070 con 0x7f46f806bb40 2024-05-03T22:13:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46f5600700 1 -- 172.21.15.82:0/4176550852 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46e0022470 con 0x7f46f806bb40 2024-05-03T22:13:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46fee00700 1 -- 172.21.15.82:0/4176550852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f819c690 con 0x7f46f806bb40 2024-05-03T22:13:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46f5600700 1 -- 172.21.15.82:0/4176550852 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0017650 con 0x7f46f806bb40 2024-05-03T22:13:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.245+0000 7f46fee00700 1 -- 172.21.15.82:0/4176550852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f81a8800 con 0x7f46f806bb40 2024-05-03T22:13:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.247+0000 7f46ee000700 1 -- 172.21.15.82:0/4176550852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f8104bd0 con 0x7f46f806bb40 2024-05-03T22:13:30.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.249+0000 7f46f5600700 1 -- 172.21.15.82:0/4176550852 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f46e0009d10 con 0x7f46f806bb40 2024-05-03T22:13:30.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.250+0000 7f46f5600700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f46dc0b2880 0x7f46dc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:30.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.251+0000 7f46f5600700 1 -- 172.21.15.82:0/4176550852 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f46e00e30b0 con 0x7f46f806bb40 2024-05-03T22:13:30.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.251+0000 7f46f7e00700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f46dc0b2880 0x7f46dc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:30.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.251+0000 7f46f7e00700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f46dc0b2880 0x7f46dc0b4d40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f46e80093a0 tx=0x7f46e800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:30.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.255+0000 7f46f5600700 1 -- 172.21.15.82:0/4176550852 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f46e0013070 con 0x7f46f806bb40 2024-05-03T22:13:30.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.538+0000 7f46ee000700 1 -- 172.21.15.82:0/4176550852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f46f819cfe0 con 0x7f46f806bb40 2024-05-03T22:13:30.540 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:30 smithi082 ceph-mon[28404]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:30.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.539+0000 7f46f5600700 1 -- 172.21.15.82:0/4176550852 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f46e00aabc0 con 0x7f46f806bb40 2024-05-03T22:13:30.541 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-03T22:13:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.542+0000 7f46ee000700 1 -- 172.21.15.82:0/4176550852 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f46dc0b2880 msgr2=0x7f46dc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.542+0000 7f46ee000700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f46dc0b2880 0x7f46dc0b4d40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f46e80093a0 tx=0x7f46e800b040 comp rx=0 tx=0).stop 2024-05-03T22:13:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.542+0000 7f46ee000700 1 -- 172.21.15.82:0/4176550852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f806bb40 msgr2=0x7f46f81a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.542+0000 7f46ee000700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f806bb40 0x7f46f81a1f90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f46e000b650 tx=0x7f46e00047b0 comp rx=0 tx=0).stop 2024-05-03T22:13:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.543+0000 7f46ee000700 1 -- 172.21.15.82:0/4176550852 shutdown_connections 2024-05-03T22:13:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.543+0000 7f46ee000700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f46dc0b2880 0x7f46dc0b4d40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.543+0000 7f46ee000700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46f8109510 0x7f46f819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.543+0000 7f46ee000700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46f806b180 0x7f46f81a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.543+0000 7f46ee000700 1 --2- 172.21.15.82:0/4176550852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46f806bb40 0x7f46f81a1f90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.543+0000 7f46ee000700 1 -- 172.21.15.82:0/4176550852 >> 172.21.15.82:0/4176550852 conn(0x7f46f8079350 msgr2=0x7f46f810e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.543+0000 7f46ee000700 1 -- 172.21.15.82:0/4176550852 shutdown_connections 2024-05-03T22:13:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:30.543+0000 7f46ee000700 1 -- 172.21.15.82:0/4176550852 wait complete. 2024-05-03T22:13:30.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:30 smithi116 ceph-mon[31828]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:30.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:30 smithi130 ceph-mon[32417]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:31.519 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-03T22:13:31.519 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-03T22:13:31.519 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-05-03T22:13:31.519 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-03T22:13:31.519 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:13:31.519 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-03T22:13:31.519 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-03T22:13:31.519 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-03T22:13:31.519 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-03T22:13:31.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:31.520 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-05-03T22:13:31.571 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-05-03T22:13:31.572 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:13:31.572 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-05-03T22:13:31.572 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-03T22:13:31.572 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-05-03T22:13:31.572 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-03T22:13:31.572 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41932sec preferred_lft 41932sec 2024-05-03T22:13:31.572 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-05-03T22:13:31.572 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:13:31.573 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-03T22:13:31.574 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:13:31.574 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-03T22:13:31.574 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-05-03T22:13:31.574 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-05-03T22:13:31.574 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-05-03T22:13:31.574 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-03T22:13:31.574 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-03T22:13:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:13:31.684 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:31 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/4176550852' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:13:31.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:31 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:13:31.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:31 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/4176550852' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:13:31.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:31 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:13:31.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:31 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/4176550852' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:13:31.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:31 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:13:32.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:13:32.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:32.022 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-03T22:13:32.090 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-05-03T22:13:32.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:32.094 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-05-03T22:13:32.180 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-05-03T22:13:32.181 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-03T22:13:32.181 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-03T22:13:32.181 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-03T22:13:32.181 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-03T22:13:32.182 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:13:32.182 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-03T22:13:32.182 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-03T22:13:32.182 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-03T22:13:32.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-03T22:13:32.183 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-03T22:13:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:13:32.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:32 smithi082 ceph-mon[28404]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:32.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:32.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:32.571 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:32.571 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:32 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:32 smithi116 ceph-mon[31828]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:32 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:32.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:32 smithi130 ceph-mon[32417]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:32 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:13:33.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:33.254 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-03T22:13:33.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:33.298 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-05-03T22:13:33.382 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:13:33.382 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-03T22:13:33.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:13:33.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-03T22:13:33.382 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-03T22:13:33.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:13:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:13:33.584 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-03T22:13:33.584 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:13:33.584 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-03T22:13:33.584 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-03T22:13:33.584 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-03T22:13:33.584 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-03T22:13:33.584 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-03T22:13:33.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-03T22:13:33.585 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-03T22:13:33.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:13:33.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:13:33.880 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:13:33.880 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-03T22:13:33.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-05-03T22:13:33.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-05-03T22:13:33.880 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-03T22:13:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:13:34.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:13:34.082 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-03T22:13:34.082 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T22:13:34.082 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:13:34.120 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-03T22:13:34.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T22:13:34.120 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:13:34.205 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-05-03T22:13:34.309 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:13:34.350 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-05-03T22:13:34.350 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-05-03T22:13:34.351 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f12cee7f96b7f798451d140ad007c61d7ed639b7a5372fce3d6bd8f3ea83bf37/merged 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/2f6bf6b7d8fe7dbe7a83d377fb416b69a0d54666292249c14045907e7e6b7172/merged 2024-05-03T22:13:34.352 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/861896c61d2f031631d8e293b5df3957eee0e08e1e4e297b69a116cb880b53ac/merged 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/4c44bb9710d86eeed12ad78f36375e0e7989f2e1c81405b1136d84006a300867/merged 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/04f6a320f35eb1ac7e90fbc1919579de39160c7dedf0a68aa5d9b7dde22acb43/merged 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/994e3dece91aede54b7238cd7a639d589b771513c1da466cb264b66175f0591a/merged 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f5d203975eeab06eaecd53a2ddd536403a93407a61bc928c7c674ec107544ad1/merged 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/53aa8f8114ca808a718332650d5f87a19b3036847a5a6531975627ca30fd5880/merged 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5e6a503d3b44749713154d460a79097934ace2aa7ce440d7dcc18cc5174f60d2/merged 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/79c5de15c7c6c3114fd78c68fb4f342d4f5964482363c58fafe69f4f95e2375d/merged 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:13:34.353 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:13:34.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:34.354 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-05-03T22:13:34.440 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-03T22:13:34.440 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-03T22:13:34.488 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-05-03T22:13:34.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:34 smithi082 ceph-mon[28404]: pgmap v406: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:34.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:34 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:34.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:34 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:34.565 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-05-03T22:13:34.607 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-05-03T22:13:34.608 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f12cee7f96b7f798451d140ad007c61d7ed639b7a5372fce3d6bd8f3ea83bf37/merged 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/2f6bf6b7d8fe7dbe7a83d377fb416b69a0d54666292249c14045907e7e6b7172/merged 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/861896c61d2f031631d8e293b5df3957eee0e08e1e4e297b69a116cb880b53ac/merged 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/4c44bb9710d86eeed12ad78f36375e0e7989f2e1c81405b1136d84006a300867/merged 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/04f6a320f35eb1ac7e90fbc1919579de39160c7dedf0a68aa5d9b7dde22acb43/merged 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/994e3dece91aede54b7238cd7a639d589b771513c1da466cb264b66175f0591a/merged 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f5d203975eeab06eaecd53a2ddd536403a93407a61bc928c7c674ec107544ad1/merged 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/53aa8f8114ca808a718332650d5f87a19b3036847a5a6531975627ca30fd5880/merged 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5e6a503d3b44749713154d460a79097934ace2aa7ce440d7dcc18cc5174f60d2/merged 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/79c5de15c7c6c3114fd78c68fb4f342d4f5964482363c58fafe69f4f95e2375d/merged 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:13:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:13:34.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:34.611 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-05-03T22:13:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:34 smithi116 ceph-mon[31828]: pgmap v406: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:34 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:34 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:34.695 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:2024-05-03T22:13:34.695+0000 7f023ce19480 -1 init, newargv = 0x55cabdcd7350 newargc=15 2024-05-03T22:13:34.695 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[72542]: starting ceph client 2024-05-03T22:13:34.708 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[72542]: starting fuse 2024-05-03T22:13:34.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:34 smithi130 ceph-mon[32417]: pgmap v406: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:34.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:34 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:34.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:34 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:35.792 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-05-03T22:13:35.877 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:35 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:35.878 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:35 smithi082 ceph-mon[28404]: pgmap v407: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:35.878 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:35 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:35.878 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:35 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:35.878 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:35 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:35.880 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:13:35.929 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-05-03T22:13:35.929 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-05-03T22:13:35.930 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-05-03T22:13:35.931 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-05-03T22:13:35.931 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-05-03T22:13:35.931 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-05-03T22:13:35.931 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-05-03T22:13:35.931 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:13:35.931 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:13:35.931 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:13:35.931 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:13:35.931 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-05-03T22:13:35.931 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-05-03T22:13:35.931 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f12cee7f96b7f798451d140ad007c61d7ed639b7a5372fce3d6bd8f3ea83bf37/merged 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/2f6bf6b7d8fe7dbe7a83d377fb416b69a0d54666292249c14045907e7e6b7172/merged 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/861896c61d2f031631d8e293b5df3957eee0e08e1e4e297b69a116cb880b53ac/merged 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/4c44bb9710d86eeed12ad78f36375e0e7989f2e1c81405b1136d84006a300867/merged 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/04f6a320f35eb1ac7e90fbc1919579de39160c7dedf0a68aa5d9b7dde22acb43/merged 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/994e3dece91aede54b7238cd7a639d589b771513c1da466cb264b66175f0591a/merged 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f5d203975eeab06eaecd53a2ddd536403a93407a61bc928c7c674ec107544ad1/merged 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/53aa8f8114ca808a718332650d5f87a19b3036847a5a6531975627ca30fd5880/merged 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5e6a503d3b44749713154d460a79097934ace2aa7ce440d7dcc18cc5174f60d2/merged 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/79c5de15c7c6c3114fd78c68fb4f342d4f5964482363c58fafe69f4f95e2375d/merged 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:13:35.932 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:13:35.933 INFO:teuthology.orchestra.run.smithi082.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-03T22:13:35.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:35.933 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-05-03T22:13:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:35 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:35 smithi116 ceph-mon[31828]: pgmap v407: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:35 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:35 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:35.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:35 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:35.972 INFO:teuthology.orchestra.run.smithi082.stdout:114 2024-05-03T22:13:35.972 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> 2024-05-03T22:13:35.973 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.admin")) 2024-05-03T22:13:35.974 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-05-03T22:13:36.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:35 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:36.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:35 smithi130 ceph-mon[32417]: pgmap v407: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:13:36.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:35 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:36.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:35 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:36.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:35 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:36.179 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.admin.72542.asok 2024-05-03T22:13:36.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:13:36.196 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.72542.asok 2024-05-03T22:13:36.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:36.197 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.72542.asok status 2024-05-03T22:13:36.422 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:13:36.422 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-05-03T22:13:36.422 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "9a047fe7599a549042d06a3fb5b6813a203eabea", 2024-05-03T22:13:36.422 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T22:13:36.422 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "admin", 2024-05-03T22:13:36.422 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-05-03T22:13:36.422 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "72542", 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 14721, 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 14721 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-05-03T22:13:36.423 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1965725591 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1965725591 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.14721 192.168.0.1:0/1965725591", 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/1965725591", 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 17, 2024-05-03T22:13:36.424 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 88, 2024-05-03T22:13:36.425 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-05-03T22:13:36.425 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-05-03T22:13:36.425 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-05-03T22:13:36.425 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:13:36.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:36.438 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-05-03T22:13:36.438 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:13:36.487 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-05-03T22:13:36.487 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:13:36.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:36.488 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:13:36.562 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-03T22:13:36.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-03T22:13:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:# file: . 2024-05-03T22:13:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-03T22:13:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:13:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:13:36.730 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:13:36.730 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T22:13:36.784 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]: dispatch 2024-05-03T22:13:36.853 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:36 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]: dispatch 2024-05-03T22:13:36.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:13:36.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:13:36.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:36.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-05-03T22:13:36.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-03T22:13:36.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-05-03T22:13:36.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-03T22:13:36.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-05-03T22:13:36.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-05-03T22:13:36.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-05-03T22:13:36.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]: dispatch 2024-05-03T22:13:36.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:36 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]: dispatch 2024-05-03T22:13:37.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:13:37.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:13:37.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:13:37.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-05-03T22:13:37.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-03T22:13:37.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-05-03T22:13:37.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-03T22:13:37.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-05-03T22:13:37.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-05-03T22:13:37.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-05-03T22:13:37.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]: dispatch 2024-05-03T22:13:37.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:36 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]: dispatch 2024-05-03T22:13:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:37 smithi116 ceph-mon[31828]: pgmap v408: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-03T22:13:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-05-03T22:13:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-03T22:13:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-05-03T22:13:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-03T22:13:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-05-03T22:13:38.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-05-03T22:13:38.187 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-05-03T22:13:38.187 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]': finished 2024-05-03T22:13:38.187 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]': finished 2024-05-03T22:13:38.187 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:37 smithi116 ceph-mon[31828]: osdmap e89: 12 total, 12 up, 12 in 2024-05-03T22:13:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:37 smithi082 ceph-mon[28404]: pgmap v408: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-03T22:13:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-05-03T22:13:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-03T22:13:38.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-05-03T22:13:38.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-03T22:13:38.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-05-03T22:13:38.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-05-03T22:13:38.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-05-03T22:13:38.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]': finished 2024-05-03T22:13:38.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]': finished 2024-05-03T22:13:38.228 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:37 smithi082 ceph-mon[28404]: osdmap e89: 12 total, 12 up, 12 in 2024-05-03T22:13:38.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:37 smithi130 ceph-mon[32417]: pgmap v408: 129 pgs: 129 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-03T22:13:38.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-05-03T22:13:38.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-03T22:13:38.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-05-03T22:13:38.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-03T22:13:38.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-05-03T22:13:38.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-05-03T22:13:38.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-05-03T22:13:38.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]': finished 2024-05-03T22:13:38.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8, 5, 10]}]': finished 2024-05-03T22:13:38.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:37 smithi130 ceph-mon[32417]: osdmap e89: 12 total, 12 up, 12 in 2024-05-03T22:13:39.094 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:38 smithi082 ceph-mon[28404]: osdmap e90: 12 total, 12 up, 12 in 2024-05-03T22:13:39.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:38 smithi116 ceph-mon[31828]: osdmap e90: 12 total, 12 up, 12 in 2024-05-03T22:13:39.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:38 smithi130 ceph-mon[32417]: osdmap e90: 12 total, 12 up, 12 in 2024-05-03T22:13:39.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.591+0000 7f526e000700 1 -- 172.21.15.82:0/1661062406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5268114250 msgr2=0x7f5268116640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:39.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.591+0000 7f526e000700 1 --2- 172.21.15.82:0/1661062406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5268114250 0x7f5268116640 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f526000b0a0 tx=0x7f526000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:13:39.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.591+0000 7f526e000700 1 -- 172.21.15.82:0/1661062406 shutdown_connections 2024-05-03T22:13:39.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.591+0000 7f526e000700 1 --2- 172.21.15.82:0/1661062406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5268114250 0x7f5268116640 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:39.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.591+0000 7f526e000700 1 --2- 172.21.15.82:0/1661062406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52680779d0 0x7f5268077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:39.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.591+0000 7f526e000700 1 --2- 172.21.15.82:0/1661062406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52680782f0 0x7f5268113d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:39.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.591+0000 7f526e000700 1 -- 172.21.15.82:0/1661062406 >> 172.21.15.82:0/1661062406 conn(0x7f52681010e0 msgr2=0x7f5268103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:39.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.591+0000 7f526e000700 1 -- 172.21.15.82:0/1661062406 shutdown_connections 2024-05-03T22:13:39.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.591+0000 7f526e000700 1 -- 172.21.15.82:0/1661062406 wait complete. 2024-05-03T22:13:39.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.592+0000 7f526e000700 1 Processor -- start 2024-05-03T22:13:39.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.593+0000 7f526e000700 1 -- start start 2024-05-03T22:13:39.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.593+0000 7f526e000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52680779d0 0x7f526819fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:39.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.593+0000 7f526e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52680782f0 0x7f52681a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:39.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.593+0000 7f526e000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5268114250 0x7f52681a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:39.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.593+0000 7f526e000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5268119a40 con 0x7f52680782f0 2024-05-03T22:13:39.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.593+0000 7f526e000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f52681198c0 con 0x7f52680779d0 2024-05-03T22:13:39.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.593+0000 7f526e000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5268119bc0 con 0x7f5268114250 2024-05-03T22:13:39.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.593+0000 7f5267e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52680782f0 0x7f52681a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:39.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.593+0000 7f5267e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52680782f0 0x7f52681a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60696/0 (socket says 172.21.15.82:60696) 2024-05-03T22:13:39.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.593+0000 7f5267e00700 1 -- 172.21.15.82:0/4161941772 learned_addr learned my addr 172.21.15.82:0/4161941772 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:39.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.594+0000 7f526cc00700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52680779d0 0x7f526819fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:39.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.594+0000 7f526d600700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5268114250 0x7f52681a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:39.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.594+0000 7f5267e00700 1 -- 172.21.15.82:0/4161941772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5268114250 msgr2=0x7f52681a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:39.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.594+0000 7f5267e00700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5268114250 0x7f52681a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:39.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.594+0000 7f5267e00700 1 -- 172.21.15.82:0/4161941772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52680779d0 msgr2=0x7f526819fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:39.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.594+0000 7f5267e00700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52680779d0 0x7f526819fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:39.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.594+0000 7f5267e00700 1 -- 172.21.15.82:0/4161941772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52681a4e90 con 0x7f52680782f0 2024-05-03T22:13:39.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.594+0000 7f526cc00700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52680779d0 0x7f526819fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:13:39.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.594+0000 7f526d600700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5268114250 0x7f52681a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:13:39.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.594+0000 7f5267e00700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52680782f0 0x7f52681a0410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f525400c9b0 tx=0x7f525400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:39.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.594+0000 7f5265600700 1 -- 172.21.15.82:0/4161941772 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254007b00 con 0x7f52680782f0 2024-05-03T22:13:39.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.595+0000 7f5265600700 1 -- 172.21.15.82:0/4161941772 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5254007ca0 con 0x7f52680782f0 2024-05-03T22:13:39.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.595+0000 7f526e000700 1 -- 172.21.15.82:0/4161941772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52681a5120 con 0x7f52680782f0 2024-05-03T22:13:39.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.595+0000 7f5265600700 1 -- 172.21.15.82:0/4161941772 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254018660 con 0x7f52680782f0 2024-05-03T22:13:39.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.595+0000 7f526e000700 1 -- 172.21.15.82:0/4161941772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52681aca00 con 0x7f52680782f0 2024-05-03T22:13:39.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.596+0000 7f526e000700 1 -- 172.21.15.82:0/4161941772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f526806a190 con 0x7f52680782f0 2024-05-03T22:13:39.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.598+0000 7f5265600700 1 -- 172.21.15.82:0/4161941772 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f525400f450 con 0x7f52680782f0 2024-05-03T22:13:39.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.600+0000 7f5265600700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52500b2900 0x7f52500b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:39.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.600+0000 7f5265600700 1 -- 172.21.15.82:0/4161941772 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7f52540e2870 con 0x7f52680782f0 2024-05-03T22:13:39.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.600+0000 7f526cc00700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52500b2900 0x7f52500b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:39.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.601+0000 7f526cc00700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52500b2900 0x7f52500b4dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f525c005950 tx=0x7f525c005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:39.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.603+0000 7f5265600700 1 -- 172.21.15.82:0/4161941772 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5254014030 con 0x7f52680782f0 2024-05-03T22:13:39.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.853+0000 7f526e000700 1 -- 172.21.15.82:0/4161941772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f52681a1210 con 0x7f52680782f0 2024-05-03T22:13:39.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.855+0000 7f5265600700 1 -- 172.21.15.82:0/4161941772 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+590 (secure 0 0 0) 0x7f52681a1210 con 0x7f52680782f0 2024-05-03T22:13:39.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1970560625 2024-05-04T22:02:36.416695+0000 2024-05-03T22:13:39.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/167294547 2024-05-04T22:02:36.416695+0000 2024-05-03T22:13:39.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/2219604538 2024-05-04T22:02:36.416695+0000 2024-05-03T22:13:39.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/2219604538 2024-05-04T22:02:36.416695+0000 2024-05-03T22:13:39.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3288839212 2024-05-04T22:02:00.707069+0000 2024-05-03T22:13:39.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1944232139 2024-05-04T22:02:00.707069+0000 2024-05-03T22:13:39.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/484754820 2024-05-04T22:02:00.707069+0000 2024-05-03T22:13:39.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1157601153 2024-05-04T22:02:00.707069+0000 2024-05-03T22:13:39.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1944232139 2024-05-04T22:02:00.707069+0000 2024-05-03T22:13:39.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2702343171 2024-05-04T22:02:36.416695+0000 2024-05-03T22:13:39.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 -- 172.21.15.82:0/4161941772 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52500b2900 msgr2=0x7f52500b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:39.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52500b2900 0x7f52500b4dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f525c005950 tx=0x7f525c005f50 comp rx=0 tx=0).stop 2024-05-03T22:13:39.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 -- 172.21.15.82:0/4161941772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52680782f0 msgr2=0x7f52681a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:39.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52680782f0 0x7f52681a0410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f525400c9b0 tx=0x7f525400cd70 comp rx=0 tx=0).stop 2024-05-03T22:13:39.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 -- 172.21.15.82:0/4161941772 shutdown_connections 2024-05-03T22:13:39.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52500b2900 0x7f52500b4dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:39.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5268114250 0x7f52681a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:39.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52680779d0 0x7f526819fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:39.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 --2- 172.21.15.82:0/4161941772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52680782f0 0x7f52681a0410 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:39.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 -- 172.21.15.82:0/4161941772 >> 172.21.15.82:0/4161941772 conn(0x7f52681010e0 msgr2=0x7f52681034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:39.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 -- 172.21.15.82:0/4161941772 shutdown_connections 2024-05-03T22:13:39.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:39.858+0000 7f526e000700 1 -- 172.21.15.82:0/4161941772 wait complete. 2024-05-03T22:13:39.861 INFO:teuthology.orchestra.run.smithi082.stderr:listed 10 entries 2024-05-03T22:13:40.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:39 smithi116 ceph-mon[31828]: pgmap v411: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-03T22:13:40.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:39 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/4161941772' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:13:40.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:39 smithi082 ceph-mon[28404]: pgmap v411: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-03T22:13:40.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:39 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/4161941772' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:13:40.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:39 smithi130 ceph-mon[32417]: pgmap v411: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-03T22:13:40.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:39 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/4161941772' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:13:40.817 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:13:40.817 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T22:13:40.872 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T22:13:41.296 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:41.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:41 smithi082 ceph-mon[28404]: pgmap v412: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-03T22:13:42.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:41 smithi116 ceph-mon[31828]: pgmap v412: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-03T22:13:42.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:41 smithi130 ceph-mon[32417]: pgmap v412: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-03T22:13:43.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.703+0000 7f35d3800700 1 -- 172.21.15.82:0/1704396356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35cc0756d0 msgr2=0x7f35cc075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:43.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.703+0000 7f35d3800700 1 --2- 172.21.15.82:0/1704396356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35cc0756d0 0x7f35cc075ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00b0a0 tx=0x7f35bc00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:13:43.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.703+0000 7f35d3800700 1 -- 172.21.15.82:0/1704396356 shutdown_connections 2024-05-03T22:13:43.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.703+0000 7f35d3800700 1 --2- 172.21.15.82:0/1704396356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35cc0756d0 0x7f35cc075ab0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:43.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.703+0000 7f35d3800700 1 --2- 172.21.15.82:0/1704396356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35cc114670 0x7f35cc116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:43.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.703+0000 7f35d3800700 1 --2- 172.21.15.82:0/1704396356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35cc075ff0 0x7f35cc114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:43.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.703+0000 7f35d3800700 1 -- 172.21.15.82:0/1704396356 >> 172.21.15.82:0/1704396356 conn(0x7f35cc07a600 msgr2=0x7f35cc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:43.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.703+0000 7f35d3800700 1 -- 172.21.15.82:0/1704396356 shutdown_connections 2024-05-03T22:13:43.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.703+0000 7f35d3800700 1 -- 172.21.15.82:0/1704396356 wait complete. 2024-05-03T22:13:43.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.704+0000 7f35d3800700 1 Processor -- start 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.705+0000 7f35d3800700 1 -- start start 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.705+0000 7f35d3800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35cc0756d0 0x7f35cc1a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.705+0000 7f35d3800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35cc075ff0 0x7f35cc1a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.705+0000 7f35d3800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35cc114670 0x7f35cc1a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.705+0000 7f35d3800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc119b50 con 0x7f35cc114670 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.705+0000 7f35d3800700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc1199d0 con 0x7f35cc075ff0 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.705+0000 7f35d3800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc119cd0 con 0x7f35cc0756d0 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.705+0000 7f35d1800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35cc114670 0x7f35cc1a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.705+0000 7f35d1800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35cc114670 0x7f35cc1a4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60718/0 (socket says 172.21.15.82:60718) 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.705+0000 7f35d1800700 1 -- 172.21.15.82:0/3128034547 learned_addr learned my addr 172.21.15.82:0/3128034547 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.706+0000 7f35d0e00700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35cc0756d0 0x7f35cc1a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.706+0000 7f35c3e00700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35cc075ff0 0x7f35cc1a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.706+0000 7f35d1800700 1 -- 172.21.15.82:0/3128034547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35cc0756d0 msgr2=0x7f35cc1a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.706+0000 7f35d1800700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35cc0756d0 0x7f35cc1a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.706+0000 7f35d1800700 1 -- 172.21.15.82:0/3128034547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35cc075ff0 msgr2=0x7f35cc1a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.706+0000 7f35d1800700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35cc075ff0 0x7f35cc1a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.706+0000 7f35d1800700 1 -- 172.21.15.82:0/3128034547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35cc1a50d0 con 0x7f35cc114670 2024-05-03T22:13:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.706+0000 7f35c3e00700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35cc075ff0 0x7f35cc1a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:13:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.706+0000 7f35d1800700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35cc114670 0x7f35cc1a4990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f35c400d950 tx=0x7f35c400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.707+0000 7f35ca000700 1 -- 172.21.15.82:0/3128034547 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c4017070 con 0x7f35cc114670 2024-05-03T22:13:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.707+0000 7f35ca000700 1 -- 172.21.15.82:0/3128034547 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35c4005020 con 0x7f35cc114670 2024-05-03T22:13:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.707+0000 7f35d3800700 1 -- 172.21.15.82:0/3128034547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35cc1a5360 con 0x7f35cc114670 2024-05-03T22:13:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.707+0000 7f35ca000700 1 -- 172.21.15.82:0/3128034547 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c4009990 con 0x7f35cc114670 2024-05-03T22:13:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.707+0000 7f35d3800700 1 -- 172.21.15.82:0/3128034547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35cc1acc40 con 0x7f35cc114670 2024-05-03T22:13:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.708+0000 7f35d3800700 1 -- 172.21.15.82:0/3128034547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35cc06a190 con 0x7f35cc114670 2024-05-03T22:13:43.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.711+0000 7f35ca000700 1 -- 172.21.15.82:0/3128034547 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f35c4004a30 con 0x7f35cc114670 2024-05-03T22:13:43.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.712+0000 7f35ca000700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f35b00b2880 0x7f35b00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:43.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.713+0000 7f35ca000700 1 -- 172.21.15.82:0/3128034547 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7f35c40e1fe0 con 0x7f35cc114670 2024-05-03T22:13:43.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.713+0000 7f35d0e00700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f35b00b2880 0x7f35b00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.714+0000 7f35d0e00700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f35b00b2880 0x7f35b00b4d40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009fd0 tx=0x7f35bc006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.714+0000 7f35ca000700 1 -- 172.21.15.82:0/3128034547 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f35c40051d0 con 0x7f35cc114670 2024-05-03T22:13:43.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.971+0000 7f35d3800700 1 -- 172.21.15.82:0/3128034547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f35cc1ace10 con 0x7f35cc114670 2024-05-03T22:13:43.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.972+0000 7f35ca000700 1 -- 172.21.15.82:0/3128034547 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+590 (secure 0 0 0) 0x7f35c40a99c0 con 0x7f35cc114670 2024-05-03T22:13:43.974 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1970560625 2024-05-04T22:02:36.416695+0000 2024-05-03T22:13:43.974 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/167294547 2024-05-04T22:02:36.416695+0000 2024-05-03T22:13:43.974 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/2219604538 2024-05-04T22:02:36.416695+0000 2024-05-03T22:13:43.974 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/2219604538 2024-05-04T22:02:36.416695+0000 2024-05-03T22:13:43.975 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3288839212 2024-05-04T22:02:00.707069+0000 2024-05-03T22:13:43.975 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1944232139 2024-05-04T22:02:00.707069+0000 2024-05-03T22:13:43.975 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/484754820 2024-05-04T22:02:00.707069+0000 2024-05-03T22:13:43.975 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1157601153 2024-05-04T22:02:00.707069+0000 2024-05-03T22:13:43.975 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1944232139 2024-05-04T22:02:00.707069+0000 2024-05-03T22:13:43.975 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2702343171 2024-05-04T22:02:36.416695+0000 2024-05-03T22:13:43.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.975+0000 7f35d3800700 1 -- 172.21.15.82:0/3128034547 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f35b00b2880 msgr2=0x7f35b00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:43.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.975+0000 7f35d3800700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f35b00b2880 0x7f35b00b4d40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009fd0 tx=0x7f35bc006210 comp rx=0 tx=0).stop 2024-05-03T22:13:43.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.975+0000 7f35d3800700 1 -- 172.21.15.82:0/3128034547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35cc114670 msgr2=0x7f35cc1a4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:43.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.975+0000 7f35d3800700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35cc114670 0x7f35cc1a4990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f35c400d950 tx=0x7f35c400dc60 comp rx=0 tx=0).stop 2024-05-03T22:13:43.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.975+0000 7f35d3800700 1 -- 172.21.15.82:0/3128034547 shutdown_connections 2024-05-03T22:13:43.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.975+0000 7f35d3800700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f35b00b2880 0x7f35b00b4d40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:43.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.975+0000 7f35d3800700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35cc114670 0x7f35cc1a4990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:43.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.975+0000 7f35d3800700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35cc0756d0 0x7f35cc1a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:43.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.975+0000 7f35d3800700 1 --2- 172.21.15.82:0/3128034547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35cc075ff0 0x7f35cc1a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:43.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.975+0000 7f35d3800700 1 -- 172.21.15.82:0/3128034547 >> 172.21.15.82:0/3128034547 conn(0x7f35cc07a600 msgr2=0x7f35cc110170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:43.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.976+0000 7f35d3800700 1 -- 172.21.15.82:0/3128034547 shutdown_connections 2024-05-03T22:13:43.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:43.976+0000 7f35d3800700 1 -- 172.21.15.82:0/3128034547 wait complete. 2024-05-03T22:13:43.979 INFO:teuthology.orchestra.run.smithi082.stderr:listed 10 entries 2024-05-03T22:13:44.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:43 smithi116 ceph-mon[31828]: pgmap v413: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-03T22:13:44.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:43 smithi082 ceph-mon[28404]: pgmap v413: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-03T22:13:44.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:43 smithi130 ceph-mon[32417]: pgmap v413: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-03T22:13:44.927 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-05-03T22:13:44.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:44.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:13:45.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi082.stderr:ceph-fuse[72542]: fuse finished with error 0 and tester_r 0 2024-05-03T22:13:45.020 INFO:teuthology.orchestra.run:waiting for 300 2024-05-03T22:13:45.096 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-05-03T22:13:45.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:13:45.096 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-03T22:13:45.160 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:13:45.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:44 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3128034547' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:13:45.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:44 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3128034547' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:13:45.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:44 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3128034547' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:13:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:46.086 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:45 smithi082 ceph-mon[28404]: pgmap v414: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-03T22:13:46.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:45 smithi130 ceph-mon[32417]: pgmap v414: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-03T22:13:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:45 smithi116 ceph-mon[31828]: pgmap v414: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-03T22:13:47.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.924+0000 7f06a4c00700 1 -- 172.21.15.82:0/673799699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a0109510 msgr2=0x7f06a01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:47.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.924+0000 7f06a4c00700 1 --2- 172.21.15.82:0/673799699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a0109510 0x7f06a01098f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0690009990 tx=0x7f0690009ca0 comp rx=0 tx=0).stop 2024-05-03T22:13:47.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.924+0000 7f06a4c00700 1 -- 172.21.15.82:0/673799699 shutdown_connections 2024-05-03T22:13:47.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.924+0000 7f06a4c00700 1 --2- 172.21.15.82:0/673799699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a0109510 0x7f06a01098f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:47.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.924+0000 7f06a4c00700 1 --2- 172.21.15.82:0/673799699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06a006bb40 0x7f06a0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:47.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.924+0000 7f06a4c00700 1 --2- 172.21.15.82:0/673799699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a006b180 0x7f06a006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:47.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.924+0000 7f06a4c00700 1 -- 172.21.15.82:0/673799699 >> 172.21.15.82:0/673799699 conn(0x7f06a0079350 msgr2=0x7f06a0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:47.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.925+0000 7f06a4c00700 1 -- 172.21.15.82:0/673799699 shutdown_connections 2024-05-03T22:13:47.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.925+0000 7f06a4c00700 1 -- 172.21.15.82:0/673799699 wait complete. 2024-05-03T22:13:47.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.926+0000 7f06a4c00700 1 Processor -- start 2024-05-03T22:13:47.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.926+0000 7f06a4c00700 1 -- start start 2024-05-03T22:13:47.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.927+0000 7f06a4c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06a006b180 0x7f06a01a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:47.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.927+0000 7f06a4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a006bb40 0x7f06a01a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:47.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.927+0000 7f06a4c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a0109510 0x7f06a019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:47.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.927+0000 7f06a4c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06a0113540 con 0x7f06a006bb40 2024-05-03T22:13:47.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.927+0000 7f06a4c00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f06a01133c0 con 0x7f06a006b180 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.927+0000 7f06a4c00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06a01136c0 con 0x7f06a0109510 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.927+0000 7f0695400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a006bb40 0x7f06a01a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.927+0000 7f0695400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a006bb40 0x7f06a01a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54242/0 (socket says 172.21.15.82:54242) 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.927+0000 7f0695400700 1 -- 172.21.15.82:0/2462306403 learned_addr learned my addr 172.21.15.82:0/2462306403 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.927+0000 7f069de00700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06a006b180 0x7f06a01a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.927+0000 7f069e800700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a0109510 0x7f06a019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.928+0000 7f0695400700 1 -- 172.21.15.82:0/2462306403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a0109510 msgr2=0x7f06a019bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.928+0000 7f0695400700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a0109510 0x7f06a019bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.928+0000 7f0695400700 1 -- 172.21.15.82:0/2462306403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06a006b180 msgr2=0x7f06a01a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.928+0000 7f0695400700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06a006b180 0x7f06a01a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.928+0000 7f0695400700 1 -- 172.21.15.82:0/2462306403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a019c240 con 0x7f06a006bb40 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.928+0000 7f069e800700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a0109510 0x7f06a019bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:13:47.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.928+0000 7f0695400700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a006bb40 0x7f06a01a1e60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f068800c970 tx=0x7f068800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:47.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.928+0000 7f0697400700 1 -- 172.21.15.82:0/2462306403 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0688007aa0 con 0x7f06a006bb40 2024-05-03T22:13:47.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.928+0000 7f0697400700 1 -- 172.21.15.82:0/2462306403 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0688004cc0 con 0x7f06a006bb40 2024-05-03T22:13:47.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.928+0000 7f0697400700 1 -- 172.21.15.82:0/2462306403 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0688005500 con 0x7f06a006bb40 2024-05-03T22:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.928+0000 7f06a4c00700 1 -- 172.21.15.82:0/2462306403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a019c530 con 0x7f06a006bb40 2024-05-03T22:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.929+0000 7f06a4c00700 1 -- 172.21.15.82:0/2462306403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a01a87f0 con 0x7f06a006bb40 2024-05-03T22:13:47.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.930+0000 7f06a4c00700 1 -- 172.21.15.82:0/2462306403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a006a190 con 0x7f06a006bb40 2024-05-03T22:13:47.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.932+0000 7f0697400700 1 -- 172.21.15.82:0/2462306403 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0688007c40 con 0x7f06a006bb40 2024-05-03T22:13:47.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.934+0000 7f0697400700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f06840b2880 0x7f06840b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.934+0000 7f0697400700 1 -- 172.21.15.82:0/2462306403 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7f06880e26c0 con 0x7f06a006bb40 2024-05-03T22:13:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.934+0000 7f069de00700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f06840b2880 0x7f06840b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.935+0000 7f069de00700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f06840b2880 0x7f06840b4d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f069000b5c0 tx=0x7f069001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:47.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:47.936+0000 7f0697400700 1 -- 172.21.15.82:0/2462306403 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f06880aa160 con 0x7f06a006bb40 2024-05-03T22:13:48.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.184+0000 7f06a4c00700 1 -- 172.21.15.82:0/2462306403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06a019cfd0 con 0x7f06a006bb40 2024-05-03T22:13:48.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:47 smithi082 ceph-mon[28404]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 315 B/s wr, 0 op/s 2024-05-03T22:13:48.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.187+0000 7f0697400700 1 -- 172.21.15.82:0/2462306403 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24560 (secure 0 0 0) 0x7f06a019cfd0 con 0x7f06a006bb40 2024-05-03T22:13:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:13:48.189 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:13:37.887665+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:12:30.512363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:12:34.936483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:12:50.095758+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:13:48.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.190+0000 7f06a4c00700 1 -- 172.21.15.82:0/2462306403 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f06840b2880 msgr2=0x7f06840b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:48.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.190+0000 7f06a4c00700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f06840b2880 0x7f06840b4d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f069000b5c0 tx=0x7f069001a040 comp rx=0 tx=0).stop 2024-05-03T22:13:48.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.190+0000 7f06a4c00700 1 -- 172.21.15.82:0/2462306403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a006bb40 msgr2=0x7f06a01a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:48.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.190+0000 7f06a4c00700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a006bb40 0x7f06a01a1e60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f068800c970 tx=0x7f068800cd30 comp rx=0 tx=0).stop 2024-05-03T22:13:48.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.191+0000 7f06a4c00700 1 -- 172.21.15.82:0/2462306403 shutdown_connections 2024-05-03T22:13:48.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.191+0000 7f06a4c00700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f06840b2880 0x7f06840b4d40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:48.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.191+0000 7f06a4c00700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06a0109510 0x7f06a019bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:48.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.191+0000 7f06a4c00700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06a006b180 0x7f06a01a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:48.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.191+0000 7f06a4c00700 1 --2- 172.21.15.82:0/2462306403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a006bb40 0x7f06a01a1e60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:48.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.191+0000 7f06a4c00700 1 -- 172.21.15.82:0/2462306403 >> 172.21.15.82:0/2462306403 conn(0x7f06a0079350 msgr2=0x7f06a010e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:48.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.191+0000 7f06a4c00700 1 -- 172.21.15.82:0/2462306403 shutdown_connections 2024-05-03T22:13:48.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:48.191+0000 7f06a4c00700 1 -- 172.21.15.82:0/2462306403 wait complete. 2024-05-03T22:13:48.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:47 smithi130 ceph-mon[32417]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 315 B/s wr, 0 op/s 2024-05-03T22:13:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:47 smithi116 ceph-mon[31828]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 315 B/s wr, 0 op/s 2024-05-03T22:13:49.188 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:13:49.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:48 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2462306403' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:49.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:48 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2462306403' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:49.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:48 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2462306403' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:49.634 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:50.048 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:49 smithi082 ceph-mon[28404]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 286 B/s wr, 0 op/s 2024-05-03T22:13:50.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:49 smithi130 ceph-mon[32417]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 286 B/s wr, 0 op/s 2024-05-03T22:13:50.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:49 smithi116 ceph-mon[31828]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 286 B/s wr, 0 op/s 2024-05-03T22:13:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.949+0000 7f4d1d200700 1 -- 172.21.15.82:0/1531545403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d1810a3a0 msgr2=0x7f4d18116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.949+0000 7f4d1d200700 1 --2- 172.21.15.82:0/1531545403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d1810a3a0 0x7f4d18116840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000b0a0 tx=0x7f4d1000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:13:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.950+0000 7f4d1d200700 1 -- 172.21.15.82:0/1531545403 shutdown_connections 2024-05-03T22:13:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.950+0000 7f4d1d200700 1 --2- 172.21.15.82:0/1531545403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d1810a3a0 0x7f4d18116840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.950+0000 7f4d1d200700 1 --2- 172.21.15.82:0/1531545403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d1810e8b0 0x7f4d1810ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.950+0000 7f4d1d200700 1 --2- 172.21.15.82:0/1531545403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d181099e0 0x7f4d18109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.950+0000 7f4d1d200700 1 -- 172.21.15.82:0/1531545403 >> 172.21.15.82:0/1531545403 conn(0x7f4d18079230 msgr2=0x7f4d181082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.950+0000 7f4d1d200700 1 -- 172.21.15.82:0/1531545403 shutdown_connections 2024-05-03T22:13:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.950+0000 7f4d1d200700 1 -- 172.21.15.82:0/1531545403 wait complete. 2024-05-03T22:13:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.951+0000 7f4d1d200700 1 Processor -- start 2024-05-03T22:13:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.951+0000 7f4d1d200700 1 -- start start 2024-05-03T22:13:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.951+0000 7f4d1d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181099e0 0x7f4d1819fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.951+0000 7f4d1d200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d1810a3a0 0x7f4d181a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.951+0000 7f4d1d200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d1810e8b0 0x7f4d181a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.951+0000 7f4d1d200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18119a30 con 0x7f4d181099e0 2024-05-03T22:13:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.951+0000 7f4d1d200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4d181198b0 con 0x7f4d1810e8b0 2024-05-03T22:13:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.951+0000 7f4d1d200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18119bb0 con 0x7f4d1810a3a0 2024-05-03T22:13:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.952+0000 7f4d17400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181099e0 0x7f4d1819fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.952+0000 7f4d17400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181099e0 0x7f4d1819fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54270/0 (socket says 172.21.15.82:54270) 2024-05-03T22:13:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.952+0000 7f4d17400700 1 -- 172.21.15.82:0/2710302428 learned_addr learned my addr 172.21.15.82:0/2710302428 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.952+0000 7f4d17e00700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d1810e8b0 0x7f4d181a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.952+0000 7f4d0fe00700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d1810a3a0 0x7f4d181a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.952+0000 7f4d17400700 1 -- 172.21.15.82:0/2710302428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d1810a3a0 msgr2=0x7f4d181a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.952+0000 7f4d17400700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d1810a3a0 0x7f4d181a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.952+0000 7f4d17400700 1 -- 172.21.15.82:0/2710302428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d1810e8b0 msgr2=0x7f4d181a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.952+0000 7f4d17400700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d1810e8b0 0x7f4d181a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.952+0000 7f4d17400700 1 -- 172.21.15.82:0/2710302428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d181a4e90 con 0x7f4d181099e0 2024-05-03T22:13:51.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.952+0000 7f4d17400700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181099e0 0x7f4d1819fe80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800c9b0 tx=0x7f4d0800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:51.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.953+0000 7f4d14c00700 1 -- 172.21.15.82:0/2710302428 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08007b00 con 0x7f4d181099e0 2024-05-03T22:13:51.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.953+0000 7f4d14c00700 1 -- 172.21.15.82:0/2710302428 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d08007ca0 con 0x7f4d181099e0 2024-05-03T22:13:51.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.953+0000 7f4d1d200700 1 -- 172.21.15.82:0/2710302428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d181a5180 con 0x7f4d181099e0 2024-05-03T22:13:51.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.953+0000 7f4d14c00700 1 -- 172.21.15.82:0/2710302428 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08018660 con 0x7f4d181099e0 2024-05-03T22:13:51.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.953+0000 7f4d1d200700 1 -- 172.21.15.82:0/2710302428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d181aca00 con 0x7f4d181099e0 2024-05-03T22:13:51.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.954+0000 7f4d1d200700 1 -- 172.21.15.82:0/2710302428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1806a190 con 0x7f4d181099e0 2024-05-03T22:13:51.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.956+0000 7f4d14c00700 1 -- 172.21.15.82:0/2710302428 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4d0800f450 con 0x7f4d181099e0 2024-05-03T22:13:51.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.958+0000 7f4d14c00700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4cfc0b2900 0x7f4cfc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:51.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.958+0000 7f4d14c00700 1 -- 172.21.15.82:0/2710302428 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7f4d080e2820 con 0x7f4d181099e0 2024-05-03T22:13:51.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.958+0000 7f4d0fe00700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4cfc0b2900 0x7f4cfc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:51.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.959+0000 7f4d0fe00700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4cfc0b2900 0x7f4cfc0b4dc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4d00005fd0 tx=0x7f4d0000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:51.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:51.960+0000 7f4d14c00700 1 -- 172.21.15.82:0/2710302428 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4d08014030 con 0x7f4d181099e0 2024-05-03T22:13:52.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.201+0000 7f4d1d200700 1 -- 172.21.15.82:0/2710302428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d181a11e0 con 0x7f4d181099e0 2024-05-03T22:13:52.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:51 smithi082 ceph-mon[28404]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-03T22:13:52.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.206+0000 7f4d14c00700 1 -- 172.21.15.82:0/2710302428 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24560 (secure 0 0 0) 0x7f4d080aa2b0 con 0x7f4d181099e0 2024-05-03T22:13:52.208 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:13:52.208 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:13:37.887665+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:12:30.512363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:12:34.936483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:12:50.095758+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:13:52.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 -- 172.21.15.82:0/2710302428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4cfc0b2900 msgr2=0x7f4cfc0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:52.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4cfc0b2900 0x7f4cfc0b4dc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4d00005fd0 tx=0x7f4d0000a560 comp rx=0 tx=0).stop 2024-05-03T22:13:52.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 -- 172.21.15.82:0/2710302428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181099e0 msgr2=0x7f4d1819fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:52.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181099e0 0x7f4d1819fe80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800c9b0 tx=0x7f4d0800cd70 comp rx=0 tx=0).stop 2024-05-03T22:13:52.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 -- 172.21.15.82:0/2710302428 shutdown_connections 2024-05-03T22:13:52.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4cfc0b2900 0x7f4cfc0b4dc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:52.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d181099e0 0x7f4d1819fe80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:52.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d1810e8b0 0x7f4d181a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:52.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 --2- 172.21.15.82:0/2710302428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4d1810a3a0 0x7f4d181a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 -- 172.21.15.82:0/2710302428 >> 172.21.15.82:0/2710302428 conn(0x7f4d18079230 msgr2=0x7f4d180797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 -- 172.21.15.82:0/2710302428 shutdown_connections 2024-05-03T22:13:52.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:52.209+0000 7f4d1d200700 1 -- 172.21.15.82:0/2710302428 wait complete. 2024-05-03T22:13:52.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:51 smithi130 ceph-mon[32417]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-03T22:13:52.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:51 smithi116 ceph-mon[31828]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-03T22:13:53.123 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-03T22:13:53.241 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:52 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2710302428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:53.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:52 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2710302428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:53.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:52 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2710302428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:13:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:54.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:53 smithi082 ceph-mon[28404]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:13:54.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:53 smithi130 ceph-mon[32417]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:13:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:53 smithi116 ceph-mon[31828]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:13:56.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:55 smithi130 ceph-mon[32417]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:13:56.079 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:55 smithi082 ceph-mon[28404]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:13:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.106+0000 7fa0bb000700 1 -- 172.21.15.82:0/2712172540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0b4106080 msgr2=0x7fa0b4112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.106+0000 7fa0bb000700 1 --2- 172.21.15.82:0/2712172540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0b4106080 0x7fa0b4112590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00b0a0 tx=0x7fa0ac00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:13:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.107+0000 7fa0bb000700 1 -- 172.21.15.82:0/2712172540 shutdown_connections 2024-05-03T22:13:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.107+0000 7fa0bb000700 1 --2- 172.21.15.82:0/2712172540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0b4106080 0x7fa0b4112590 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.107+0000 7fa0bb000700 1 --2- 172.21.15.82:0/2712172540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0b410b6c0 0x7fa0b410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.107+0000 7fa0bb000700 1 --2- 172.21.15.82:0/2712172540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b41056c0 0x7fa0b4105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.107+0000 7fa0bb000700 1 -- 172.21.15.82:0/2712172540 >> 172.21.15.82:0/2712172540 conn(0x7fa0b4101170 msgr2=0x7fa0b4103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.107+0000 7fa0bb000700 1 -- 172.21.15.82:0/2712172540 shutdown_connections 2024-05-03T22:13:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.107+0000 7fa0bb000700 1 -- 172.21.15.82:0/2712172540 wait complete. 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.108+0000 7fa0bb000700 1 Processor -- start 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.108+0000 7fa0bb000700 1 -- start start 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.108+0000 7fa0bb000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b41056c0 0x7fa0b41a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.108+0000 7fa0bb000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0b4106080 0x7fa0b41a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.108+0000 7fa0bb000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0b410b6c0 0x7fa0b419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.108+0000 7fa0bb000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4115770 con 0x7fa0b4106080 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.108+0000 7fa0bb000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b41155f0 con 0x7fa0b410b6c0 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.108+0000 7fa0bb000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b41158f0 con 0x7fa0b41056c0 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.109+0000 7fa0b3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0b4106080 0x7fa0b41a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.109+0000 7fa0b3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0b4106080 0x7fa0b41a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58292/0 (socket says 172.21.15.82:58292) 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.109+0000 7fa0b3400700 1 -- 172.21.15.82:0/3534724563 learned_addr learned my addr 172.21.15.82:0/3534724563 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:13:56.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.109+0000 7fa0b3e00700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b41056c0 0x7fa0b41a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:56.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.109+0000 7fa0b9000700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0b410b6c0 0x7fa0b419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:56.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.109+0000 7fa0b3400700 1 -- 172.21.15.82:0/3534724563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b41056c0 msgr2=0x7fa0b41a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.109+0000 7fa0b3400700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b41056c0 0x7fa0b41a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.109+0000 7fa0b3400700 1 -- 172.21.15.82:0/3534724563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0b410b6c0 msgr2=0x7fa0b419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.109+0000 7fa0b3400700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0b410b6c0 0x7fa0b419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.109+0000 7fa0b3400700 1 -- 172.21.15.82:0/3534724563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b419c230 con 0x7fa0b4106080 2024-05-03T22:13:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.109+0000 7fa0b9000700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0b410b6c0 0x7fa0b419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:13:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.110+0000 7fa0b3400700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0b4106080 0x7fa0b41a1e00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000d980 tx=0x7fa0a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.110+0000 7fa0b0c00700 1 -- 172.21.15.82:0/3534724563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0017070 con 0x7fa0b4106080 2024-05-03T22:13:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.110+0000 7fa0b0c00700 1 -- 172.21.15.82:0/3534724563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0a0005020 con 0x7fa0b4106080 2024-05-03T22:13:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.110+0000 7fa0bb000700 1 -- 172.21.15.82:0/3534724563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b419c520 con 0x7fa0b4106080 2024-05-03T22:13:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.110+0000 7fa0b0c00700 1 -- 172.21.15.82:0/3534724563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0009ab0 con 0x7fa0b4106080 2024-05-03T22:13:56.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.110+0000 7fa0bb000700 1 -- 172.21.15.82:0/3534724563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b41a8790 con 0x7fa0b4106080 2024-05-03T22:13:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.111+0000 7fa0bb000700 1 -- 172.21.15.82:0/3534724563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b406a190 con 0x7fa0b4106080 2024-05-03T22:13:56.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.117+0000 7fa0b0c00700 1 -- 172.21.15.82:0/3534724563 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa0a00051d0 con 0x7fa0b4106080 2024-05-03T22:13:56.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.118+0000 7fa0b0c00700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0980b2880 0x7fa0980b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:13:56.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.118+0000 7fa0b0c00700 1 -- 172.21.15.82:0/3534724563 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7fa0a00e28c0 con 0x7fa0b4106080 2024-05-03T22:13:56.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.118+0000 7fa0b3e00700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0980b2880 0x7fa0980b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:13:56.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.119+0000 7fa0b3e00700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0980b2880 0x7fa0980b4d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4103250 tx=0x7fa0a400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:13:56.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.120+0000 7fa0b0c00700 1 -- 172.21.15.82:0/3534724563 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa0a0020020 con 0x7fa0b4106080 2024-05-03T22:13:56.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:56.409+0000 7fa0bb000700 1 -- 172.21.15.82:0/3534724563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa0b402e510 con 0x7fa0b4106080 2024-05-03T22:13:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:55 smithi116 ceph-mon[31828]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:13:57.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.010+0000 7fa0b0c00700 1 -- 172.21.15.82:0/3534724563 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fa0a00aa240 con 0x7fa0b4106080 2024-05-03T22:13:57.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 -- 172.21.15.82:0/3534724563 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0980b2880 msgr2=0x7fa0980b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:57.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0980b2880 0x7fa0980b4d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4103250 tx=0x7fa0a400b410 comp rx=0 tx=0).stop 2024-05-03T22:13:57.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 -- 172.21.15.82:0/3534724563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0b4106080 msgr2=0x7fa0b41a1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:13:57.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0b4106080 0x7fa0b41a1e00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000d980 tx=0x7fa0a000dc90 comp rx=0 tx=0).stop 2024-05-03T22:13:57.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 -- 172.21.15.82:0/3534724563 shutdown_connections 2024-05-03T22:13:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fa0980b2880 0x7fa0980b4d40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0b410b6c0 0x7fa0b419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b41056c0 0x7fa0b41a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 --2- 172.21.15.82:0/3534724563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0b4106080 0x7fa0b41a1e00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:13:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 -- 172.21.15.82:0/3534724563 >> 172.21.15.82:0/3534724563 conn(0x7fa0b4101170 msgr2=0x7fa0b41019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:13:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 -- 172.21.15.82:0/3534724563 shutdown_connections 2024-05-03T22:13:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:13:57.015+0000 7fa0bb000700 1 -- 172.21.15.82:0/3534724563 wait complete. 2024-05-03T22:13:57.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:57 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3534724563' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-03T22:13:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:57 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3534724563' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-03T22:13:57.473 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:57 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3534724563' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-03T22:13:57.962 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-05-03T22:13:57.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-05-03T22:13:58.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:58 smithi082 ceph-mon[28404]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:13:58.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:58 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3534724563' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-03T22:13:58.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:13:58 smithi082 ceph-mon[28404]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:13:58.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:58 smithi130 ceph-mon[32417]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:13:58.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:58 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3534724563' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-03T22:13:58.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:13:58 smithi130 ceph-mon[32417]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:13:58.411 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:13:58.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:58 smithi116 ceph-mon[31828]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:13:58.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:58 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3534724563' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-03T22:13:58.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:13:58 smithi116 ceph-mon[31828]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:14:00.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:00 smithi130 ceph-mon[32417]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:14:00.321 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:00 smithi082 ceph-mon[28404]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:14:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:00 smithi116 ceph-mon[31828]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:14:00.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.984+0000 7f5592200700 1 -- 172.21.15.82:0/1889137040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f558c1060a0 msgr2=0x7f558c1125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:00.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.984+0000 7f5592200700 1 --2- 172.21.15.82:0/1889137040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f558c1060a0 0x7f558c1125b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f558400b0a0 tx=0x7f558400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:14:00.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.984+0000 7f5592200700 1 -- 172.21.15.82:0/1889137040 shutdown_connections 2024-05-03T22:14:00.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.984+0000 7f5592200700 1 --2- 172.21.15.82:0/1889137040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f558c1060a0 0x7f558c1125b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:00.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.984+0000 7f5592200700 1 --2- 172.21.15.82:0/1889137040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558c10b6e0 0x7f558c10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:00.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.984+0000 7f5592200700 1 --2- 172.21.15.82:0/1889137040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f558c1056e0 0x7f558c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:00.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.984+0000 7f5592200700 1 -- 172.21.15.82:0/1889137040 >> 172.21.15.82:0/1889137040 conn(0x7f558c1011d0 msgr2=0x7f558c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:00.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.984+0000 7f5592200700 1 -- 172.21.15.82:0/1889137040 shutdown_connections 2024-05-03T22:14:00.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.984+0000 7f5592200700 1 -- 172.21.15.82:0/1889137040 wait complete. 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.986+0000 7f5592200700 1 Processor -- start 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.986+0000 7f5592200700 1 -- start start 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.986+0000 7f5592200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f558c1056e0 0x7f558c1a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.986+0000 7f5592200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f558c1060a0 0x7f558c1a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.986+0000 7f5592200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558c10b6e0 0x7f558c19ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.986+0000 7f5592200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f558c1157d0 con 0x7f558c1060a0 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.986+0000 7f5592200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f558c115650 con 0x7f558c1056e0 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.986+0000 7f5592200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f558c115950 con 0x7f558c10b6e0 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.987+0000 7f558aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f558c1060a0 0x7f558c1a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.987+0000 7f558aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f558c1060a0 0x7f558c1a1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58316/0 (socket says 172.21.15.82:58316) 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.987+0000 7f558aa00700 1 -- 172.21.15.82:0/432281731 learned_addr learned my addr 172.21.15.82:0/432281731 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:00.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.987+0000 7f558b400700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f558c1056e0 0x7f558c1a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:00.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.987+0000 7f558be00700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558c10b6e0 0x7f558c19ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:00.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.987+0000 7f558aa00700 1 -- 172.21.15.82:0/432281731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558c10b6e0 msgr2=0x7f558c19ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:00.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.987+0000 7f558aa00700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558c10b6e0 0x7f558c19ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:00.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.987+0000 7f558aa00700 1 -- 172.21.15.82:0/432281731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f558c1056e0 msgr2=0x7f558c1a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:00.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.987+0000 7f558aa00700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f558c1056e0 0x7f558c1a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:00.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.987+0000 7f558aa00700 1 -- 172.21.15.82:0/432281731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558c19c190 con 0x7f558c1060a0 2024-05-03T22:14:00.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.987+0000 7f558aa00700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f558c1060a0 0x7f558c1a1db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f557800d950 tx=0x7f557800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:00.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.988+0000 7f5583e00700 1 -- 172.21.15.82:0/432281731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578016070 con 0x7f558c1060a0 2024-05-03T22:14:00.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.988+0000 7f5583e00700 1 -- 172.21.15.82:0/432281731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5578010460 con 0x7f558c1060a0 2024-05-03T22:14:00.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.988+0000 7f5592200700 1 -- 172.21.15.82:0/432281731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558c19c420 con 0x7f558c1060a0 2024-05-03T22:14:00.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.988+0000 7f5583e00700 1 -- 172.21.15.82:0/432281731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557800f620 con 0x7f558c1060a0 2024-05-03T22:14:00.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.988+0000 7f5592200700 1 -- 172.21.15.82:0/432281731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f558c1a8740 con 0x7f558c1060a0 2024-05-03T22:14:00.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.989+0000 7f5592200700 1 -- 172.21.15.82:0/432281731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f558c06a190 con 0x7f558c1060a0 2024-05-03T22:14:00.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.992+0000 7f5583e00700 1 -- 172.21.15.82:0/432281731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5578019070 con 0x7f558c1060a0 2024-05-03T22:14:00.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.994+0000 7f5583e00700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f55700b2900 0x7f55700b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:00.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.994+0000 7f5583e00700 1 -- 172.21.15.82:0/432281731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7f55780e2140 con 0x7f558c1060a0 2024-05-03T22:14:00.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.994+0000 7f558b400700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f55700b2900 0x7f55700b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:00.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.995+0000 7f558b400700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f55700b2900 0x7f55700b4dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f557c005fd0 tx=0x7f557c00af00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:00.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:00.998+0000 7f5583e00700 1 -- 172.21.15.82:0/432281731 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f55780a9ac0 con 0x7f558c1060a0 2024-05-03T22:14:01.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:01.278+0000 7f5592200700 1 -- 172.21.15.82:0/432281731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f558c02e510 con 0x7f558c1060a0 2024-05-03T22:14:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.047+0000 7f5583e00700 1 -- 172.21.15.82:0/432281731 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f55780a93c0 con 0x7f558c1060a0 2024-05-03T22:14:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.051+0000 7f5592200700 1 -- 172.21.15.82:0/432281731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f55700b2900 msgr2=0x7f55700b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.051+0000 7f5592200700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f55700b2900 0x7f55700b4dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f557c005fd0 tx=0x7f557c00af00 comp rx=0 tx=0).stop 2024-05-03T22:14:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.051+0000 7f5592200700 1 -- 172.21.15.82:0/432281731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f558c1060a0 msgr2=0x7f558c1a1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.051+0000 7f5592200700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f558c1060a0 0x7f558c1a1db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f557800d950 tx=0x7f557800dd10 comp rx=0 tx=0).stop 2024-05-03T22:14:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.051+0000 7f5592200700 1 -- 172.21.15.82:0/432281731 shutdown_connections 2024-05-03T22:14:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.051+0000 7f5592200700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f55700b2900 0x7f55700b4dc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.051+0000 7f5592200700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558c10b6e0 0x7f558c19ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.051+0000 7f5592200700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f558c1056e0 0x7f558c1a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.051+0000 7f5592200700 1 --2- 172.21.15.82:0/432281731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f558c1060a0 0x7f558c1a1db0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.051+0000 7f5592200700 1 -- 172.21.15.82:0/432281731 >> 172.21.15.82:0/432281731 conn(0x7f558c1011d0 msgr2=0x7f558c101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.052+0000 7f5592200700 1 -- 172.21.15.82:0/432281731 shutdown_connections 2024-05-03T22:14:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:02.052+0000 7f5592200700 1 -- 172.21.15.82:0/432281731 wait complete. 2024-05-03T22:14:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:02 smithi116 ceph-mon[31828]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:14:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:02 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/432281731' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-03T22:14:02.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:02 smithi082 ceph-mon[28404]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:14:02.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:02 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/432281731' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-03T22:14:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:02 smithi130 ceph-mon[32417]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:14:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:02 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/432281731' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-03T22:14:02.940 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-03T22:14:03.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:03 smithi082 ceph-mon[28404]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-03T22:14:03.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:03 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/432281731' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-03T22:14:03.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:03 smithi082 ceph-mon[28404]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-03T22:14:03.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:03 smithi082 ceph-mon[28404]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:14:03.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:03 smithi082 ceph-mon[28404]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-03T22:14:03.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:03 smithi082 ceph-mon[28404]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-03T22:14:03.337 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:03 smithi116 ceph-mon[31828]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-03T22:14:03.338 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:03 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/432281731' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-03T22:14:03.338 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:03 smithi116 ceph-mon[31828]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-03T22:14:03.338 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:03 smithi116 ceph-mon[31828]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:14:03.338 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:03 smithi116 ceph-mon[31828]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-03T22:14:03.338 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:03 smithi116 ceph-mon[31828]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-03T22:14:03.416 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:03.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:03 smithi130 ceph-mon[32417]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-03T22:14:03.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:03 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/432281731' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-03T22:14:03.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:03 smithi130 ceph-mon[32417]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-03T22:14:03.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:03 smithi130 ceph-mon[32417]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:14:03.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:03 smithi130 ceph-mon[32417]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-03T22:14:03.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:03 smithi130 ceph-mon[32417]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-03T22:14:04.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:04 smithi082 ceph-mon[28404]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:14:04.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:04 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] up:active 2024-05-03T22:14:04.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:04 smithi082 ceph-mon[28404]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-03T22:14:04.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:04 smithi082 ceph-mon[28404]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-03T22:14:04.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:04 smithi082 ceph-mon[28404]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-03T22:14:04.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:04 smithi082 ceph-mon[28404]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-03T22:14:04.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:04 smithi116 ceph-mon[31828]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:14:04.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:04 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] up:active 2024-05-03T22:14:04.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:04 smithi116 ceph-mon[31828]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-03T22:14:04.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:04 smithi116 ceph-mon[31828]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-03T22:14:04.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:04 smithi116 ceph-mon[31828]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-03T22:14:04.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:04 smithi116 ceph-mon[31828]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-03T22:14:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:04 smithi130 ceph-mon[32417]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:14:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:04 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] up:active 2024-05-03T22:14:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:04 smithi130 ceph-mon[32417]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-03T22:14:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:04 smithi130 ceph-mon[32417]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-03T22:14:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:04 smithi130 ceph-mon[32417]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-03T22:14:04.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:04 smithi130 ceph-mon[32417]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-03T22:14:05.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:05 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] up:active 2024-05-03T22:14:05.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:05 smithi082 ceph-mon[28404]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-03T22:14:05.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:05 smithi082 ceph-mon[28404]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-03T22:14:05.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:05 smithi082 ceph-mon[28404]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-03T22:14:05.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:05 smithi082 ceph-mon[28404]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-03T22:14:05.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:05 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] up:active 2024-05-03T22:14:05.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:05 smithi116 ceph-mon[31828]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-03T22:14:05.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:05 smithi116 ceph-mon[31828]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-03T22:14:05.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:05 smithi116 ceph-mon[31828]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-03T22:14:05.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:05 smithi116 ceph-mon[31828]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-03T22:14:05.530 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:05 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] up:active 2024-05-03T22:14:05.530 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:05 smithi130 ceph-mon[32417]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-03T22:14:05.530 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:05 smithi130 ceph-mon[32417]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-03T22:14:05.530 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:05 smithi130 ceph-mon[32417]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-03T22:14:05.530 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:05 smithi130 ceph-mon[32417]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-03T22:14:05.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.782+0000 7fd23d600700 1 -- 172.21.15.82:0/3790771554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23810b6e0 msgr2=0x7fd23810bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:05.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.782+0000 7fd23d600700 1 --2- 172.21.15.82:0/3790771554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23810b6e0 0x7fd23810bac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd228009990 tx=0x7fd228009ca0 comp rx=0 tx=0).stop 2024-05-03T22:14:05.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.783+0000 7fd23d600700 1 -- 172.21.15.82:0/3790771554 shutdown_connections 2024-05-03T22:14:05.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.783+0000 7fd23d600700 1 --2- 172.21.15.82:0/3790771554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd23810b6e0 0x7fd23810bac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:05.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.783+0000 7fd23d600700 1 --2- 172.21.15.82:0/3790771554 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2381060a0 0x7fd2381125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:05.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.783+0000 7fd23d600700 1 --2- 172.21.15.82:0/3790771554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2381056e0 0x7fd238105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:05.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.783+0000 7fd23d600700 1 -- 172.21.15.82:0/3790771554 >> 172.21.15.82:0/3790771554 conn(0x7fd2381011d0 msgr2=0x7fd2381035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:05.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.783+0000 7fd23d600700 1 -- 172.21.15.82:0/3790771554 shutdown_connections 2024-05-03T22:14:05.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.783+0000 7fd23d600700 1 -- 172.21.15.82:0/3790771554 wait complete. 2024-05-03T22:14:05.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.784+0000 7fd23d600700 1 Processor -- start 2024-05-03T22:14:05.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.784+0000 7fd23d600700 1 -- start start 2024-05-03T22:14:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.785+0000 7fd23d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2381056e0 0x7fd23819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.785+0000 7fd23d600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2381060a0 0x7fd23819c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.785+0000 7fd23d600700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd23810b6e0 0x7fd2381a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.785+0000 7fd23d600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd2381157e0 con 0x7fd2381056e0 2024-05-03T22:14:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.785+0000 7fd23d600700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd238115660 con 0x7fd23810b6e0 2024-05-03T22:14:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.785+0000 7fd23d600700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd238115960 con 0x7fd2381060a0 2024-05-03T22:14:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.785+0000 7fd236a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2381056e0 0x7fd23819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.786+0000 7fd236a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2381056e0 0x7fd23819bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33532/0 (socket says 172.21.15.82:33532) 2024-05-03T22:14:05.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.786+0000 7fd236a00700 1 -- 172.21.15.82:0/3770648424 learned_addr learned my addr 172.21.15.82:0/3770648424 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:05.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.786+0000 7fd237400700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd23810b6e0 0x7fd2381a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.786+0000 7fd236000700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2381060a0 0x7fd23819c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.786+0000 7fd236a00700 1 -- 172.21.15.82:0/3770648424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2381060a0 msgr2=0x7fd23819c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.786+0000 7fd236a00700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2381060a0 0x7fd23819c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.786+0000 7fd236a00700 1 -- 172.21.15.82:0/3770648424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd23810b6e0 msgr2=0x7fd2381a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.786+0000 7fd236a00700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd23810b6e0 0x7fd2381a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.786+0000 7fd236a00700 1 -- 172.21.15.82:0/3770648424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2381a0d20 con 0x7fd2381056e0 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.786+0000 7fd236a00700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2381056e0 0x7fd23819bd10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd228000c00 tx=0x7fd2280057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.787+0000 7fd22f400700 1 -- 172.21.15.82:0/3770648424 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228027070 con 0x7fd2381056e0 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.787+0000 7fd22f400700 1 -- 172.21.15.82:0/3770648424 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd22800fb00 con 0x7fd2381056e0 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.787+0000 7fd22f400700 1 -- 172.21.15.82:0/3770648424 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228022b70 con 0x7fd2381056e0 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.787+0000 7fd23d600700 1 -- 172.21.15.82:0/3770648424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2381a0fb0 con 0x7fd2381056e0 2024-05-03T22:14:05.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.787+0000 7fd23d600700 1 -- 172.21.15.82:0/3770648424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2381a8890 con 0x7fd2381056e0 2024-05-03T22:14:05.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.788+0000 7fd23d600700 1 -- 172.21.15.82:0/3770648424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23806a190 con 0x7fd2381056e0 2024-05-03T22:14:05.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.790+0000 7fd22f400700 1 -- 172.21.15.82:0/3770648424 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd228022d10 con 0x7fd2381056e0 2024-05-03T22:14:05.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.792+0000 7fd22f400700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd21c0b2900 0x7fd21c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:05.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.792+0000 7fd22f400700 1 -- 172.21.15.82:0/3770648424 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7fd2280e36b0 con 0x7fd2381056e0 2024-05-03T22:14:05.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.792+0000 7fd236000700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd21c0b2900 0x7fd21c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:05.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.793+0000 7fd236000700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd21c0b2900 0x7fd21c0b4dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd224005950 tx=0x7fd2240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:05.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:05.794+0000 7fd22f400700 1 -- 172.21.15.82:0/3770648424 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd228031080 con 0x7fd2381056e0 2024-05-03T22:14:06.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.065+0000 7fd23d600700 1 -- 172.21.15.82:0/3770648424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fd23802e510 con 0x7fd2381056e0 2024-05-03T22:14:06.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.110+0000 7fd22f400700 1 -- 172.21.15.82:0/3770648424 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7fd228013070 con 0x7fd2381056e0 2024-05-03T22:14:06.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.113+0000 7fd23d600700 1 -- 172.21.15.82:0/3770648424 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd21c0b2900 msgr2=0x7fd21c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:06.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.113+0000 7fd23d600700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd21c0b2900 0x7fd21c0b4dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd224005950 tx=0x7fd2240058e0 comp rx=0 tx=0).stop 2024-05-03T22:14:06.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.113+0000 7fd23d600700 1 -- 172.21.15.82:0/3770648424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2381056e0 msgr2=0x7fd23819bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:06.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.113+0000 7fd23d600700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2381056e0 0x7fd23819bd10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd228000c00 tx=0x7fd2280057a0 comp rx=0 tx=0).stop 2024-05-03T22:14:06.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.113+0000 7fd23d600700 1 -- 172.21.15.82:0/3770648424 shutdown_connections 2024-05-03T22:14:06.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.113+0000 7fd23d600700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd21c0b2900 0x7fd21c0b4dc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:06.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.113+0000 7fd23d600700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2381056e0 0x7fd23819bd10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:06.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.113+0000 7fd23d600700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd23810b6e0 0x7fd2381a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:06.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.113+0000 7fd23d600700 1 --2- 172.21.15.82:0/3770648424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd2381060a0 0x7fd23819c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:06.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.113+0000 7fd23d600700 1 -- 172.21.15.82:0/3770648424 >> 172.21.15.82:0/3770648424 conn(0x7fd2381011d0 msgr2=0x7fd238101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:06.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.114+0000 7fd23d600700 1 -- 172.21.15.82:0/3770648424 shutdown_connections 2024-05-03T22:14:06.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:06.114+0000 7fd23d600700 1 -- 172.21.15.82:0/3770648424 wait complete. 2024-05-03T22:14:06.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:06 smithi130 ceph-mon[32417]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 1 op/s 2024-05-03T22:14:06.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:06 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] up:active 2024-05-03T22:14:06.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:06 smithi130 ceph-mon[32417]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-03T22:14:06.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:06 smithi130 ceph-mon[32417]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-03T22:14:06.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:06 smithi130 ceph-mon[32417]: Cluster is now healthy 2024-05-03T22:14:06.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:06 smithi130 ceph-mon[32417]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-03T22:14:06.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:06 smithi130 ceph-mon[32417]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-03T22:14:06.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:06 smithi130 ceph-mon[32417]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-03T22:14:06.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:06 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3770648424' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-03T22:14:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:06 smithi116 ceph-mon[31828]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 1 op/s 2024-05-03T22:14:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:06 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] up:active 2024-05-03T22:14:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:06 smithi116 ceph-mon[31828]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-03T22:14:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:06 smithi116 ceph-mon[31828]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-03T22:14:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:06 smithi116 ceph-mon[31828]: Cluster is now healthy 2024-05-03T22:14:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:06 smithi116 ceph-mon[31828]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-03T22:14:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:06 smithi116 ceph-mon[31828]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-03T22:14:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:06 smithi116 ceph-mon[31828]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-03T22:14:06.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:06 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3770648424' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-03T22:14:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:06 smithi082 ceph-mon[28404]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 1 op/s 2024-05-03T22:14:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:06 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] up:active 2024-05-03T22:14:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:06 smithi082 ceph-mon[28404]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-03T22:14:06.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:06 smithi082 ceph-mon[28404]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-03T22:14:06.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:06 smithi082 ceph-mon[28404]: Cluster is now healthy 2024-05-03T22:14:06.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:06 smithi082 ceph-mon[28404]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-03T22:14:06.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:06 smithi082 ceph-mon[28404]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-03T22:14:06.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:06 smithi082 ceph-mon[28404]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-03T22:14:06.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:06 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3770648424' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-03T22:14:07.000 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-03T22:14:07.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:07 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3770648424' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-03T22:14:07.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:07 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] up:active 2024-05-03T22:14:07.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:07 smithi082 ceph-mon[28404]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T22:14:07.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:07 smithi082 ceph-mon[28404]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:14:07.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:07 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3770648424' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-03T22:14:07.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:07 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] up:active 2024-05-03T22:14:07.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:07 smithi116 ceph-mon[31828]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T22:14:07.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:07 smithi116 ceph-mon[31828]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:14:07.445 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:07.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:07 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3770648424' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-03T22:14:07.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:07 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] up:active 2024-05-03T22:14:07.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:07 smithi130 ceph-mon[32417]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T22:14:07.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:07 smithi130 ceph-mon[32417]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:14:08.128 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:14:07 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b[62451]: 2024-05-03T22:14:07.732+0000 7f4291a00700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-03T22:14:08.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:08 smithi116 ceph-mon[31828]: pgmap v425: 129 pgs: 129 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.3 KiB/s wr, 9 op/s 2024-05-03T22:14:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:08 smithi082 ceph-mon[28404]: pgmap v425: 129 pgs: 129 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.3 KiB/s wr, 9 op/s 2024-05-03T22:14:08.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:08 smithi130 ceph-mon[32417]: pgmap v425: 129 pgs: 129 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.3 KiB/s wr, 9 op/s 2024-05-03T22:14:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.946+0000 7f135a400700 1 -- 172.21.15.82:0/3190111845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13541056c0 msgr2=0x7f1354105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.946+0000 7f135a400700 1 --2- 172.21.15.82:0/3190111845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13541056c0 0x7f1354105b40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f133c009990 tx=0x7f133c009ca0 comp rx=0 tx=0).stop 2024-05-03T22:14:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.946+0000 7f135a400700 1 -- 172.21.15.82:0/3190111845 shutdown_connections 2024-05-03T22:14:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.946+0000 7f135a400700 1 --2- 172.21.15.82:0/3190111845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1354106080 0x7f1354112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.946+0000 7f135a400700 1 --2- 172.21.15.82:0/3190111845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f135410b6c0 0x7f135410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.946+0000 7f135a400700 1 --2- 172.21.15.82:0/3190111845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13541056c0 0x7f1354105b40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.946+0000 7f135a400700 1 -- 172.21.15.82:0/3190111845 >> 172.21.15.82:0/3190111845 conn(0x7f13541011b0 msgr2=0x7f13541035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.946+0000 7f135a400700 1 -- 172.21.15.82:0/3190111845 shutdown_connections 2024-05-03T22:14:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.946+0000 7f135a400700 1 -- 172.21.15.82:0/3190111845 wait complete. 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.947+0000 7f135a400700 1 Processor -- start 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.948+0000 7f135a400700 1 -- start start 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.948+0000 7f135a400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13541056c0 0x7f13541a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.948+0000 7f135a400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1354106080 0x7f13541a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.948+0000 7f135a400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f135410b6c0 0x7f135419ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.948+0000 7f135a400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1354115750 con 0x7f1354106080 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.948+0000 7f135a400700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f13541155d0 con 0x7f13541056c0 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.948+0000 7f135a400700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13541158d0 con 0x7f135410b6c0 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.948+0000 7f134aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1354106080 0x7f13541a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.948+0000 7f134aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1354106080 0x7f13541a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33552/0 (socket says 172.21.15.82:33552) 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.948+0000 7f134aa00700 1 -- 172.21.15.82:0/4226690751 learned_addr learned my addr 172.21.15.82:0/4226690751 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.949+0000 7f1353e00700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f135410b6c0 0x7f135419ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.949+0000 7f1353400700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13541056c0 0x7f13541a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:09.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.949+0000 7f134aa00700 1 -- 172.21.15.82:0/4226690751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f135410b6c0 msgr2=0x7f135419ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:09.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.949+0000 7f134aa00700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f135410b6c0 0x7f135419ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:09.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.949+0000 7f134aa00700 1 -- 172.21.15.82:0/4226690751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13541056c0 msgr2=0x7f13541a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:09.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.949+0000 7f134aa00700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13541056c0 0x7f13541a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:09.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.949+0000 7f134aa00700 1 -- 172.21.15.82:0/4226690751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135419c170 con 0x7f1354106080 2024-05-03T22:14:09.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.949+0000 7f1353400700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13541056c0 0x7f13541a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:14:09.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.949+0000 7f134aa00700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1354106080 0x7f13541a1d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f133c000c00 tx=0x7f133c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:09.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.950+0000 7f1350c00700 1 -- 172.21.15.82:0/4226690751 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c027070 con 0x7f1354106080 2024-05-03T22:14:09.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.950+0000 7f135a400700 1 -- 172.21.15.82:0/4226690751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135419c400 con 0x7f1354106080 2024-05-03T22:14:09.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.950+0000 7f1350c00700 1 -- 172.21.15.82:0/4226690751 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f133c00fdb0 con 0x7f1354106080 2024-05-03T22:14:09.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.950+0000 7f1350c00700 1 -- 172.21.15.82:0/4226690751 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c0173f0 con 0x7f1354106080 2024-05-03T22:14:09.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.950+0000 7f135a400700 1 -- 172.21.15.82:0/4226690751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13541a8720 con 0x7f1354106080 2024-05-03T22:14:09.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.951+0000 7f135a400700 1 -- 172.21.15.82:0/4226690751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f135406a190 con 0x7f1354106080 2024-05-03T22:14:09.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.954+0000 7f1350c00700 1 -- 172.21.15.82:0/4226690751 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f133c02a070 con 0x7f1354106080 2024-05-03T22:14:09.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.955+0000 7f1350c00700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13380b2880 0x7f13380b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:09.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.955+0000 7f1350c00700 1 -- 172.21.15.82:0/4226690751 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7f133c0e3b90 con 0x7f1354106080 2024-05-03T22:14:09.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.955+0000 7f1353400700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13380b2880 0x7f13380b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:09.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.956+0000 7f1353400700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13380b2880 0x7f13380b4d40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1344005fd0 tx=0x7f1344005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:09.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:09.958+0000 7f1350c00700 1 -- 172.21.15.82:0/4226690751 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f133c031070 con 0x7f1354106080 2024-05-03T22:14:10.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:10.242+0000 7f135a400700 1 -- 172.21.15.82:0/4226690751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f135402e510 con 0x7f1354106080 2024-05-03T22:14:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:10 smithi116 ceph-mon[31828]: pgmap v426: 129 pgs: 129 active+clean; 586 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-05-03T22:14:10.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:10 smithi082 ceph-mon[28404]: pgmap v426: 129 pgs: 129 active+clean; 586 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-05-03T22:14:10.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:10 smithi130 ceph-mon[32417]: pgmap v426: 129 pgs: 129 active+clean; 586 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-05-03T22:14:11.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.145+0000 7f1350c00700 1 -- 172.21.15.82:0/4226690751 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7f133c013070 con 0x7f1354106080 2024-05-03T22:14:11.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.149+0000 7f135a400700 1 -- 172.21.15.82:0/4226690751 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13380b2880 msgr2=0x7f13380b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.149+0000 7f135a400700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13380b2880 0x7f13380b4d40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1344005fd0 tx=0x7f1344005dc0 comp rx=0 tx=0).stop 2024-05-03T22:14:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.149+0000 7f135a400700 1 -- 172.21.15.82:0/4226690751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1354106080 msgr2=0x7f13541a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.149+0000 7f135a400700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1354106080 0x7f13541a1d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f133c000c00 tx=0x7f133c0047b0 comp rx=0 tx=0).stop 2024-05-03T22:14:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.149+0000 7f135a400700 1 -- 172.21.15.82:0/4226690751 shutdown_connections 2024-05-03T22:14:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.149+0000 7f135a400700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f13380b2880 0x7f13380b4d40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.150+0000 7f135a400700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f135410b6c0 0x7f135419ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.150+0000 7f135a400700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13541056c0 0x7f13541a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.150+0000 7f135a400700 1 --2- 172.21.15.82:0/4226690751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1354106080 0x7f13541a1d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.150+0000 7f135a400700 1 -- 172.21.15.82:0/4226690751 >> 172.21.15.82:0/4226690751 conn(0x7f13541011b0 msgr2=0x7f1354101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.150+0000 7f135a400700 1 -- 172.21.15.82:0/4226690751 shutdown_connections 2024-05-03T22:14:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:11.150+0000 7f135a400700 1 -- 172.21.15.82:0/4226690751 wait complete. 2024-05-03T22:14:11.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:11 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/4226690751' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-03T22:14:11.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:11 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/4226690751' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-03T22:14:11.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:11 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/4226690751' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-03T22:14:12.089 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-05-03T22:14:12.090 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-03T22:14:12.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:12 smithi116 ceph-mon[31828]: pgmap v427: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-03T22:14:12.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:12 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/4226690751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-03T22:14:12.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:12 smithi116 ceph-mon[31828]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:14:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:12 smithi082 ceph-mon[28404]: pgmap v427: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-03T22:14:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:12 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/4226690751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-03T22:14:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:12 smithi082 ceph-mon[28404]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:14:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:12 smithi130 ceph-mon[32417]: pgmap v427: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2024-05-03T22:14:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:12 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/4226690751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-03T22:14:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:12 smithi130 ceph-mon[32417]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:14:12.549 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:14.337 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:14 smithi082 ceph-mon[28404]: pgmap v428: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-03T22:14:14.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:14 smithi116 ceph-mon[31828]: pgmap v428: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-03T22:14:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:14 smithi130 ceph-mon[32417]: pgmap v428: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-03T22:14:14.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.957+0000 7fb52f000700 1 -- 172.21.15.82:0/1829448103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52810ff10 msgr2=0x7fb528112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:14.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.957+0000 7fb52f000700 1 --2- 172.21.15.82:0/1829448103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52810ff10 0x7fb528112300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb52000b0a0 tx=0x7fb52000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:14:14.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.958+0000 7fb52f000700 1 -- 172.21.15.82:0/1829448103 shutdown_connections 2024-05-03T22:14:14.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.958+0000 7fb52f000700 1 --2- 172.21.15.82:0/1829448103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52810ff10 0x7fb528112300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:14.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.958+0000 7fb52f000700 1 --2- 172.21.15.82:0/1829448103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5280756d0 0x7fb528075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:14.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.958+0000 7fb52f000700 1 --2- 172.21.15.82:0/1829448103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528075ff0 0x7fb52810f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:14.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.958+0000 7fb52f000700 1 -- 172.21.15.82:0/1829448103 >> 172.21.15.82:0/1829448103 conn(0x7fb52807a660 msgr2=0x7fb52807aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:14.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.958+0000 7fb52f000700 1 -- 172.21.15.82:0/1829448103 shutdown_connections 2024-05-03T22:14:14.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.958+0000 7fb52f000700 1 -- 172.21.15.82:0/1829448103 wait complete. 2024-05-03T22:14:14.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.959+0000 7fb52f000700 1 Processor -- start 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.960+0000 7fb52f000700 1 -- start start 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.960+0000 7fb52f000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5280756d0 0x7fb5281a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.960+0000 7fb52f000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528075ff0 0x7fb5281a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.960+0000 7fb52f000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52810ff10 0x7fb52819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.960+0000 7fb52f000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb528115730 con 0x7fb52810ff10 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.960+0000 7fb52f000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb5281155b0 con 0x7fb528075ff0 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.960+0000 7fb52f000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5281158b0 con 0x7fb5280756d0 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.961+0000 7fb52d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52810ff10 0x7fb52819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.961+0000 7fb52d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52810ff10 0x7fb52819ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51898/0 (socket says 172.21.15.82:51898) 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.961+0000 7fb52d000700 1 -- 172.21.15.82:0/3807006185 learned_addr learned my addr 172.21.15.82:0/3807006185 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.961+0000 7fb527400700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528075ff0 0x7fb5281a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.961+0000 7fb527e00700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5280756d0 0x7fb5281a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:14.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.961+0000 7fb52d000700 1 -- 172.21.15.82:0/3807006185 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5280756d0 msgr2=0x7fb5281a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:14.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.961+0000 7fb52d000700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5280756d0 0x7fb5281a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:14.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.961+0000 7fb52d000700 1 -- 172.21.15.82:0/3807006185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528075ff0 msgr2=0x7fb5281a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:14.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.961+0000 7fb52d000700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528075ff0 0x7fb5281a1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:14.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.961+0000 7fb52d000700 1 -- 172.21.15.82:0/3807006185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52819c190 con 0x7fb52810ff10 2024-05-03T22:14:14.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.961+0000 7fb52d000700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52810ff10 0x7fb52819ba30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb520004dc0 tx=0x7fb520004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:14.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.962+0000 7fb524c00700 1 -- 172.21.15.82:0/3807006185 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb520021020 con 0x7fb52810ff10 2024-05-03T22:14:14.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.962+0000 7fb52f000700 1 -- 172.21.15.82:0/3807006185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb52819c420 con 0x7fb52810ff10 2024-05-03T22:14:14.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.962+0000 7fb524c00700 1 -- 172.21.15.82:0/3807006185 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb520007cf0 con 0x7fb52810ff10 2024-05-03T22:14:14.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.962+0000 7fb52f000700 1 -- 172.21.15.82:0/3807006185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5281a86f0 con 0x7fb52810ff10 2024-05-03T22:14:14.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.962+0000 7fb524c00700 1 -- 172.21.15.82:0/3807006185 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb520005110 con 0x7fb52810ff10 2024-05-03T22:14:14.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.963+0000 7fb52f000700 1 -- 172.21.15.82:0/3807006185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb52806a190 con 0x7fb52810ff10 2024-05-03T22:14:14.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.965+0000 7fb524c00700 1 -- 172.21.15.82:0/3807006185 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb520024020 con 0x7fb52810ff10 2024-05-03T22:14:14.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.968+0000 7fb524c00700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb50c0b2880 0x7fb50c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.968+0000 7fb524c00700 1 -- 172.21.15.82:0/3807006185 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7fb5200e3a90 con 0x7fb52810ff10 2024-05-03T22:14:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.968+0000 7fb527e00700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb50c0b2880 0x7fb50c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:14.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.969+0000 7fb527e00700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb50c0b2880 0x7fb50c0b4d40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb518005ea0 tx=0x7fb518005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:14.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:14.971+0000 7fb524c00700 1 -- 172.21.15.82:0/3807006185 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb5200074e0 con 0x7fb52810ff10 2024-05-03T22:14:15.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.247+0000 7fb52f000700 1 -- 172.21.15.82:0/3807006185 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb5280638e0 con 0x7fb50c0b2880 2024-05-03T22:14:15.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.326+0000 7fb524c00700 1 -- 172.21.15.82:0/3807006185 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb5280638e0 con 0x7fb50c0b2880 2024-05-03T22:14:15.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.330+0000 7fb52f000700 1 -- 172.21.15.82:0/3807006185 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb50c0b2880 msgr2=0x7fb50c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:15.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.330+0000 7fb52f000700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb50c0b2880 0x7fb50c0b4d40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb518005ea0 tx=0x7fb518005e30 comp rx=0 tx=0).stop 2024-05-03T22:14:15.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.330+0000 7fb52f000700 1 -- 172.21.15.82:0/3807006185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52810ff10 msgr2=0x7fb52819ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:15.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.330+0000 7fb52f000700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52810ff10 0x7fb52819ba30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb520004dc0 tx=0x7fb520004ea0 comp rx=0 tx=0).stop 2024-05-03T22:14:15.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.330+0000 7fb52f000700 1 -- 172.21.15.82:0/3807006185 shutdown_connections 2024-05-03T22:14:15.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.330+0000 7fb52f000700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb50c0b2880 0x7fb50c0b4d40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:15.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.330+0000 7fb52f000700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52810ff10 0x7fb52819ba30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:15.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.330+0000 7fb52f000700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5280756d0 0x7fb5281a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:15.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.330+0000 7fb52f000700 1 --2- 172.21.15.82:0/3807006185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb528075ff0 0x7fb5281a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:15.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.330+0000 7fb52f000700 1 -- 172.21.15.82:0/3807006185 >> 172.21.15.82:0/3807006185 conn(0x7fb52807a660 msgr2=0x7fb528101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:15.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.330+0000 7fb52f000700 1 -- 172.21.15.82:0/3807006185 shutdown_connections 2024-05-03T22:14:15.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:15.331+0000 7fb52f000700 1 -- 172.21.15.82:0/3807006185 wait complete. 2024-05-03T22:14:15.729 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:14:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:14:15.263+0000 7f2b3a400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T22:14:15.729 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:14:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:14:15.263+0000 7f2b3a400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T22:14:15.729 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:14:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:14:15.263+0000 7f2b3a400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T22:14:15.729 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:14:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:14:15.263+0000 7f2b3a400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T22:14:15.729 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:14:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:14:15.263+0000 7f2b3a400700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T22:14:16.262 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-03T22:14:16.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:16 smithi116 ceph-mon[31828]: pgmap v429: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.9 KiB/s wr, 20 op/s 2024-05-03T22:14:16.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:16 smithi116 ceph-mon[31828]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:16 smithi082 ceph-mon[28404]: pgmap v429: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.9 KiB/s wr, 20 op/s 2024-05-03T22:14:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:16 smithi082 ceph-mon[28404]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:16 smithi130 ceph-mon[32417]: pgmap v429: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.9 KiB/s wr, 20 op/s 2024-05-03T22:14:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:16 smithi130 ceph-mon[32417]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:16.719 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:18.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:18 smithi082 ceph-mon[28404]: pgmap v430: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-05-03T22:14:18.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:18 smithi082 ceph-mon[28404]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-03T22:14:18.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:18 smithi130 ceph-mon[32417]: pgmap v430: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-05-03T22:14:18.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:18 smithi130 ceph-mon[32417]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-03T22:14:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:18 smithi116 ceph-mon[31828]: pgmap v430: 129 pgs: 129 active+clean; 587 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-05-03T22:14:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:18 smithi116 ceph-mon[31828]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-03T22:14:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.136+0000 7eff06c00700 1 -- 172.21.15.82:0/864006344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff001020a0 msgr2=0x7eff00102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.136+0000 7eff06c00700 1 --2- 172.21.15.82:0/864006344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff001020a0 0x7eff00102480 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efef00099c0 tx=0x7efef0009cd0 comp rx=0 tx=0).stop 2024-05-03T22:14:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.137+0000 7eff06c00700 1 -- 172.21.15.82:0/864006344 shutdown_connections 2024-05-03T22:14:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.137+0000 7eff06c00700 1 --2- 172.21.15.82:0/864006344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff001020a0 0x7eff00102480 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.137+0000 7eff06c00700 1 --2- 172.21.15.82:0/864006344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff0010bce0 0x7eff001126b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.137+0000 7eff06c00700 1 --2- 172.21.15.82:0/864006344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff00102a50 0x7eff0010b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.137+0000 7eff06c00700 1 -- 172.21.15.82:0/864006344 >> 172.21.15.82:0/864006344 conn(0x7eff00077740 msgr2=0x7eff00077b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.137+0000 7eff06c00700 1 -- 172.21.15.82:0/864006344 shutdown_connections 2024-05-03T22:14:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.137+0000 7eff06c00700 1 -- 172.21.15.82:0/864006344 wait complete. 2024-05-03T22:14:19.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.138+0000 7eff06c00700 1 Processor -- start 2024-05-03T22:14:19.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.138+0000 7eff06c00700 1 -- start start 2024-05-03T22:14:19.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.139+0000 7eff06c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff001020a0 0x7eff001a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:19.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.139+0000 7eff06c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff00102a50 0x7eff001a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:19.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.139+0000 7eff06c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff0010bce0 0x7eff0019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:19.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.139+0000 7eff06c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff001157f0 con 0x7eff00102a50 2024-05-03T22:14:19.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.139+0000 7eff06c00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7eff00115670 con 0x7eff001020a0 2024-05-03T22:14:19.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.139+0000 7eff06c00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff00115970 con 0x7eff0010bce0 2024-05-03T22:14:19.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.139+0000 7efef7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff00102a50 0x7eff001a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:19.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.139+0000 7efef7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff00102a50 0x7eff001a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51932/0 (socket says 172.21.15.82:51932) 2024-05-03T22:14:19.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.139+0000 7efef7e00700 1 -- 172.21.15.82:0/3061156490 learned_addr learned my addr 172.21.15.82:0/3061156490 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:19.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.140+0000 7efeffe00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff001020a0 0x7eff001a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:19.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.140+0000 7eff04c00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff0010bce0 0x7eff0019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:19.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.140+0000 7efef7e00700 1 -- 172.21.15.82:0/3061156490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff0010bce0 msgr2=0x7eff0019bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:19.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.140+0000 7efef7e00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff0010bce0 0x7eff0019bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:19.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.140+0000 7efef7e00700 1 -- 172.21.15.82:0/3061156490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff001020a0 msgr2=0x7eff001a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:19.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.140+0000 7efef7e00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff001020a0 0x7eff001a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:19.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.140+0000 7efef7e00700 1 -- 172.21.15.82:0/3061156490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0019c210 con 0x7eff00102a50 2024-05-03T22:14:19.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.140+0000 7eff04c00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff0010bce0 0x7eff0019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:14:19.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.140+0000 7efef7e00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff00102a50 0x7eff001a1e30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efee800d950 tx=0x7efee800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:19.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.141+0000 7efefd600700 1 -- 172.21.15.82:0/3061156490 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8017070 con 0x7eff00102a50 2024-05-03T22:14:19.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.141+0000 7efefd600700 1 -- 172.21.15.82:0/3061156490 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efee8009dc0 con 0x7eff00102a50 2024-05-03T22:14:19.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.141+0000 7efefd600700 1 -- 172.21.15.82:0/3061156490 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee800f3c0 con 0x7eff00102a50 2024-05-03T22:14:19.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.141+0000 7eff06c00700 1 -- 172.21.15.82:0/3061156490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0019c500 con 0x7eff00102a50 2024-05-03T22:14:19.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.141+0000 7eff06c00700 1 -- 172.21.15.82:0/3061156490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff001a87c0 con 0x7eff00102a50 2024-05-03T22:14:19.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.142+0000 7eff06c00700 1 -- 172.21.15.82:0/3061156490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff0006b700 con 0x7eff00102a50 2024-05-03T22:14:19.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.144+0000 7efefd600700 1 -- 172.21.15.82:0/3061156490 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7efee801a070 con 0x7eff00102a50 2024-05-03T22:14:19.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.146+0000 7efefd600700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efee40b2990 0x7efee40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:19.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.146+0000 7efefd600700 1 -- 172.21.15.82:0/3061156490 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7efee80e1f30 con 0x7eff00102a50 2024-05-03T22:14:19.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.146+0000 7efeffe00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efee40b2990 0x7efee40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:19.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.147+0000 7efeffe00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efee40b2990 0x7efee40b4e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff0019cbf0 tx=0x7efef001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:19.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.149+0000 7efefd600700 1 -- 172.21.15.82:0/3061156490 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7efee80a97d0 con 0x7eff00102a50 2024-05-03T22:14:19.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.422+0000 7eff06c00700 1 -- 172.21.15.82:0/3061156490 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7eff000638e0 con 0x7efee40b2990 2024-05-03T22:14:19.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.491+0000 7efefd600700 1 -- 172.21.15.82:0/3061156490 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7eff000638e0 con 0x7efee40b2990 2024-05-03T22:14:19.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.494+0000 7eff06c00700 1 -- 172.21.15.82:0/3061156490 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efee40b2990 msgr2=0x7efee40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:19.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.494+0000 7eff06c00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efee40b2990 0x7efee40b4e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff0019cbf0 tx=0x7efef001a040 comp rx=0 tx=0).stop 2024-05-03T22:14:19.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.494+0000 7eff06c00700 1 -- 172.21.15.82:0/3061156490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff00102a50 msgr2=0x7eff001a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:19.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.494+0000 7eff06c00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff00102a50 0x7eff001a1e30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efee800d950 tx=0x7efee800dc60 comp rx=0 tx=0).stop 2024-05-03T22:14:19.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.495+0000 7eff06c00700 1 -- 172.21.15.82:0/3061156490 shutdown_connections 2024-05-03T22:14:19.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.495+0000 7eff06c00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efee40b2990 0x7efee40b4e50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:19.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.495+0000 7eff06c00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff0010bce0 0x7eff0019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:19.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.495+0000 7eff06c00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff001020a0 0x7eff001a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:19.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.495+0000 7eff06c00700 1 --2- 172.21.15.82:0/3061156490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff00102a50 0x7eff001a1e30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:19.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.495+0000 7eff06c00700 1 -- 172.21.15.82:0/3061156490 >> 172.21.15.82:0/3061156490 conn(0x7eff00077740 msgr2=0x7eff00109850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:19.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.495+0000 7eff06c00700 1 -- 172.21.15.82:0/3061156490 shutdown_connections 2024-05-03T22:14:19.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:19.495+0000 7eff06c00700 1 -- 172.21.15.82:0/3061156490 wait complete. 2024-05-03T22:14:20.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:20 smithi082 ceph-mon[28404]: pgmap v431: 129 pgs: 129 active+clean; 588 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-05-03T22:14:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:20 smithi130 ceph-mon[32417]: pgmap v431: 129 pgs: 129 active+clean; 588 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-05-03T22:14:20.540 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-03T22:14:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:20 smithi116 ceph-mon[31828]: pgmap v431: 129 pgs: 129 active+clean; 588 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-05-03T22:14:20.980 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:21.473 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:21 smithi082 ceph-mon[28404]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:21 smithi130 ceph-mon[32417]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:21.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:21 smithi116 ceph-mon[31828]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:22.434 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:22 smithi082 ceph-mon[28404]: pgmap v432: 129 pgs: 129 active+clean; 608 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-05-03T22:14:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:22 smithi130 ceph-mon[32417]: pgmap v432: 129 pgs: 129 active+clean; 608 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-05-03T22:14:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:22 smithi116 ceph-mon[31828]: pgmap v432: 129 pgs: 129 active+clean; 608 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-05-03T22:14:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.323+0000 7f073ac00700 1 -- 172.21.15.82:0/346573142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0734075840 msgr2=0x7f0734075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.323+0000 7f073ac00700 1 --2- 172.21.15.82:0/346573142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0734075840 0x7f0734075c20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0728009990 tx=0x7f0728009ca0 comp rx=0 tx=0).stop 2024-05-03T22:14:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.324+0000 7f073ac00700 1 -- 172.21.15.82:0/346573142 shutdown_connections 2024-05-03T22:14:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.324+0000 7f073ac00700 1 --2- 172.21.15.82:0/346573142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0734075840 0x7f0734075c20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.324+0000 7f073ac00700 1 --2- 172.21.15.82:0/346573142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07341143e0 0x7f07341167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.324+0000 7f073ac00700 1 --2- 172.21.15.82:0/346573142 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0734076160 0x7f0734113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.324+0000 7f073ac00700 1 -- 172.21.15.82:0/346573142 >> 172.21.15.82:0/346573142 conn(0x7f07340fef20 msgr2=0x7f0734101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.324+0000 7f073ac00700 1 -- 172.21.15.82:0/346573142 shutdown_connections 2024-05-03T22:14:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.324+0000 7f073ac00700 1 -- 172.21.15.82:0/346573142 wait complete. 2024-05-03T22:14:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.325+0000 7f073ac00700 1 Processor -- start 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.325+0000 7f073ac00700 1 -- start start 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.326+0000 7f073ac00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0734075840 0x7f07341a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.326+0000 7f073ac00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0734076160 0x7f07341a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.326+0000 7f073ac00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07341143e0 0x7f07341a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.326+0000 7f073ac00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0734119ad0 con 0x7f0734076160 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.326+0000 7f073ac00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0734119950 con 0x7f07341143e0 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.326+0000 7f073ac00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0734119c50 con 0x7f0734075840 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.326+0000 7f0738e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0734076160 0x7f07341a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.326+0000 7f0738e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0734076160 0x7f07341a0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51948/0 (socket says 172.21.15.82:51948) 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.326+0000 7f0738e00700 1 -- 172.21.15.82:0/2391962559 learned_addr learned my addr 172.21.15.82:0/2391962559 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.326+0000 7f0739800700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0734075840 0x7f07341a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.326+0000 7f073a200700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07341143e0 0x7f07341a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.327+0000 7f0738e00700 1 -- 172.21.15.82:0/2391962559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0734075840 msgr2=0x7f07341a0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.327+0000 7f0738e00700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0734075840 0x7f07341a0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.327+0000 7f0738e00700 1 -- 172.21.15.82:0/2391962559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07341143e0 msgr2=0x7f07341a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.327+0000 7f0738e00700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07341143e0 0x7f07341a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.327+0000 7f0738e00700 1 -- 172.21.15.82:0/2391962559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07341a5010 con 0x7f0734076160 2024-05-03T22:14:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.327+0000 7f0738e00700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0734076160 0x7f07341a0540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f072000d980 tx=0x7f072000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.327+0000 7f0732000700 1 -- 172.21.15.82:0/2391962559 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720017070 con 0x7f0734076160 2024-05-03T22:14:23.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.327+0000 7f0732000700 1 -- 172.21.15.82:0/2391962559 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0720005020 con 0x7f0734076160 2024-05-03T22:14:23.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.327+0000 7f073ac00700 1 -- 172.21.15.82:0/2391962559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07341a5300 con 0x7f0734076160 2024-05-03T22:14:23.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.327+0000 7f0732000700 1 -- 172.21.15.82:0/2391962559 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720009ab0 con 0x7f0734076160 2024-05-03T22:14:23.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.328+0000 7f073ac00700 1 -- 172.21.15.82:0/2391962559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07341acb80 con 0x7f0734076160 2024-05-03T22:14:23.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.329+0000 7f073ac00700 1 -- 172.21.15.82:0/2391962559 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f073406a190 con 0x7f0734076160 2024-05-03T22:14:23.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.331+0000 7f0732000700 1 -- 172.21.15.82:0/2391962559 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f07200051d0 con 0x7f0734076160 2024-05-03T22:14:23.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.334+0000 7f0732000700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f071c0b2910 0x7f071c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:23.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.334+0000 7f0732000700 1 -- 172.21.15.82:0/2391962559 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7f07200e2a50 con 0x7f0734076160 2024-05-03T22:14:23.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.334+0000 7f0739800700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f071c0b2910 0x7f071c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:23.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.335+0000 7f0739800700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f071c0b2910 0x7f071c0b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0728003760 tx=0x7f0728005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:23.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.337+0000 7f0732000700 1 -- 172.21.15.82:0/2391962559 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0720020020 con 0x7f0734076160 2024-05-03T22:14:23.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.604+0000 7f073ac00700 1 -- 172.21.15.82:0/2391962559 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f07341a1360 con 0x7f071c0b2910 2024-05-03T22:14:23.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.619+0000 7f0732000700 1 -- 172.21.15.82:0/2391962559 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f07341a1360 con 0x7f071c0b2910 2024-05-03T22:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_0/c4c99729-4e2a-4a57-b93e-0d9fb77274d2 2024-05-03T22:14:23.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 -- 172.21.15.82:0/2391962559 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f071c0b2910 msgr2=0x7f071c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:23.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f071c0b2910 0x7f071c0b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0728003760 tx=0x7f0728005fd0 comp rx=0 tx=0).stop 2024-05-03T22:14:23.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 -- 172.21.15.82:0/2391962559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0734076160 msgr2=0x7f07341a0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:23.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0734076160 0x7f07341a0540 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f072000d980 tx=0x7f072000dc90 comp rx=0 tx=0).stop 2024-05-03T22:14:23.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 -- 172.21.15.82:0/2391962559 shutdown_connections 2024-05-03T22:14:23.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f071c0b2910 0x7f071c0b4dd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:23.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07341143e0 0x7f07341a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:23.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0734075840 0x7f07341a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:23.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 --2- 172.21.15.82:0/2391962559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0734076160 0x7f07341a0540 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:23.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 -- 172.21.15.82:0/2391962559 >> 172.21.15.82:0/2391962559 conn(0x7f07340fef20 msgr2=0x7f0734100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:23.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 -- 172.21.15.82:0/2391962559 shutdown_connections 2024-05-03T22:14:23.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:23.622+0000 7f073ac00700 1 -- 172.21.15.82:0/2391962559 wait complete. 2024-05-03T22:14:24.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:24 smithi082 ceph-mon[28404]: pgmap v433: 129 pgs: 129 active+clean; 608 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-05-03T22:14:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:24 smithi130 ceph-mon[32417]: pgmap v433: 129 pgs: 129 active+clean; 608 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-05-03T22:14:24.640 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-03T22:14:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:24 smithi116 ceph-mon[31828]: pgmap v433: 129 pgs: 129 active+clean; 608 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-05-03T22:14:25.090 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:25.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:25 smithi082 ceph-mon[28404]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:25.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:25 smithi130 ceph-mon[32417]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:25.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:25 smithi116 ceph-mon[31828]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:26.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:26 smithi082 ceph-mon[28404]: pgmap v434: 129 pgs: 129 active+clean; 608 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-05-03T22:14:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:26 smithi130 ceph-mon[32417]: pgmap v434: 129 pgs: 129 active+clean; 608 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-05-03T22:14:26.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:26 smithi116 ceph-mon[31828]: pgmap v434: 129 pgs: 129 active+clean; 608 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-05-03T22:14:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.618+0000 7f6001e00700 1 -- 172.21.15.82:0/3592152619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ffc06ba10 msgr2=0x7f5ffc06be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.618+0000 7f6001e00700 1 --2- 172.21.15.82:0/3592152619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ffc06ba10 0x7f5ffc06be90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009990 tx=0x7f5fe8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:14:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.618+0000 7f6001e00700 1 -- 172.21.15.82:0/3592152619 shutdown_connections 2024-05-03T22:14:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.618+0000 7f6001e00700 1 --2- 172.21.15.82:0/3592152619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ffc06c3d0 0x7f5ffc110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.618+0000 7f6001e00700 1 --2- 172.21.15.82:0/3592152619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ffc109500 0x7f5ffc1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.618+0000 7f6001e00700 1 --2- 172.21.15.82:0/3592152619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ffc06ba10 0x7f5ffc06be90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.618+0000 7f6001e00700 1 -- 172.21.15.82:0/3592152619 >> 172.21.15.82:0/3592152619 conn(0x7f5ffc079310 msgr2=0x7f5ffc079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.618+0000 7f6001e00700 1 -- 172.21.15.82:0/3592152619 shutdown_connections 2024-05-03T22:14:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.618+0000 7f6001e00700 1 -- 172.21.15.82:0/3592152619 wait complete. 2024-05-03T22:14:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.619+0000 7f6001e00700 1 Processor -- start 2024-05-03T22:14:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.620+0000 7f6001e00700 1 -- start start 2024-05-03T22:14:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.620+0000 7f6001e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ffc06ba10 0x7f5ffc19f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.620+0000 7f6001e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ffc06c3d0 0x7f5ffc19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.620+0000 7f6001e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ffc109500 0x7f5ffc199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.620+0000 7f6001e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc1134e0 con 0x7f5ffc06ba10 2024-05-03T22:14:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.620+0000 7f6001e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc113360 con 0x7f5ffc06c3d0 2024-05-03T22:14:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.620+0000 7f6001e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc113660 con 0x7f5ffc109500 2024-05-03T22:14:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.621+0000 7f5ffaa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ffc06ba10 0x7f5ffc19f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.621+0000 7f5ffaa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ffc06ba10 0x7f5ffc19f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45768/0 (socket says 172.21.15.82:45768) 2024-05-03T22:14:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.621+0000 7f5ffaa00700 1 -- 172.21.15.82:0/3788140069 learned_addr learned my addr 172.21.15.82:0/3788140069 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.621+0000 7f5ffa000700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ffc06c3d0 0x7f5ffc19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.621+0000 7f5ffb400700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ffc109500 0x7f5ffc199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.621+0000 7f5ffaa00700 1 -- 172.21.15.82:0/3788140069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ffc109500 msgr2=0x7f5ffc199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.621+0000 7f5ffaa00700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ffc109500 0x7f5ffc199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.621+0000 7f5ffaa00700 1 -- 172.21.15.82:0/3788140069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ffc06c3d0 msgr2=0x7f5ffc19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.621+0000 7f5ffaa00700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ffc06c3d0 0x7f5ffc19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.621+0000 7f5ffaa00700 1 -- 172.21.15.82:0/3788140069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ffc19a070 con 0x7f5ffc06ba10 2024-05-03T22:14:27.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.622+0000 7f5ffaa00700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ffc06ba10 0x7f5ffc19f750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00d980 tx=0x7f5fec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:27.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.622+0000 7f6000a00700 1 -- 172.21.15.82:0/3788140069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec017070 con 0x7f5ffc06ba10 2024-05-03T22:14:27.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.622+0000 7f6000a00700 1 -- 172.21.15.82:0/3788140069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5fec005020 con 0x7f5ffc06ba10 2024-05-03T22:14:27.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.622+0000 7f6000a00700 1 -- 172.21.15.82:0/3788140069 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec009ab0 con 0x7f5ffc06ba10 2024-05-03T22:14:27.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.622+0000 7f6001e00700 1 -- 172.21.15.82:0/3788140069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ffc19a360 con 0x7f5ffc06ba10 2024-05-03T22:14:27.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.622+0000 7f6001e00700 1 -- 172.21.15.82:0/3788140069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ffc1a6620 con 0x7f5ffc06ba10 2024-05-03T22:14:27.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.623+0000 7f6001e00700 1 -- 172.21.15.82:0/3788140069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ffc06a190 con 0x7f5ffc06ba10 2024-05-03T22:14:27.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.626+0000 7f6000a00700 1 -- 172.21.15.82:0/3788140069 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5fec0051d0 con 0x7f5ffc06ba10 2024-05-03T22:14:27.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.627+0000 7f6000a00700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5fe00b2990 0x7f5fe00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:27.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.627+0000 7f6000a00700 1 -- 172.21.15.82:0/3788140069 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7f5fec0e2560 con 0x7f5ffc06ba10 2024-05-03T22:14:27.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.627+0000 7f5ffa000700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5fe00b2990 0x7f5fe00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:27.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.628+0000 7f5ffa000700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5fe00b2990 0x7f5fe00b4e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800b5c0 tx=0x7f5fe8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:27.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.632+0000 7f6000a00700 1 -- 172.21.15.82:0/3788140069 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5fec020020 con 0x7f5ffc06ba10 2024-05-03T22:14:27.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.907+0000 7f6001e00700 1 -- 172.21.15.82:0/3788140069 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5ffc0638e0 con 0x7f5fe00b2990 2024-05-03T22:14:27.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.975+0000 7f6000a00700 1 -- 172.21.15.82:0/3788140069 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5ffc0638e0 con 0x7f5fe00b2990 2024-05-03T22:14:27.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.978+0000 7f6001e00700 1 -- 172.21.15.82:0/3788140069 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5fe00b2990 msgr2=0x7f5fe00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:27.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.978+0000 7f6001e00700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5fe00b2990 0x7f5fe00b4e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800b5c0 tx=0x7f5fe8005960 comp rx=0 tx=0).stop 2024-05-03T22:14:27.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.978+0000 7f6001e00700 1 -- 172.21.15.82:0/3788140069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ffc06ba10 msgr2=0x7f5ffc19f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.978+0000 7f6001e00700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ffc06ba10 0x7f5ffc19f750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00d980 tx=0x7f5fec00dc90 comp rx=0 tx=0).stop 2024-05-03T22:14:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.979+0000 7f6001e00700 1 -- 172.21.15.82:0/3788140069 shutdown_connections 2024-05-03T22:14:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.979+0000 7f6001e00700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f5fe00b2990 0x7f5fe00b4e50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.979+0000 7f6001e00700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ffc06ba10 0x7f5ffc19f750 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.979+0000 7f6001e00700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ffc109500 0x7f5ffc199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:27.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.979+0000 7f6001e00700 1 --2- 172.21.15.82:0/3788140069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ffc06c3d0 0x7f5ffc19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.979+0000 7f6001e00700 1 -- 172.21.15.82:0/3788140069 >> 172.21.15.82:0/3788140069 conn(0x7f5ffc079310 msgr2=0x7f5ffc101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.979+0000 7f6001e00700 1 -- 172.21.15.82:0/3788140069 shutdown_connections 2024-05-03T22:14:27.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:27.979+0000 7f6001e00700 1 -- 172.21.15.82:0/3788140069 wait complete. 2024-05-03T22:14:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:28 smithi130 ceph-mon[32417]: pgmap v435: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2024-05-03T22:14:28.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:28 smithi116 ceph-mon[31828]: pgmap v435: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2024-05-03T22:14:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:28 smithi082 ceph-mon[28404]: pgmap v435: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2024-05-03T22:14:28.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-03T22:14:29.309 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:29.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:29 smithi130 ceph-mon[32417]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:29.571 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:29 smithi082 ceph-mon[28404]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:29.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:29 smithi116 ceph-mon[31828]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:30.501 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:30 smithi082 ceph-mon[28404]: pgmap v436: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-05-03T22:14:30.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:30 smithi130 ceph-mon[32417]: pgmap v436: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-05-03T22:14:30.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:30 smithi116 ceph-mon[31828]: pgmap v436: 129 pgs: 129 active+clean; 613 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-05-03T22:14:31.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.940+0000 7f9912600700 1 -- 172.21.15.82:0/124263864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f990c06ba10 msgr2=0x7f990c06be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:31.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.940+0000 7f9912600700 1 --2- 172.21.15.82:0/124263864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f990c06ba10 0x7f990c06be90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009990 tx=0x7f98f4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:14:31.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.941+0000 7f9912600700 1 -- 172.21.15.82:0/124263864 shutdown_connections 2024-05-03T22:14:31.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.941+0000 7f9912600700 1 --2- 172.21.15.82:0/124263864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f990c06c3d0 0x7f990c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:31.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.941+0000 7f9912600700 1 --2- 172.21.15.82:0/124263864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f990c109500 0x7f990c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:31.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.941+0000 7f9912600700 1 --2- 172.21.15.82:0/124263864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f990c06ba10 0x7f990c06be90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:31.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.941+0000 7f9912600700 1 -- 172.21.15.82:0/124263864 >> 172.21.15.82:0/124263864 conn(0x7f990c079310 msgr2=0x7f990c079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:31.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.941+0000 7f9912600700 1 -- 172.21.15.82:0/124263864 shutdown_connections 2024-05-03T22:14:31.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.941+0000 7f9912600700 1 -- 172.21.15.82:0/124263864 wait complete. 2024-05-03T22:14:31.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.942+0000 7f9912600700 1 Processor -- start 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.942+0000 7f9912600700 1 -- start start 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.942+0000 7f9912600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f990c06ba10 0x7f990c102460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.942+0000 7f9912600700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f990c06c3d0 0x7f990c1029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.942+0000 7f9912600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f990c109500 0x7f990c102ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.942+0000 7f9912600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f990c113540 con 0x7f990c06ba10 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.942+0000 7f9912600700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1133c0 con 0x7f990c06c3d0 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.942+0000 7f9912600700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1136c0 con 0x7f990c109500 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.942+0000 7f990b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f990c06ba10 0x7f990c102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.943+0000 7f990b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f990c06ba10 0x7f990c102460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45786/0 (socket says 172.21.15.82:45786) 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.943+0000 7f990b400700 1 -- 172.21.15.82:0/2613258218 learned_addr learned my addr 172.21.15.82:0/2613258218 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.943+0000 7f9903e00700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f990c06c3d0 0x7f990c1029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:31.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.943+0000 7f990be00700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f990c109500 0x7f990c102ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.943+0000 7f990b400700 1 -- 172.21.15.82:0/2613258218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f990c109500 msgr2=0x7f990c102ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.943+0000 7f990b400700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f990c109500 0x7f990c102ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.943+0000 7f990b400700 1 -- 172.21.15.82:0/2613258218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f990c06c3d0 msgr2=0x7f990c1029a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.943+0000 7f990b400700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f990c06c3d0 0x7f990c1029a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.943+0000 7f990b400700 1 -- 172.21.15.82:0/2613258218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c1a7fe0 con 0x7f990c06ba10 2024-05-03T22:14:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.943+0000 7f990b400700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f990c06ba10 0x7f990c102460 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c9b0 tx=0x7f98fc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.944+0000 7f9908c00700 1 -- 172.21.15.82:0/2613258218 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc007b00 con 0x7f990c06ba10 2024-05-03T22:14:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.944+0000 7f9908c00700 1 -- 172.21.15.82:0/2613258218 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98fc007ca0 con 0x7f990c06ba10 2024-05-03T22:14:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.944+0000 7f9912600700 1 -- 172.21.15.82:0/2613258218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990c1a82d0 con 0x7f990c06ba10 2024-05-03T22:14:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.944+0000 7f9908c00700 1 -- 172.21.15.82:0/2613258218 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc018660 con 0x7f990c06ba10 2024-05-03T22:14:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.944+0000 7f9912600700 1 -- 172.21.15.82:0/2613258218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990c1a8810 con 0x7f990c06ba10 2024-05-03T22:14:31.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.945+0000 7f9912600700 1 -- 172.21.15.82:0/2613258218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f990c06a190 con 0x7f990c06ba10 2024-05-03T22:14:31.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.947+0000 7f9908c00700 1 -- 172.21.15.82:0/2613258218 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f98fc00f450 con 0x7f990c06ba10 2024-05-03T22:14:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.949+0000 7f9908c00700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98f00b2910 0x7f98f00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.949+0000 7f9908c00700 1 -- 172.21.15.82:0/2613258218 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7f98fc0e2ad0 con 0x7f990c06ba10 2024-05-03T22:14:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.949+0000 7f9903e00700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98f00b2910 0x7f98f00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.950+0000 7f9903e00700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98f00b2910 0x7f98f00b4dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f98f4006010 tx=0x7f98f401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:31.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:31.952+0000 7f9908c00700 1 -- 172.21.15.82:0/2613258218 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f98fc014030 con 0x7f990c06ba10 2024-05-03T22:14:32.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.223+0000 7f9912600700 1 -- 172.21.15.82:0/2613258218 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f990c0638e0 con 0x7f98f00b2910 2024-05-03T22:14:32.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.235+0000 7f9908c00700 1 -- 172.21.15.82:0/2613258218 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f990c0638e0 con 0x7f98f00b2910 2024-05-03T22:14:32.237 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_1/cc12d162-130e-4d8b-95bb-2f1259a50985 2024-05-03T22:14:32.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.238+0000 7f9912600700 1 -- 172.21.15.82:0/2613258218 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98f00b2910 msgr2=0x7f98f00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:32.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.238+0000 7f9912600700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98f00b2910 0x7f98f00b4dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f98f4006010 tx=0x7f98f401a040 comp rx=0 tx=0).stop 2024-05-03T22:14:32.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.238+0000 7f9912600700 1 -- 172.21.15.82:0/2613258218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f990c06ba10 msgr2=0x7f990c102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:32.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.238+0000 7f9912600700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f990c06ba10 0x7f990c102460 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c9b0 tx=0x7f98fc00cd70 comp rx=0 tx=0).stop 2024-05-03T22:14:32.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.238+0000 7f9912600700 1 -- 172.21.15.82:0/2613258218 shutdown_connections 2024-05-03T22:14:32.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.238+0000 7f9912600700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98f00b2910 0x7f98f00b4dd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:32.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.238+0000 7f9912600700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f990c06ba10 0x7f990c102460 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:32.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.238+0000 7f9912600700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f990c109500 0x7f990c102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:32.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.238+0000 7f9912600700 1 --2- 172.21.15.82:0/2613258218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f990c06c3d0 0x7f990c1029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:32.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.238+0000 7f9912600700 1 -- 172.21.15.82:0/2613258218 >> 172.21.15.82:0/2613258218 conn(0x7f990c079310 msgr2=0x7f990c101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:32.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.239+0000 7f9912600700 1 -- 172.21.15.82:0/2613258218 shutdown_connections 2024-05-03T22:14:32.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:32.239+0000 7f9912600700 1 -- 172.21.15.82:0/2613258218 wait complete. 2024-05-03T22:14:32.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:32 smithi082 ceph-mon[28404]: pgmap v437: 129 pgs: 129 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-03T22:14:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:32 smithi130 ceph-mon[32417]: pgmap v437: 129 pgs: 129 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-03T22:14:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:32 smithi116 ceph-mon[31828]: pgmap v437: 129 pgs: 129 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-03T22:14:33.179 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:14:33.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:33 smithi082 ceph-mon[28404]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:33.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:33 smithi130 ceph-mon[32417]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:33.587 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:33 smithi116 ceph-mon[31828]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:14:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:34.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:34 smithi082 ceph-mon[28404]: pgmap v438: 129 pgs: 129 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-03T22:14:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:34 smithi130 ceph-mon[32417]: pgmap v438: 129 pgs: 129 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-03T22:14:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:34 smithi116 ceph-mon[31828]: pgmap v438: 129 pgs: 129 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-03T22:14:36.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.005+0000 7f64adc00700 1 -- 172.21.15.82:0/932034326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a810b6c0 msgr2=0x7f64a810baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:36.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.005+0000 7f64adc00700 1 --2- 172.21.15.82:0/932034326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a810b6c0 0x7f64a810baa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6498009990 tx=0x7f6498009ca0 comp rx=0 tx=0).stop 2024-05-03T22:14:36.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.005+0000 7f64adc00700 1 -- 172.21.15.82:0/932034326 shutdown_connections 2024-05-03T22:14:36.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.005+0000 7f64adc00700 1 --2- 172.21.15.82:0/932034326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a810b6c0 0x7f64a810baa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:36.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.005+0000 7f64adc00700 1 --2- 172.21.15.82:0/932034326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8106080 0x7f64a8112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:36.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.005+0000 7f64adc00700 1 --2- 172.21.15.82:0/932034326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64a81056c0 0x7f64a8105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:36.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.005+0000 7f64adc00700 1 -- 172.21.15.82:0/932034326 >> 172.21.15.82:0/932034326 conn(0x7f64a81011b0 msgr2=0x7f64a81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:36.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.005+0000 7f64adc00700 1 -- 172.21.15.82:0/932034326 shutdown_connections 2024-05-03T22:14:36.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.005+0000 7f64adc00700 1 -- 172.21.15.82:0/932034326 wait complete. 2024-05-03T22:14:36.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.006+0000 7f64adc00700 1 Processor -- start 2024-05-03T22:14:36.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.006+0000 7f64adc00700 1 -- start start 2024-05-03T22:14:36.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.007+0000 7f64adc00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64a81056c0 0x7f64a81124a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:36.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.007+0000 7f64adc00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8106080 0x7f64a810f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:36.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.007+0000 7f64adc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a810b6c0 0x7f64a810fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:36.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.007+0000 7f64adc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8115770 con 0x7f64a810b6c0 2024-05-03T22:14:36.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.007+0000 7f64adc00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81155f0 con 0x7f64a81056c0 2024-05-03T22:14:36.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.007+0000 7f64adc00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81158f0 con 0x7f64a8106080 2024-05-03T22:14:36.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.007+0000 7f64a7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a810b6c0 0x7f64a810fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:36.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.007+0000 7f64a7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a810b6c0 0x7f64a810fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46446/0 (socket says 172.21.15.82:46446) 2024-05-03T22:14:36.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.007+0000 7f64a7400700 1 -- 172.21.15.82:0/1321961137 learned_addr learned my addr 172.21.15.82:0/1321961137 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:36.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.008+0000 7f649fe00700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8106080 0x7f64a810f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:36.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.008+0000 7f64a6a00700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64a81056c0 0x7f64a81124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:36.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.008+0000 7f64a7400700 1 -- 172.21.15.82:0/1321961137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8106080 msgr2=0x7f64a810f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:36.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.008+0000 7f64a7400700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8106080 0x7f64a810f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:36.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.008+0000 7f64a7400700 1 -- 172.21.15.82:0/1321961137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64a81056c0 msgr2=0x7f64a81124a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:36.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.008+0000 7f64a7400700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64a81056c0 0x7f64a81124a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:36.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.008+0000 7f64a7400700 1 -- 172.21.15.82:0/1321961137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a81ac470 con 0x7f64a810b6c0 2024-05-03T22:14:36.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.008+0000 7f64a7400700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a810b6c0 0x7f64a810fb10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f64a0007ee0 tx=0x7f64a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:36.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.009+0000 7f649f400700 1 -- 172.21.15.82:0/1321961137 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a000dbd0 con 0x7f64a810b6c0 2024-05-03T22:14:36.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.009+0000 7f649f400700 1 -- 172.21.15.82:0/1321961137 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64a000dd70 con 0x7f64a810b6c0 2024-05-03T22:14:36.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.009+0000 7f649f400700 1 -- 172.21.15.82:0/1321961137 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a00058a0 con 0x7f64a810b6c0 2024-05-03T22:14:36.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.009+0000 7f64adc00700 1 -- 172.21.15.82:0/1321961137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a81ac640 con 0x7f64a810b6c0 2024-05-03T22:14:36.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.009+0000 7f64adc00700 1 -- 172.21.15.82:0/1321961137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a81acba0 con 0x7f64a810b6c0 2024-05-03T22:14:36.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.010+0000 7f64adc00700 1 -- 172.21.15.82:0/1321961137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a8106e00 con 0x7f64a810b6c0 2024-05-03T22:14:36.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.013+0000 7f649f400700 1 -- 172.21.15.82:0/1321961137 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f64a001a020 con 0x7f64a810b6c0 2024-05-03T22:14:36.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.015+0000 7f649f400700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f648c0b2990 0x7f648c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:36.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.015+0000 7f649f400700 1 -- 172.21.15.82:0/1321961137 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9071+0+0 (secure 0 0 0) 0x7f64a00e23e0 con 0x7f64a810b6c0 2024-05-03T22:14:36.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.015+0000 7f64a6a00700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f648c0b2990 0x7f648c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:36.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.016+0000 7f64a6a00700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f648c0b2990 0x7f648c0b4e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f649800b5c0 tx=0x7f649801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:36.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.018+0000 7f649f400700 1 -- 172.21.15.82:0/1321961137 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f64a0010070 con 0x7f64a810b6c0 2024-05-03T22:14:36.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.307+0000 7f64adc00700 1 -- 172.21.15.82:0/1321961137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64a802e510 con 0x7f64a810b6c0 2024-05-03T22:14:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.309+0000 7f649f400700 1 -- 172.21.15.82:0/1321961137 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f64a00a9c00 con 0x7f64a810b6c0 2024-05-03T22:14:36.311 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:14:36.312 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:12:39.270198+0000","modified":"2024-05-03T22:14:10.244210+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34460,"mds_1":34433,"mds_2":34412,"mds_3":34403,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":40,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34412":{"gid":34412,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6839/3254019270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3254019270},{"type":"v1","addr":"172.21.15.116:6839","nonce":3254019270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34460,"qdb_cluster":[24469,34403,34460,34433,34412]},"id":1}]} 2024-05-03T22:14:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.312+0000 7f64adc00700 1 -- 172.21.15.82:0/1321961137 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f648c0b2990 msgr2=0x7f648c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.312+0000 7f64adc00700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f648c0b2990 0x7f648c0b4e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f649800b5c0 tx=0x7f649801a040 comp rx=0 tx=0).stop 2024-05-03T22:14:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.312+0000 7f64adc00700 1 -- 172.21.15.82:0/1321961137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a810b6c0 msgr2=0x7f64a810fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.312+0000 7f64adc00700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a810b6c0 0x7f64a810fb10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f64a0007ee0 tx=0x7f64a000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:14:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.313+0000 7f64adc00700 1 -- 172.21.15.82:0/1321961137 shutdown_connections 2024-05-03T22:14:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.313+0000 7f64adc00700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f648c0b2990 0x7f648c0b4e50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.313+0000 7f64adc00700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64a810b6c0 0x7f64a810fb10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.313+0000 7f64adc00700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64a81056c0 0x7f64a81124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.313+0000 7f64adc00700 1 --2- 172.21.15.82:0/1321961137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8106080 0x7f64a810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.313+0000 7f64adc00700 1 -- 172.21.15.82:0/1321961137 >> 172.21.15.82:0/1321961137 conn(0x7f64a81011b0 msgr2=0x7f64a81019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.313+0000 7f64adc00700 1 -- 172.21.15.82:0/1321961137 shutdown_connections 2024-05-03T22:14:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:36.313+0000 7f64adc00700 1 -- 172.21.15.82:0/1321961137 wait complete. 2024-05-03T22:14:36.316 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-05-03T22:14:36.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:36 smithi130 ceph-mon[32417]: pgmap v439: 129 pgs: 129 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-03T22:14:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:36 smithi116 ceph-mon[31828]: pgmap v439: 129 pgs: 129 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-03T22:14:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:36 smithi082 ceph-mon[28404]: pgmap v439: 129 pgs: 129 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-03T22:14:37.326 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:14:37.586 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:14:37.586 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:37 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1321961137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:14:37.586 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-05-03T22:14:37.586 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-03T22:14:37.586 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-05-03T22:14:37.587 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:37 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-05-03T22:14:37.624 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:14:37.624 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:37 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1321961137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:14:37.624 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-05-03T22:14:37.624 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-03T22:14:37.624 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-05-03T22:14:37.624 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:37 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-05-03T22:14:37.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:14:37.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:37 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1321961137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:14:37.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-05-03T22:14:37.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-03T22:14:37.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-05-03T22:14:37.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:37 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-05-03T22:14:38.296 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:38 smithi082 ceph-mon[28404]: pgmap v440: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-05-03T22:14:38.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-05-03T22:14:38.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-03T22:14:38.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-05-03T22:14:38.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:38 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-05-03T22:14:38.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:38 smithi082 ceph-mon[28404]: osdmap e91: 12 total, 12 up, 12 in 2024-05-03T22:14:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:38 smithi116 ceph-mon[31828]: pgmap v440: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-05-03T22:14:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-05-03T22:14:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-03T22:14:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-05-03T22:14:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:38 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-05-03T22:14:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:38 smithi116 ceph-mon[31828]: osdmap e91: 12 total, 12 up, 12 in 2024-05-03T22:14:38.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:38 smithi130 ceph-mon[32417]: pgmap v440: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-05-03T22:14:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-05-03T22:14:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-03T22:14:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-05-03T22:14:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:38 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-05-03T22:14:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:38 smithi130 ceph-mon[32417]: osdmap e91: 12 total, 12 up, 12 in 2024-05-03T22:14:39.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:39 smithi082 ceph-mon[28404]: osdmap e92: 12 total, 12 up, 12 in 2024-05-03T22:14:39.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:39.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:39.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:39.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:39 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:39.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:39 smithi116 ceph-mon[31828]: osdmap e92: 12 total, 12 up, 12 in 2024-05-03T22:14:39.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:39.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:39.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:39.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:39 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:39.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:39 smithi130 ceph-mon[32417]: osdmap e92: 12 total, 12 up, 12 in 2024-05-03T22:14:39.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:39.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:39.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:39.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:39 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:40.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:40 smithi082 ceph-mon[28404]: pgmap v443: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-03T22:14:40.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:40 smithi116 ceph-mon[31828]: pgmap v443: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-03T22:14:40.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:40 smithi130 ceph-mon[32417]: pgmap v443: 129 pgs: 129 active+clean; 636 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-03T22:14:41.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.146+0000 7f66ada00700 1 -- 172.21.15.82:0/583882582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a8103d90 msgr2=0x7f66a81102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:41.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.146+0000 7f66ada00700 1 --2- 172.21.15.82:0/583882582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a8103d90 0x7f66a81102a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f66a000b0a0 tx=0x7f66a000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:14:41.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.146+0000 7f66ada00700 1 -- 172.21.15.82:0/583882582 shutdown_connections 2024-05-03T22:14:41.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.146+0000 7f66ada00700 1 --2- 172.21.15.82:0/583882582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a8103d90 0x7f66a81102a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:41.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.146+0000 7f66ada00700 1 --2- 172.21.15.82:0/583882582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66a8109460 0x7f66a8109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:41.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.146+0000 7f66ada00700 1 --2- 172.21.15.82:0/583882582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66a81033d0 0x7f66a8103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:41.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.146+0000 7f66ada00700 1 -- 172.21.15.82:0/583882582 >> 172.21.15.82:0/583882582 conn(0x7f66a80fef20 msgr2=0x7f66a8101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:41.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.146+0000 7f66ada00700 1 -- 172.21.15.82:0/583882582 shutdown_connections 2024-05-03T22:14:41.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.146+0000 7f66ada00700 1 -- 172.21.15.82:0/583882582 wait complete. 2024-05-03T22:14:41.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.147+0000 7f66ada00700 1 Processor -- start 2024-05-03T22:14:41.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.148+0000 7f66ada00700 1 -- start start 2024-05-03T22:14:41.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.148+0000 7f66ada00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a81033d0 0x7f66a81a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:41.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.148+0000 7f66ada00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66a8103d90 0x7f66a81a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:41.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.148+0000 7f66ada00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66a8109460 0x7f66a819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:41.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.148+0000 7f66ada00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8113470 con 0x7f66a81033d0 2024-05-03T22:14:41.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.148+0000 7f66ada00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81132f0 con 0x7f66a8109460 2024-05-03T22:14:41.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.148+0000 7f66ada00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81135f0 con 0x7f66a8103d90 2024-05-03T22:14:41.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.148+0000 7f66a7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a81033d0 0x7f66a81a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:41.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.148+0000 7f66a7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a81033d0 0x7f66a81a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46470/0 (socket says 172.21.15.82:46470) 2024-05-03T22:14:41.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.148+0000 7f66a7e00700 1 -- 172.21.15.82:0/1542218170 learned_addr learned my addr 172.21.15.82:0/1542218170 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:41.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.149+0000 7f66a7400700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66a8103d90 0x7f66a81a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:41.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.149+0000 7f66ad000700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66a8109460 0x7f66a819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.149+0000 7f66a7e00700 1 -- 172.21.15.82:0/1542218170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66a8103d90 msgr2=0x7f66a81a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.149+0000 7f66a7e00700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66a8103d90 0x7f66a81a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.149+0000 7f66a7e00700 1 -- 172.21.15.82:0/1542218170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66a8109460 msgr2=0x7f66a819b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.149+0000 7f66a7e00700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66a8109460 0x7f66a819b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.149+0000 7f66a7e00700 1 -- 172.21.15.82:0/1542218170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a819c0f0 con 0x7f66a81033d0 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.149+0000 7f66ad000700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66a8109460 0x7f66a819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.149+0000 7f66a7e00700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a81033d0 0x7f66a81a17d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f669800d950 tx=0x7f669800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.149+0000 7f66a4c00700 1 -- 172.21.15.82:0/1542218170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698016070 con 0x7f66a81033d0 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.150+0000 7f66a4c00700 1 -- 172.21.15.82:0/1542218170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6698010460 con 0x7f66a81033d0 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.150+0000 7f66a4c00700 1 -- 172.21.15.82:0/1542218170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669800f620 con 0x7f66a81033d0 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.150+0000 7f66ada00700 1 -- 172.21.15.82:0/1542218170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a819c380 con 0x7f66a81033d0 2024-05-03T22:14:41.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.150+0000 7f66ada00700 1 -- 172.21.15.82:0/1542218170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a81a86a0 con 0x7f66a81033d0 2024-05-03T22:14:41.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.151+0000 7f66ada00700 1 -- 172.21.15.82:0/1542218170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a806a190 con 0x7f66a81033d0 2024-05-03T22:14:41.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.153+0000 7f66a4c00700 1 -- 172.21.15.82:0/1542218170 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6698019070 con 0x7f66a81033d0 2024-05-03T22:14:41.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.155+0000 7f66a4c00700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f668c0b2990 0x7f668c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:41.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.155+0000 7f66a4c00700 1 -- 172.21.15.82:0/1542218170 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f66980e22d0 con 0x7f66a81033d0 2024-05-03T22:14:41.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.155+0000 7f66a7400700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f668c0b2990 0x7f668c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:41.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.156+0000 7f66a7400700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f668c0b2990 0x7f668c0b4e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f66a810f6f0 tx=0x7f6694009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:41.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.159+0000 7f66a4c00700 1 -- 172.21.15.82:0/1542218170 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f66980a9a70 con 0x7f66a81033d0 2024-05-03T22:14:41.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.421+0000 7f66ada00700 1 -- 172.21.15.82:0/1542218170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66a81a8870 con 0x7f66a81033d0 2024-05-03T22:14:41.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.424+0000 7f66a4c00700 1 -- 172.21.15.82:0/1542218170 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24803 (secure 0 0 0) 0x7f66980a9370 con 0x7f66a81033d0 2024-05-03T22:14:41.426 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:14:41.426 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:14:38.277415+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:12:30.512363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:12:34.936483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:12:50.095758+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:14:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.427+0000 7f66ada00700 1 -- 172.21.15.82:0/1542218170 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f668c0b2990 msgr2=0x7f668c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.427+0000 7f66ada00700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f668c0b2990 0x7f668c0b4e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f66a810f6f0 tx=0x7f6694009260 comp rx=0 tx=0).stop 2024-05-03T22:14:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.427+0000 7f66ada00700 1 -- 172.21.15.82:0/1542218170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a81033d0 msgr2=0x7f66a81a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.427+0000 7f66ada00700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a81033d0 0x7f66a81a17d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f669800d950 tx=0x7f669800dd10 comp rx=0 tx=0).stop 2024-05-03T22:14:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.427+0000 7f66ada00700 1 -- 172.21.15.82:0/1542218170 shutdown_connections 2024-05-03T22:14:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.427+0000 7f66ada00700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f668c0b2990 0x7f668c0b4e50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.427+0000 7f66ada00700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a81033d0 0x7f66a81a17d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.427+0000 7f66ada00700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66a8109460 0x7f66a819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.427+0000 7f66ada00700 1 --2- 172.21.15.82:0/1542218170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66a8103d90 0x7f66a81a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.428+0000 7f66ada00700 1 -- 172.21.15.82:0/1542218170 >> 172.21.15.82:0/1542218170 conn(0x7f66a80fef20 msgr2=0x7f66a810fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.428+0000 7f66ada00700 1 -- 172.21.15.82:0/1542218170 shutdown_connections 2024-05-03T22:14:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:41.428+0000 7f66ada00700 1 -- 172.21.15.82:0/1542218170 wait complete. 2024-05-03T22:14:42.469 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-03T22:14:42.469 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T22:14:42.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:42 smithi082 ceph-mon[28404]: pgmap v444: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s; 97 B/s, 1 objects/s recovering 2024-05-03T22:14:42.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:42 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1542218170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:14:42.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:42 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:42.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:42 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:42 smithi116 ceph-mon[31828]: pgmap v444: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s; 97 B/s, 1 objects/s recovering 2024-05-03T22:14:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:42 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1542218170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:14:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:42 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:42.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:42 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:42 smithi130 ceph-mon[32417]: pgmap v444: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s; 97 B/s, 1 objects/s recovering 2024-05-03T22:14:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:42 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1542218170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:14:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:42 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:42 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:42.914 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:43.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:14:43.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:14:43.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:43.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:14:43.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:14:43.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:43.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:14:43.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:14:43.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:14:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:44 smithi082 ceph-mon[28404]: pgmap v445: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.5 KiB/s wr, 12 op/s; 97 B/s, 1 objects/s recovering 2024-05-03T22:14:44.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:44 smithi116 ceph-mon[31828]: pgmap v445: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.5 KiB/s wr, 12 op/s; 97 B/s, 1 objects/s recovering 2024-05-03T22:14:44.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:44 smithi130 ceph-mon[32417]: pgmap v445: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.5 KiB/s wr, 12 op/s; 97 B/s, 1 objects/s recovering 2024-05-03T22:14:45.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.602+0000 7f0fe4c00700 1 -- 172.21.15.82:0/2147519741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe0109500 msgr2=0x7f0fe01098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:45.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.602+0000 7f0fe4c00700 1 --2- 172.21.15.82:0/2147519741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe0109500 0x7f0fe01098e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009990 tx=0x7f0fd0009ca0 comp rx=0 tx=0).stop 2024-05-03T22:14:45.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.603+0000 7f0fe4c00700 1 -- 172.21.15.82:0/2147519741 shutdown_connections 2024-05-03T22:14:45.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.603+0000 7f0fe4c00700 1 --2- 172.21.15.82:0/2147519741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe0109500 0x7f0fe01098e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:45.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.603+0000 7f0fe4c00700 1 --2- 172.21.15.82:0/2147519741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe006c3d0 0x7f0fe0110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:45.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.603+0000 7f0fe4c00700 1 --2- 172.21.15.82:0/2147519741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fe006ba10 0x7f0fe006be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:45.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.603+0000 7f0fe4c00700 1 -- 172.21.15.82:0/2147519741 >> 172.21.15.82:0/2147519741 conn(0x7f0fe0079310 msgr2=0x7f0fe0079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:45.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.603+0000 7f0fe4c00700 1 -- 172.21.15.82:0/2147519741 shutdown_connections 2024-05-03T22:14:45.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.603+0000 7f0fe4c00700 1 -- 172.21.15.82:0/2147519741 wait complete. 2024-05-03T22:14:45.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.604+0000 7f0fe4c00700 1 Processor -- start 2024-05-03T22:14:45.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.604+0000 7f0fe4c00700 1 -- start start 2024-05-03T22:14:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.604+0000 7f0fe4c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe006ba10 0x7f0fe01a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.604+0000 7f0fe4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe006c3d0 0x7f0fe01a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.604+0000 7f0fe4c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fe0109500 0x7f0fe019ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.604+0000 7f0fe4c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe0113510 con 0x7f0fe006c3d0 2024-05-03T22:14:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.604+0000 7f0fe4c00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe0113390 con 0x7f0fe006ba10 2024-05-03T22:14:45.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.604+0000 7f0fe4c00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe0113690 con 0x7f0fe0109500 2024-05-03T22:14:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fdd400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe006c3d0 0x7f0fe01a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fdd400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe006c3d0 0x7f0fe01a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50110/0 (socket says 172.21.15.82:50110) 2024-05-03T22:14:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fdd400700 1 -- 172.21.15.82:0/1136581608 learned_addr learned my addr 172.21.15.82:0/1136581608 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fdde00700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe006ba10 0x7f0fe01a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fde800700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fe0109500 0x7f0fe019ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fdd400700 1 -- 172.21.15.82:0/1136581608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fe0109500 msgr2=0x7f0fe019ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fdd400700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fe0109500 0x7f0fe019ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fdd400700 1 -- 172.21.15.82:0/1136581608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe006ba10 msgr2=0x7f0fe01a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fdd400700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe006ba10 0x7f0fe01a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fdd400700 1 -- 172.21.15.82:0/1136581608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe019c1f0 con 0x7f0fe006c3d0 2024-05-03T22:14:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fdde00700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe006ba10 0x7f0fe01a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:14:45.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.605+0000 7f0fde800700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fe0109500 0x7f0fe019ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:14:45.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.606+0000 7f0fdd400700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe006c3d0 0x7f0fe01a1e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc00c920 tx=0x7f0fcc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:45.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.606+0000 7f0fd6a00700 1 -- 172.21.15.82:0/1136581608 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc007b00 con 0x7f0fe006c3d0 2024-05-03T22:14:45.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.606+0000 7f0fd6a00700 1 -- 172.21.15.82:0/1136581608 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0fcc004cc0 con 0x7f0fe006c3d0 2024-05-03T22:14:45.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.606+0000 7f0fe4c00700 1 -- 172.21.15.82:0/1136581608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe019c4e0 con 0x7f0fe006c3d0 2024-05-03T22:14:45.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.606+0000 7f0fd6a00700 1 -- 172.21.15.82:0/1136581608 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc0054f0 con 0x7f0fe006c3d0 2024-05-03T22:14:45.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.606+0000 7f0fe4c00700 1 -- 172.21.15.82:0/1136581608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe01a87a0 con 0x7f0fe006c3d0 2024-05-03T22:14:45.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.607+0000 7f0fe4c00700 1 -- 172.21.15.82:0/1136581608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe006a190 con 0x7f0fe006c3d0 2024-05-03T22:14:45.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.610+0000 7f0fd6a00700 1 -- 172.21.15.82:0/1136581608 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0fcc007ca0 con 0x7f0fe006c3d0 2024-05-03T22:14:45.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.612+0000 7f0fd6a00700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fc40b2910 0x7f0fc40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:45.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.612+0000 7f0fd6a00700 1 -- 172.21.15.82:0/1136581608 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f0fcc0e2400 con 0x7f0fe006c3d0 2024-05-03T22:14:45.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.612+0000 7f0fdde00700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fc40b2910 0x7f0fc40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:45.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.613+0000 7f0fdde00700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fc40b2910 0x7f0fc40b4dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0005850 tx=0x7f0fd001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:45.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.616+0000 7f0fd6a00700 1 -- 172.21.15.82:0/1136581608 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0fcc014030 con 0x7f0fe006c3d0 2024-05-03T22:14:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.839+0000 7f0fe4c00700 1 -- 172.21.15.82:0/1136581608 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0fe010ed80 con 0x7f0fc40b2910 2024-05-03T22:14:45.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.855+0000 7f0fd6a00700 1 -- 172.21.15.82:0/1136581608 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340472 (secure 0 0 0) 0x7f0fe010ed80 con 0x7f0fc40b2910 2024-05-03T22:14:45.863 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:14:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.861+0000 7f0fe4c00700 1 -- 172.21.15.82:0/1136581608 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fc40b2910 msgr2=0x7f0fc40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.861+0000 7f0fe4c00700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fc40b2910 0x7f0fc40b4dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0005850 tx=0x7f0fd001a040 comp rx=0 tx=0).stop 2024-05-03T22:14:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.861+0000 7f0fe4c00700 1 -- 172.21.15.82:0/1136581608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe006c3d0 msgr2=0x7f0fe01a1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.861+0000 7f0fe4c00700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe006c3d0 0x7f0fe01a1e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc00c920 tx=0x7f0fcc00cce0 comp rx=0 tx=0).stop 2024-05-03T22:14:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.861+0000 7f0fe4c00700 1 -- 172.21.15.82:0/1136581608 shutdown_connections 2024-05-03T22:14:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.861+0000 7f0fe4c00700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0fc40b2910 0x7f0fc40b4dd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.861+0000 7f0fe4c00700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0fe0109500 0x7f0fe019ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:45.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.861+0000 7f0fe4c00700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe006ba10 0x7f0fe01a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:45.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.861+0000 7f0fe4c00700 1 --2- 172.21.15.82:0/1136581608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fe006c3d0 0x7f0fe01a1e10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:45.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.861+0000 7f0fe4c00700 1 -- 172.21.15.82:0/1136581608 >> 172.21.15.82:0/1136581608 conn(0x7f0fe0079310 msgr2=0x7f0fe010e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:45.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.862+0000 7f0fe4c00700 1 -- 172.21.15.82:0/1136581608 shutdown_connections 2024-05-03T22:14:45.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:45.862+0000 7f0fe4c00700 1 -- 172.21.15.82:0/1136581608 wait complete. 2024-05-03T22:14:45.867 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-03T22:14:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:46 smithi116 ceph-mon[31828]: pgmap v446: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s; 97 B/s, 1 objects/s recovering 2024-05-03T22:14:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:46 smithi082 ceph-mon[28404]: pgmap v446: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s; 97 B/s, 1 objects/s recovering 2024-05-03T22:14:46.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:46 smithi130 ceph-mon[32417]: pgmap v446: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s; 97 B/s, 1 objects/s recovering 2024-05-03T22:14:46.941 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2024-05-03T22:14:44.651692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655757,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":467,"num_read_kb":328,"num_write":371,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2952624,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":422,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359664,"kb_used_data":14600,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124582160,"statfs":{"total":1151940427776,"available":1151572131840,"internally_reserved":0,"allocated":14950400,"data_stored":8294597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4962,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003601"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288498+0000","last_change":"2024-05-03T22:12:36.021433+0000","last_active":"2024-05-03T22:14:38.288498+0000","last_peered":"2024-05-03T22:14:38.288498+0000","last_clean":"2024-05-03T22:14:38.288498+0000","last_became_active":"2024-05-03T22:12:36.019902+0000","last_became_peered":"2024-05-03T22:12:36.019902+0000","last_unstale":"2024-05-03T22:14:38.288498+0000","last_undegraded":"2024-05-03T22:14:38.288498+0000","last_fullsized":"2024-05-03T22:14:38.288498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:08:27.361044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298298+0000","last_change":"2024-05-03T22:12:36.012811+0000","last_active":"2024-05-03T22:14:38.298298+0000","last_peered":"2024-05-03T22:14:38.298298+0000","last_clean":"2024-05-03T22:14:38.298298+0000","last_became_active":"2024-05-03T22:12:36.012491+0000","last_became_peered":"2024-05-03T22:12:36.012491+0000","last_unstale":"2024-05-03T22:14:38.298298+0000","last_undegraded":"2024-05-03T22:14:38.298298+0000","last_fullsized":"2024-05-03T22:14:38.298298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:19:01.773304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297615+0000","last_change":"2024-05-03T22:12:36.009783+0000","last_active":"2024-05-03T22:14:38.297615+0000","last_peered":"2024-05-03T22:14:38.297615+0000","last_clean":"2024-05-03T22:14:38.297615+0000","last_became_active":"2024-05-03T22:12:36.009461+0000","last_became_peered":"2024-05-03T22:12:36.009461+0000","last_unstale":"2024-05-03T22:14:38.297615+0000","last_undegraded":"2024-05-03T22:14:38.297615+0000","last_fullsized":"2024-05-03T22:14:38.297615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:04:17.127323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283737+0000","last_change":"2024-05-03T22:12:36.005887+0000","last_active":"2024-05-03T22:14:38.283737+0000","last_peered":"2024-05-03T22:14:38.283737+0000","last_clean":"2024-05-03T22:14:38.283737+0000","last_became_active":"2024-05-03T22:12:36.005519+0000","last_became_peered":"2024-05-03T22:12:36.005519+0000","last_unstale":"2024-05-03T22:14:38.283737+0000","last_undegraded":"2024-05-03T22:14:38.283737+0000","last_fullsized":"2024-05-03T22:14:38.283737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:15:23.962047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285218+0000","last_change":"2024-05-03T22:12:35.988566+0000","last_active":"2024-05-03T22:14:38.285218+0000","last_peered":"2024-05-03T22:14:38.285218+0000","last_clean":"2024-05-03T22:14:38.285218+0000","last_became_active":"2024-05-03T22:12:35.986766+0000","last_became_peered":"2024-05-03T22:12:35.986766+0000","last_unstale":"2024-05-03T22:14:38.285218+0000","last_undegraded":"2024-05-03T22:14:38.285218+0000","last_fullsized":"2024-05-03T22:14:38.285218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:38:52.877608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036215+0000","last_change":"2024-05-03T22:12:36.013994+0000","last_active":"2024-05-03T22:14:39.036215+0000","last_peered":"2024-05-03T22:14:39.036215+0000","last_clean":"2024-05-03T22:14:39.036215+0000","last_became_active":"2024-05-03T22:12:36.013134+0000","last_became_peered":"2024-05-03T22:12:36.013134+0000","last_unstale":"2024-05-03T22:14:39.036215+0000","last_undegraded":"2024-05-03T22:14:39.036215+0000","last_fullsized":"2024-05-03T22:14:39.036215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:21:47.881727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288833+0000","last_change":"2024-05-03T22:12:36.016165+0000","last_active":"2024-05-03T22:14:38.288833+0000","last_peered":"2024-05-03T22:14:38.288833+0000","last_clean":"2024-05-03T22:14:38.288833+0000","last_became_active":"2024-05-03T22:12:36.009230+0000","last_became_peered":"2024-05-03T22:12:36.009230+0000","last_unstale":"2024-05-03T22:14:38.288833+0000","last_undegraded":"2024-05-03T22:14:38.288833+0000","last_fullsized":"2024-05-03T22:14:38.288833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:27:38.042296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290394+0000","last_change":"2024-05-03T22:12:36.006859+0000","last_active":"2024-05-03T22:14:38.290394+0000","last_peered":"2024-05-03T22:14:38.290394+0000","last_clean":"2024-05-03T22:14:38.290394+0000","last_became_active":"2024-05-03T22:12:36.006396+0000","last_became_peered":"2024-05-03T22:12:36.006396+0000","last_unstale":"2024-05-03T22:14:38.290394+0000","last_undegraded":"2024-05-03T22:14:38.290394+0000","last_fullsized":"2024-05-03T22:14:38.290394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:45:00.863115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728822+0000","last_change":"2024-05-03T22:12:36.020513+0000","last_active":"2024-05-03T22:14:38.728822+0000","last_peered":"2024-05-03T22:14:38.728822+0000","last_clean":"2024-05-03T22:14:38.728822+0000","last_became_active":"2024-05-03T22:12:36.017852+0000","last_became_peered":"2024-05-03T22:12:36.017852+0000","last_unstale":"2024-05-03T22:14:38.728822+0000","last_undegraded":"2024-05-03T22:14:38.728822+0000","last_fullsized":"2024-05-03T22:14:38.728822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:20:33.567258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036789+0000","last_change":"2024-05-03T22:12:36.009729+0000","last_active":"2024-05-03T22:14:39.036789+0000","last_peered":"2024-05-03T22:14:39.036789+0000","last_clean":"2024-05-03T22:14:39.036789+0000","last_became_active":"2024-05-03T22:12:36.007356+0000","last_became_peered":"2024-05-03T22:12:36.007356+0000","last_unstale":"2024-05-03T22:14:39.036789+0000","last_undegraded":"2024-05-03T22:14:39.036789+0000","last_fullsized":"2024-05-03T22:14:39.036789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:49:56.964694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289164+0000","last_change":"2024-05-03T22:12:36.019438+0000","last_active":"2024-05-03T22:14:38.289164+0000","last_peered":"2024-05-03T22:14:38.289164+0000","last_clean":"2024-05-03T22:14:38.289164+0000","last_became_active":"2024-05-03T22:12:36.019049+0000","last_became_peered":"2024-05-03T22:12:36.019049+0000","last_unstale":"2024-05-03T22:14:38.289164+0000","last_undegraded":"2024-05-03T22:14:38.289164+0000","last_fullsized":"2024-05-03T22:14:38.289164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:06:01.344591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283615+0000","last_change":"2024-05-03T22:12:36.015763+0000","last_active":"2024-05-03T22:14:38.283615+0000","last_peered":"2024-05-03T22:14:38.283615+0000","last_clean":"2024-05-03T22:14:38.283615+0000","last_became_active":"2024-05-03T22:12:36.010804+0000","last_became_peered":"2024-05-03T22:12:36.010804+0000","last_unstale":"2024-05-03T22:14:38.283615+0000","last_undegraded":"2024-05-03T22:14:38.283615+0000","last_fullsized":"2024-05-03T22:14:38.283615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:06:14.150027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288985+0000","last_change":"2024-05-03T22:12:36.018442+0000","last_active":"2024-05-03T22:14:38.288985+0000","last_peered":"2024-05-03T22:14:38.288985+0000","last_clean":"2024-05-03T22:14:38.288985+0000","last_became_active":"2024-05-03T22:12:36.017288+0000","last_became_peered":"2024-05-03T22:12:36.017288+0000","last_unstale":"2024-05-03T22:14:38.288985+0000","last_undegraded":"2024-05-03T22:14:38.288985+0000","last_fullsized":"2024-05-03T22:14:38.288985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:06.097579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.296785+0000","last_change":"2024-05-03T22:12:36.015322+0000","last_active":"2024-05-03T22:14:38.296785+0000","last_peered":"2024-05-03T22:14:38.296785+0000","last_clean":"2024-05-03T22:14:38.296785+0000","last_became_active":"2024-05-03T22:12:36.014933+0000","last_became_peered":"2024-05-03T22:12:36.014933+0000","last_unstale":"2024-05-03T22:14:38.296785+0000","last_undegraded":"2024-05-03T22:14:38.296785+0000","last_fullsized":"2024-05-03T22:14:38.296785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:35:07.654487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.296654+0000","last_change":"2024-05-03T22:12:36.016161+0000","last_active":"2024-05-03T22:14:38.296654+0000","last_peered":"2024-05-03T22:14:38.296654+0000","last_clean":"2024-05-03T22:14:38.296654+0000","last_became_active":"2024-05-03T22:12:36.015827+0000","last_became_peered":"2024-05-03T22:12:36.015827+0000","last_unstale":"2024-05-03T22:14:38.296654+0000","last_undegraded":"2024-05-03T22:14:38.296654+0000","last_fullsized":"2024-05-03T22:14:38.296654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:27.585544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.727721+0000","last_change":"2024-05-03T22:12:36.010741+0000","last_active":"2024-05-03T22:14:38.727721+0000","last_peered":"2024-05-03T22:14:38.727721+0000","last_clean":"2024-05-03T22:14:38.727721+0000","last_became_active":"2024-05-03T22:12:36.010391+0000","last_became_peered":"2024-05-03T22:12:36.010391+0000","last_unstale":"2024-05-03T22:14:38.727721+0000","last_undegraded":"2024-05-03T22:14:38.727721+0000","last_fullsized":"2024-05-03T22:14:38.727721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:58:18.400114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287568+0000","last_change":"2024-05-03T22:12:36.024248+0000","last_active":"2024-05-03T22:14:38.287568+0000","last_peered":"2024-05-03T22:14:38.287568+0000","last_clean":"2024-05-03T22:14:38.287568+0000","last_became_active":"2024-05-03T22:12:36.023864+0000","last_became_peered":"2024-05-03T22:12:36.023864+0000","last_unstale":"2024-05-03T22:14:38.287568+0000","last_undegraded":"2024-05-03T22:14:38.287568+0000","last_fullsized":"2024-05-03T22:14:38.287568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:29:22.455105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285087+0000","last_change":"2024-05-03T22:12:36.006077+0000","last_active":"2024-05-03T22:14:38.285087+0000","last_peered":"2024-05-03T22:14:38.285087+0000","last_clean":"2024-05-03T22:14:38.285087+0000","last_became_active":"2024-05-03T22:12:36.005745+0000","last_became_peered":"2024-05-03T22:12:36.005745+0000","last_unstale":"2024-05-03T22:14:38.285087+0000","last_undegraded":"2024-05-03T22:14:38.285087+0000","last_fullsized":"2024-05-03T22:14:38.285087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:46:47.245132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.292473+0000","last_change":"2024-05-03T22:12:36.001122+0000","last_active":"2024-05-03T22:14:38.292473+0000","last_peered":"2024-05-03T22:14:38.292473+0000","last_clean":"2024-05-03T22:14:38.292473+0000","last_became_active":"2024-05-03T22:12:36.000396+0000","last_became_peered":"2024-05-03T22:12:36.000396+0000","last_unstale":"2024-05-03T22:14:38.292473+0000","last_undegraded":"2024-05-03T22:14:38.292473+0000","last_fullsized":"2024-05-03T22:14:38.292473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:13:50.457303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291420+0000","last_change":"2024-05-03T22:12:52.138524+0000","last_active":"2024-05-03T22:14:38.291420+0000","last_peered":"2024-05-03T22:14:38.291420+0000","last_clean":"2024-05-03T22:14:38.291420+0000","last_became_active":"2024-05-03T22:12:52.136455+0000","last_became_peered":"2024-05-03T22:12:52.136455+0000","last_unstale":"2024-05-03T22:14:38.291420+0000","last_undegraded":"2024-05-03T22:14:38.291420+0000","last_fullsized":"2024-05-03T22:14:38.291420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:46:24.807062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":117,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:42.741634+0000","last_change":"2024-05-03T22:14:38.745729+0000","last_active":"2024-05-03T22:14:42.741634+0000","last_peered":"2024-05-03T22:14:42.741634+0000","last_clean":"2024-05-03T22:14:42.741634+0000","last_became_active":"2024-05-03T22:14:38.730211+0000","last_became_peered":"2024-05-03T22:14:38.730211+0000","last_unstale":"2024-05-03T22:14:42.741634+0000","last_undegraded":"2024-05-03T22:14:42.741634+0000","last_fullsized":"2024-05-03T22:14:42.741634+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:23:32.539747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290952+0000","last_change":"2024-05-03T22:12:36.008931+0000","last_active":"2024-05-03T22:14:38.290952+0000","last_peered":"2024-05-03T22:14:38.290952+0000","last_clean":"2024-05-03T22:14:38.290952+0000","last_became_active":"2024-05-03T22:12:36.008550+0000","last_became_peered":"2024-05-03T22:12:36.008550+0000","last_unstale":"2024-05-03T22:14:38.290952+0000","last_undegraded":"2024-05-03T22:14:38.290952+0000","last_fullsized":"2024-05-03T22:14:38.290952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:14.542598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283133+0000","last_change":"2024-05-03T22:13:37.973509+0000","last_active":"2024-05-03T22:14:38.283133+0000","last_peered":"2024-05-03T22:14:38.283133+0000","last_clean":"2024-05-03T22:14:38.283133+0000","last_became_active":"2024-05-03T22:13:37.972160+0000","last_became_peered":"2024-05-03T22:13:37.972160+0000","last_unstale":"2024-05-03T22:14:38.283133+0000","last_undegraded":"2024-05-03T22:14:38.283133+0000","last_fullsized":"2024-05-03T22:14:38.283133+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:04.292667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291284+0000","last_change":"2024-05-03T22:12:32.023501+0000","last_active":"2024-05-03T22:14:38.291284+0000","last_peered":"2024-05-03T22:14:38.291284+0000","last_clean":"2024-05-03T22:14:38.291284+0000","last_became_active":"2024-05-03T22:12:32.022961+0000","last_became_peered":"2024-05-03T22:12:32.022961+0000","last_unstale":"2024-05-03T22:14:38.291284+0000","last_undegraded":"2024-05-03T22:14:38.291284+0000","last_fullsized":"2024-05-03T22:14:38.291284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:03:42.477600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298613+0000","last_change":"2024-05-03T22:12:36.003449+0000","last_active":"2024-05-03T22:14:38.298613+0000","last_peered":"2024-05-03T22:14:38.298613+0000","last_clean":"2024-05-03T22:14:38.298613+0000","last_became_active":"2024-05-03T22:12:36.002257+0000","last_became_peered":"2024-05-03T22:12:36.002257+0000","last_unstale":"2024-05-03T22:14:38.298613+0000","last_undegraded":"2024-05-03T22:14:38.298613+0000","last_fullsized":"2024-05-03T22:14:38.298613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:52:38.409271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283373+0000","last_change":"2024-05-03T22:12:52.143583+0000","last_active":"2024-05-03T22:14:38.283373+0000","last_peered":"2024-05-03T22:14:38.283373+0000","last_clean":"2024-05-03T22:14:38.283373+0000","last_became_active":"2024-05-03T22:12:52.142656+0000","last_became_peered":"2024-05-03T22:12:52.142656+0000","last_unstale":"2024-05-03T22:14:38.283373+0000","last_undegraded":"2024-05-03T22:14:38.283373+0000","last_fullsized":"2024-05-03T22:14:38.283373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:13:37.342909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285654+0000","last_change":"2024-05-03T22:12:31.985223+0000","last_active":"2024-05-03T22:14:38.285654+0000","last_peered":"2024-05-03T22:14:38.285654+0000","last_clean":"2024-05-03T22:14:38.285654+0000","last_became_active":"2024-05-03T22:12:31.984728+0000","last_became_peered":"2024-05-03T22:12:31.984728+0000","last_unstale":"2024-05-03T22:14:38.285654+0000","last_undegraded":"2024-05-03T22:14:38.285654+0000","last_fullsized":"2024-05-03T22:14:38.285654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:16.493672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728320+0000","last_change":"2024-05-03T22:12:35.999341+0000","last_active":"2024-05-03T22:14:38.728320+0000","last_peered":"2024-05-03T22:14:38.728320+0000","last_clean":"2024-05-03T22:14:38.728320+0000","last_became_active":"2024-05-03T22:12:35.998263+0000","last_became_peered":"2024-05-03T22:12:35.998263+0000","last_unstale":"2024-05-03T22:14:38.728320+0000","last_undegraded":"2024-05-03T22:14:38.728320+0000","last_fullsized":"2024-05-03T22:14:38.728320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:48:23.344678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283271+0000","last_change":"2024-05-03T22:12:52.137263+0000","last_active":"2024-05-03T22:14:38.283271+0000","last_peered":"2024-05-03T22:14:38.283271+0000","last_clean":"2024-05-03T22:14:38.283271+0000","last_became_active":"2024-05-03T22:12:52.136252+0000","last_became_peered":"2024-05-03T22:12:52.136252+0000","last_unstale":"2024-05-03T22:14:38.283271+0000","last_undegraded":"2024-05-03T22:14:38.283271+0000","last_fullsized":"2024-05-03T22:14:38.283271+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:51:13.215710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285267+0000","last_change":"2024-05-03T22:12:31.981027+0000","last_active":"2024-05-03T22:14:38.285267+0000","last_peered":"2024-05-03T22:14:38.285267+0000","last_clean":"2024-05-03T22:14:38.285267+0000","last_became_active":"2024-05-03T22:12:31.980525+0000","last_became_peered":"2024-05-03T22:12:31.980525+0000","last_unstale":"2024-05-03T22:14:38.285267+0000","last_undegraded":"2024-05-03T22:14:38.285267+0000","last_fullsized":"2024-05-03T22:14:38.285267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:45:00.651947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038089+0000","last_change":"2024-05-03T22:12:36.018950+0000","last_active":"2024-05-03T22:14:39.038089+0000","last_peered":"2024-05-03T22:14:39.038089+0000","last_clean":"2024-05-03T22:14:39.038089+0000","last_became_active":"2024-05-03T22:12:36.018617+0000","last_became_peered":"2024-05-03T22:12:36.018617+0000","last_unstale":"2024-05-03T22:14:39.038089+0000","last_undegraded":"2024-05-03T22:14:39.038089+0000","last_fullsized":"2024-05-03T22:14:39.038089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:14:03.619225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.292214+0000","last_change":"2024-05-03T22:12:52.127174+0000","last_active":"2024-05-03T22:14:38.292214+0000","last_peered":"2024-05-03T22:14:38.292214+0000","last_clean":"2024-05-03T22:14:38.292214+0000","last_became_active":"2024-05-03T22:12:52.125762+0000","last_became_peered":"2024-05-03T22:12:52.125762+0000","last_unstale":"2024-05-03T22:14:38.292214+0000","last_undegraded":"2024-05-03T22:14:38.292214+0000","last_fullsized":"2024-05-03T22:14:38.292214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:21:20.502831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'6","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.232152+0000","last_change":"2024-05-03T22:12:31.983721+0000","last_active":"2024-05-03T22:14:39.232152+0000","last_peered":"2024-05-03T22:14:39.232152+0000","last_clean":"2024-05-03T22:14:39.232152+0000","last_became_active":"2024-05-03T22:12:31.983192+0000","last_became_peered":"2024-05-03T22:12:31.983192+0000","last_unstale":"2024-05-03T22:14:39.232152+0000","last_undegraded":"2024-05-03T22:14:39.232152+0000","last_fullsized":"2024-05-03T22:14:39.232152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:02:28.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284799+0000","last_change":"2024-05-03T22:12:36.012909+0000","last_active":"2024-05-03T22:14:38.284799+0000","last_peered":"2024-05-03T22:14:38.284799+0000","last_clean":"2024-05-03T22:14:38.284799+0000","last_became_active":"2024-05-03T22:12:36.011402+0000","last_became_peered":"2024-05-03T22:12:36.011402+0000","last_unstale":"2024-05-03T22:14:38.284799+0000","last_undegraded":"2024-05-03T22:14:38.284799+0000","last_fullsized":"2024-05-03T22:14:38.284799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:46:31.464317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291628+0000","last_change":"2024-05-03T22:13:37.973869+0000","last_active":"2024-05-03T22:14:38.291628+0000","last_peered":"2024-05-03T22:14:38.291628+0000","last_clean":"2024-05-03T22:14:38.291628+0000","last_became_active":"2024-05-03T22:13:37.972089+0000","last_became_peered":"2024-05-03T22:13:37.972089+0000","last_unstale":"2024-05-03T22:14:38.291628+0000","last_undegraded":"2024-05-03T22:14:38.291628+0000","last_fullsized":"2024-05-03T22:14:38.291628+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:18:00.510183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,10],"acting":[2,6,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036203+0000","last_change":"2024-05-03T22:12:31.984789+0000","last_active":"2024-05-03T22:14:39.036203+0000","last_peered":"2024-05-03T22:14:39.036203+0000","last_clean":"2024-05-03T22:14:39.036203+0000","last_became_active":"2024-05-03T22:12:31.980106+0000","last_became_peered":"2024-05-03T22:12:31.980106+0000","last_unstale":"2024-05-03T22:14:39.036203+0000","last_undegraded":"2024-05-03T22:14:39.036203+0000","last_fullsized":"2024-05-03T22:14:39.036203+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:50:09.564802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038196+0000","last_change":"2024-05-03T22:13:37.973316+0000","last_active":"2024-05-03T22:14:39.038196+0000","last_peered":"2024-05-03T22:14:39.038196+0000","last_clean":"2024-05-03T22:14:39.038196+0000","last_became_active":"2024-05-03T22:13:37.972152+0000","last_became_peered":"2024-05-03T22:13:37.972152+0000","last_unstale":"2024-05-03T22:14:39.038196+0000","last_undegraded":"2024-05-03T22:14:39.038196+0000","last_fullsized":"2024-05-03T22:14:39.038196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:23:21.940322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287404+0000","last_change":"2024-05-03T22:12:52.145126+0000","last_active":"2024-05-03T22:14:38.287404+0000","last_peered":"2024-05-03T22:14:38.287404+0000","last_clean":"2024-05-03T22:14:38.287404+0000","last_became_active":"2024-05-03T22:12:52.144544+0000","last_became_peered":"2024-05-03T22:12:52.144544+0000","last_unstale":"2024-05-03T22:14:38.287404+0000","last_undegraded":"2024-05-03T22:14:38.287404+0000","last_fullsized":"2024-05-03T22:14:38.287404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:59:54.069750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287087+0000","last_change":"2024-05-03T22:12:31.978411+0000","last_active":"2024-05-03T22:14:38.287087+0000","last_peered":"2024-05-03T22:14:38.287087+0000","last_clean":"2024-05-03T22:14:38.287087+0000","last_became_active":"2024-05-03T22:12:31.976914+0000","last_became_peered":"2024-05-03T22:12:31.976914+0000","last_unstale":"2024-05-03T22:14:38.287087+0000","last_undegraded":"2024-05-03T22:14:38.287087+0000","last_fullsized":"2024-05-03T22:14:38.287087+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:52:05.545111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290646+0000","last_change":"2024-05-03T22:12:36.014624+0000","last_active":"2024-05-03T22:14:38.290646+0000","last_peered":"2024-05-03T22:14:38.290646+0000","last_clean":"2024-05-03T22:14:38.290646+0000","last_became_active":"2024-05-03T22:12:36.012531+0000","last_became_peered":"2024-05-03T22:12:36.012531+0000","last_unstale":"2024-05-03T22:14:38.290646+0000","last_undegraded":"2024-05-03T22:14:38.290646+0000","last_fullsized":"2024-05-03T22:14:38.290646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:19:46.840442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297996+0000","last_change":"2024-05-03T22:12:52.137187+0000","last_active":"2024-05-03T22:14:38.297996+0000","last_peered":"2024-05-03T22:14:38.297996+0000","last_clean":"2024-05-03T22:14:38.297996+0000","last_became_active":"2024-05-03T22:12:52.136764+0000","last_became_peered":"2024-05-03T22:12:52.136764+0000","last_unstale":"2024-05-03T22:14:38.297996+0000","last_undegraded":"2024-05-03T22:14:38.297996+0000","last_fullsized":"2024-05-03T22:14:38.297996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:54:00.922048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037241+0000","last_change":"2024-05-03T22:12:31.982086+0000","last_active":"2024-05-03T22:14:39.037241+0000","last_peered":"2024-05-03T22:14:39.037241+0000","last_clean":"2024-05-03T22:14:39.037241+0000","last_became_active":"2024-05-03T22:12:31.981464+0000","last_became_peered":"2024-05-03T22:12:31.981464+0000","last_unstale":"2024-05-03T22:14:39.037241+0000","last_undegraded":"2024-05-03T22:14:39.037241+0000","last_fullsized":"2024-05-03T22:14:39.037241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:22.450640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283028+0000","last_change":"2024-05-03T22:12:36.015808+0000","last_active":"2024-05-03T22:14:38.283028+0000","last_peered":"2024-05-03T22:14:38.283028+0000","last_clean":"2024-05-03T22:14:38.283028+0000","last_became_active":"2024-05-03T22:12:36.015496+0000","last_became_peered":"2024-05-03T22:12:36.015496+0000","last_unstale":"2024-05-03T22:14:38.283028+0000","last_undegraded":"2024-05-03T22:14:38.283028+0000","last_fullsized":"2024-05-03T22:14:38.283028+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:12:18.316985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291624+0000","last_change":"2024-05-03T22:12:52.131977+0000","last_active":"2024-05-03T22:14:38.291624+0000","last_peered":"2024-05-03T22:14:38.291624+0000","last_clean":"2024-05-03T22:14:38.291624+0000","last_became_active":"2024-05-03T22:12:52.131120+0000","last_became_peered":"2024-05-03T22:12:52.131120+0000","last_unstale":"2024-05-03T22:14:38.291624+0000","last_undegraded":"2024-05-03T22:14:38.291624+0000","last_fullsized":"2024-05-03T22:14:38.291624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:38:28.239495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":118,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:40.231096+0000","last_change":"2024-05-03T22:12:31.977238+0000","last_active":"2024-05-03T22:14:40.231096+0000","last_peered":"2024-05-03T22:14:40.231096+0000","last_clean":"2024-05-03T22:14:40.231096+0000","last_became_active":"2024-05-03T22:12:31.975006+0000","last_became_peered":"2024-05-03T22:12:31.975006+0000","last_unstale":"2024-05-03T22:14:40.231096+0000","last_undegraded":"2024-05-03T22:14:40.231096+0000","last_fullsized":"2024-05-03T22:14:40.231096+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:01.030733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728502+0000","last_change":"2024-05-03T22:12:36.007750+0000","last_active":"2024-05-03T22:14:38.728502+0000","last_peered":"2024-05-03T22:14:38.728502+0000","last_clean":"2024-05-03T22:14:38.728502+0000","last_became_active":"2024-05-03T22:12:36.005505+0000","last_became_peered":"2024-05-03T22:12:36.005505+0000","last_unstale":"2024-05-03T22:14:38.728502+0000","last_undegraded":"2024-05-03T22:14:38.728502+0000","last_fullsized":"2024-05-03T22:14:38.728502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:37:28.409920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283140+0000","last_change":"2024-05-03T22:12:52.142733+0000","last_active":"2024-05-03T22:14:38.283140+0000","last_peered":"2024-05-03T22:14:38.283140+0000","last_clean":"2024-05-03T22:14:38.283140+0000","last_became_active":"2024-05-03T22:12:52.142186+0000","last_became_peered":"2024-05-03T22:12:52.142186+0000","last_unstale":"2024-05-03T22:14:38.283140+0000","last_undegraded":"2024-05-03T22:14:38.283140+0000","last_fullsized":"2024-05-03T22:14:38.283140+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:05:12.226021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289088+0000","last_change":"2024-05-03T22:12:31.984945+0000","last_active":"2024-05-03T22:14:38.289088+0000","last_peered":"2024-05-03T22:14:38.289088+0000","last_clean":"2024-05-03T22:14:38.289088+0000","last_became_active":"2024-05-03T22:12:31.982844+0000","last_became_peered":"2024-05-03T22:12:31.982844+0000","last_unstale":"2024-05-03T22:14:38.289088+0000","last_undegraded":"2024-05-03T22:14:38.289088+0000","last_fullsized":"2024-05-03T22:14:38.289088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:51:13.520574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298901+0000","last_change":"2024-05-03T22:12:36.010250+0000","last_active":"2024-05-03T22:14:38.298901+0000","last_peered":"2024-05-03T22:14:38.298901+0000","last_clean":"2024-05-03T22:14:38.298901+0000","last_became_active":"2024-05-03T22:12:36.009867+0000","last_became_peered":"2024-05-03T22:12:36.009867+0000","last_unstale":"2024-05-03T22:14:38.298901+0000","last_undegraded":"2024-05-03T22:14:38.298901+0000","last_fullsized":"2024-05-03T22:14:38.298901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:21:07.114667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283475+0000","last_change":"2024-05-03T22:13:37.973331+0000","last_active":"2024-05-03T22:14:38.283475+0000","last_peered":"2024-05-03T22:14:38.283475+0000","last_clean":"2024-05-03T22:14:38.283475+0000","last_became_active":"2024-05-03T22:13:37.972030+0000","last_became_peered":"2024-05-03T22:13:37.972030+0000","last_unstale":"2024-05-03T22:14:38.283475+0000","last_undegraded":"2024-05-03T22:14:38.283475+0000","last_fullsized":"2024-05-03T22:14:38.283475+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:11:18.105975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037779+0000","last_change":"2024-05-03T22:12:32.021662+0000","last_active":"2024-05-03T22:14:39.037779+0000","last_peered":"2024-05-03T22:14:39.037779+0000","last_clean":"2024-05-03T22:14:39.037779+0000","last_became_active":"2024-05-03T22:12:32.021128+0000","last_became_peered":"2024-05-03T22:12:32.021128+0000","last_unstale":"2024-05-03T22:14:39.037779+0000","last_undegraded":"2024-05-03T22:14:39.037779+0000","last_fullsized":"2024-05-03T22:14:39.037779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:08:02.608160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728461+0000","last_change":"2024-05-03T22:13:37.973105+0000","last_active":"2024-05-03T22:14:38.728461+0000","last_peered":"2024-05-03T22:14:38.728461+0000","last_clean":"2024-05-03T22:14:38.728461+0000","last_became_active":"2024-05-03T22:13:37.971963+0000","last_became_peered":"2024-05-03T22:13:37.971963+0000","last_unstale":"2024-05-03T22:14:38.728461+0000","last_undegraded":"2024-05-03T22:14:38.728461+0000","last_fullsized":"2024-05-03T22:14:38.728461+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:22:50.092753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283115+0000","last_change":"2024-05-03T22:12:52.140596+0000","last_active":"2024-05-03T22:14:38.283115+0000","last_peered":"2024-05-03T22:14:38.283115+0000","last_clean":"2024-05-03T22:14:38.283115+0000","last_became_active":"2024-05-03T22:12:52.140185+0000","last_became_peered":"2024-05-03T22:12:52.140185+0000","last_unstale":"2024-05-03T22:14:38.283115+0000","last_undegraded":"2024-05-03T22:14:38.283115+0000","last_fullsized":"2024-05-03T22:14:38.283115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:01:53.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'35","reported_seq":158,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:40.249849+0000","last_change":"2024-05-03T22:12:31.984670+0000","last_active":"2024-05-03T22:14:40.249849+0000","last_peered":"2024-05-03T22:14:40.249849+0000","last_clean":"2024-05-03T22:14:40.249849+0000","last_became_active":"2024-05-03T22:12:31.983939+0000","last_became_peered":"2024-05-03T22:12:31.983939+0000","last_unstale":"2024-05-03T22:14:40.249849+0000","last_undegraded":"2024-05-03T22:14:40.249849+0000","last_fullsized":"2024-05-03T22:14:40.249849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:29:13.702952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57951,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":95,"num_write":37,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285294+0000","last_change":"2024-05-03T22:12:36.010032+0000","last_active":"2024-05-03T22:14:38.285294+0000","last_peered":"2024-05-03T22:14:38.285294+0000","last_clean":"2024-05-03T22:14:38.285294+0000","last_became_active":"2024-05-03T22:12:36.009682+0000","last_became_peered":"2024-05-03T22:12:36.009682+0000","last_unstale":"2024-05-03T22:14:38.285294+0000","last_undegraded":"2024-05-03T22:14:38.285294+0000","last_fullsized":"2024-05-03T22:14:38.285294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:58.307939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038671+0000","last_change":"2024-05-03T22:12:52.137858+0000","last_active":"2024-05-03T22:14:39.038671+0000","last_peered":"2024-05-03T22:14:39.038671+0000","last_clean":"2024-05-03T22:14:39.038671+0000","last_became_active":"2024-05-03T22:12:52.137343+0000","last_became_peered":"2024-05-03T22:12:52.137343+0000","last_unstale":"2024-05-03T22:14:39.038671+0000","last_undegraded":"2024-05-03T22:14:39.038671+0000","last_fullsized":"2024-05-03T22:14:39.038671+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:30:20.534943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291954+0000","last_change":"2024-05-03T22:12:31.986574+0000","last_active":"2024-05-03T22:14:38.291954+0000","last_peered":"2024-05-03T22:14:38.291954+0000","last_clean":"2024-05-03T22:14:38.291954+0000","last_became_active":"2024-05-03T22:12:31.986168+0000","last_became_peered":"2024-05-03T22:12:31.986168+0000","last_unstale":"2024-05-03T22:14:38.291954+0000","last_undegraded":"2024-05-03T22:14:38.291954+0000","last_fullsized":"2024-05-03T22:14:38.291954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:09:22.184243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287336+0000","last_change":"2024-05-03T22:12:36.008859+0000","last_active":"2024-05-03T22:14:38.287336+0000","last_peered":"2024-05-03T22:14:38.287336+0000","last_clean":"2024-05-03T22:14:38.287336+0000","last_became_active":"2024-05-03T22:12:36.008301+0000","last_became_peered":"2024-05-03T22:12:36.008301+0000","last_unstale":"2024-05-03T22:14:38.287336+0000","last_undegraded":"2024-05-03T22:14:38.287336+0000","last_fullsized":"2024-05-03T22:14:38.287336+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:09:51.945525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288086+0000","last_change":"2024-05-03T22:12:52.143678+0000","last_active":"2024-05-03T22:14:38.288086+0000","last_peered":"2024-05-03T22:14:38.288086+0000","last_clean":"2024-05-03T22:14:38.288086+0000","last_became_active":"2024-05-03T22:12:52.143240+0000","last_became_peered":"2024-05-03T22:12:52.143240+0000","last_unstale":"2024-05-03T22:14:38.288086+0000","last_undegraded":"2024-05-03T22:14:38.288086+0000","last_fullsized":"2024-05-03T22:14:38.288086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:03.078230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037591+0000","last_change":"2024-05-03T22:12:31.987181+0000","last_active":"2024-05-03T22:14:39.037591+0000","last_peered":"2024-05-03T22:14:39.037591+0000","last_clean":"2024-05-03T22:14:39.037591+0000","last_became_active":"2024-05-03T22:12:31.986795+0000","last_became_peered":"2024-05-03T22:12:31.986795+0000","last_unstale":"2024-05-03T22:14:39.037591+0000","last_undegraded":"2024-05-03T22:14:39.037591+0000","last_fullsized":"2024-05-03T22:14:39.037591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:03.871175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289467+0000","last_change":"2024-05-03T22:12:36.023303+0000","last_active":"2024-05-03T22:14:38.289467+0000","last_peered":"2024-05-03T22:14:38.289467+0000","last_clean":"2024-05-03T22:14:38.289467+0000","last_became_active":"2024-05-03T22:12:36.022969+0000","last_became_peered":"2024-05-03T22:12:36.022969+0000","last_unstale":"2024-05-03T22:14:38.289467+0000","last_undegraded":"2024-05-03T22:14:38.289467+0000","last_fullsized":"2024-05-03T22:14:38.289467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:08:19.277423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283869+0000","last_change":"2024-05-03T22:12:52.145449+0000","last_active":"2024-05-03T22:14:38.283869+0000","last_peered":"2024-05-03T22:14:38.283869+0000","last_clean":"2024-05-03T22:14:38.283869+0000","last_became_active":"2024-05-03T22:12:52.144652+0000","last_became_peered":"2024-05-03T22:12:52.144652+0000","last_unstale":"2024-05-03T22:14:38.283869+0000","last_undegraded":"2024-05-03T22:14:38.283869+0000","last_fullsized":"2024-05-03T22:14:38.283869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:03:17.916994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":87,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:40.255147+0000","last_change":"2024-05-03T22:12:31.986355+0000","last_active":"2024-05-03T22:14:40.255147+0000","last_peered":"2024-05-03T22:14:40.255147+0000","last_clean":"2024-05-03T22:14:40.255147+0000","last_became_active":"2024-05-03T22:12:31.985927+0000","last_became_peered":"2024-05-03T22:12:31.985927+0000","last_unstale":"2024-05-03T22:14:40.255147+0000","last_undegraded":"2024-05-03T22:14:40.255147+0000","last_fullsized":"2024-05-03T22:14:40.255147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:25:41.683036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288851+0000","last_change":"2024-05-03T22:13:37.973243+0000","last_active":"2024-05-03T22:14:38.288851+0000","last_peered":"2024-05-03T22:14:38.288851+0000","last_clean":"2024-05-03T22:14:38.288851+0000","last_became_active":"2024-05-03T22:13:37.972204+0000","last_became_peered":"2024-05-03T22:13:37.972204+0000","last_unstale":"2024-05-03T22:14:38.288851+0000","last_undegraded":"2024-05-03T22:14:38.288851+0000","last_fullsized":"2024-05-03T22:14:38.288851+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:58:23.537262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289736+0000","last_change":"2024-05-03T22:12:52.137933+0000","last_active":"2024-05-03T22:14:38.289736+0000","last_peered":"2024-05-03T22:14:38.289736+0000","last_clean":"2024-05-03T22:14:38.289736+0000","last_became_active":"2024-05-03T22:12:52.137339+0000","last_became_peered":"2024-05-03T22:12:52.137339+0000","last_unstale":"2024-05-03T22:14:38.289736+0000","last_undegraded":"2024-05-03T22:14:38.289736+0000","last_fullsized":"2024-05-03T22:14:38.289736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:10:11.514234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":62,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284464+0000","last_change":"2024-05-03T22:12:32.023719+0000","last_active":"2024-05-03T22:14:38.284464+0000","last_peered":"2024-05-03T22:14:38.284464+0000","last_clean":"2024-05-03T22:14:38.284464+0000","last_became_active":"2024-05-03T22:12:32.022649+0000","last_became_peered":"2024-05-03T22:12:32.022649+0000","last_unstale":"2024-05-03T22:14:38.284464+0000","last_undegraded":"2024-05-03T22:14:38.284464+0000","last_fullsized":"2024-05-03T22:14:38.284464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:24:46.321843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037569+0000","last_change":"2024-05-03T22:12:36.019586+0000","last_active":"2024-05-03T22:14:39.037569+0000","last_peered":"2024-05-03T22:14:39.037569+0000","last_clean":"2024-05-03T22:14:39.037569+0000","last_became_active":"2024-05-03T22:12:36.019209+0000","last_became_peered":"2024-05-03T22:12:36.019209+0000","last_unstale":"2024-05-03T22:14:39.037569+0000","last_undegraded":"2024-05-03T22:14:39.037569+0000","last_fullsized":"2024-05-03T22:14:39.037569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:05:31.897550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037235+0000","last_change":"2024-05-03T22:12:52.137116+0000","last_active":"2024-05-03T22:14:39.037235+0000","last_peered":"2024-05-03T22:14:39.037235+0000","last_clean":"2024-05-03T22:14:39.037235+0000","last_became_active":"2024-05-03T22:12:52.135908+0000","last_became_peered":"2024-05-03T22:12:52.135908+0000","last_unstale":"2024-05-03T22:14:39.037235+0000","last_undegraded":"2024-05-03T22:14:39.037235+0000","last_fullsized":"2024-05-03T22:14:39.037235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:44.728662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284889+0000","last_change":"2024-05-03T22:12:31.982743+0000","last_active":"2024-05-03T22:14:38.284889+0000","last_peered":"2024-05-03T22:14:38.284889+0000","last_clean":"2024-05-03T22:14:38.284889+0000","last_became_active":"2024-05-03T22:12:31.982181+0000","last_became_peered":"2024-05-03T22:12:31.982181+0000","last_unstale":"2024-05-03T22:14:38.284889+0000","last_undegraded":"2024-05-03T22:14:38.284889+0000","last_fullsized":"2024-05-03T22:14:38.284889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:55:32.178361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288347+0000","last_change":"2024-05-03T22:12:36.017581+0000","last_active":"2024-05-03T22:14:38.288347+0000","last_peered":"2024-05-03T22:14:38.288347+0000","last_clean":"2024-05-03T22:14:38.288347+0000","last_became_active":"2024-05-03T22:12:36.017156+0000","last_became_peered":"2024-05-03T22:12:36.017156+0000","last_unstale":"2024-05-03T22:14:38.288347+0000","last_undegraded":"2024-05-03T22:14:38.288347+0000","last_fullsized":"2024-05-03T22:14:38.288347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:05:47.432249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284751+0000","last_change":"2024-05-03T22:12:52.149798+0000","last_active":"2024-05-03T22:14:38.284751+0000","last_peered":"2024-05-03T22:14:38.284751+0000","last_clean":"2024-05-03T22:14:38.284751+0000","last_became_active":"2024-05-03T22:12:52.149184+0000","last_became_peered":"2024-05-03T22:12:52.149184+0000","last_unstale":"2024-05-03T22:14:38.284751+0000","last_undegraded":"2024-05-03T22:14:38.284751+0000","last_fullsized":"2024-05-03T22:14:38.284751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:21:38.968847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283619+0000","last_change":"2024-05-03T22:12:32.022315+0000","last_active":"2024-05-03T22:14:38.283619+0000","last_peered":"2024-05-03T22:14:38.283619+0000","last_clean":"2024-05-03T22:14:38.283619+0000","last_became_active":"2024-05-03T22:12:32.021730+0000","last_became_peered":"2024-05-03T22:12:32.021730+0000","last_unstale":"2024-05-03T22:14:38.283619+0000","last_undegraded":"2024-05-03T22:14:38.283619+0000","last_fullsized":"2024-05-03T22:14:38.283619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:26.485434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036593+0000","last_change":"2024-05-03T22:12:36.004242+0000","last_active":"2024-05-03T22:14:39.036593+0000","last_peered":"2024-05-03T22:14:39.036593+0000","last_clean":"2024-05-03T22:14:39.036593+0000","last_became_active":"2024-05-03T22:12:36.003811+0000","last_became_peered":"2024-05-03T22:12:36.003811+0000","last_unstale":"2024-05-03T22:14:39.036593+0000","last_undegraded":"2024-05-03T22:14:39.036593+0000","last_fullsized":"2024-05-03T22:14:39.036593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:16:57.058316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289573+0000","last_change":"2024-05-03T22:12:52.125889+0000","last_active":"2024-05-03T22:14:38.289573+0000","last_peered":"2024-05-03T22:14:38.289573+0000","last_clean":"2024-05-03T22:14:38.289573+0000","last_became_active":"2024-05-03T22:12:52.125401+0000","last_became_peered":"2024-05-03T22:12:52.125401+0000","last_unstale":"2024-05-03T22:14:38.289573+0000","last_undegraded":"2024-05-03T22:14:38.289573+0000","last_fullsized":"2024-05-03T22:14:38.289573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:32:11.112125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'6","reported_seq":89,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:40.737328+0000","last_change":"2024-05-03T22:12:31.981194+0000","last_active":"2024-05-03T22:14:40.737328+0000","last_peered":"2024-05-03T22:14:40.737328+0000","last_clean":"2024-05-03T22:14:40.737328+0000","last_became_active":"2024-05-03T22:12:31.980685+0000","last_became_peered":"2024-05-03T22:12:31.980685+0000","last_unstale":"2024-05-03T22:14:40.737328+0000","last_undegraded":"2024-05-03T22:14:40.737328+0000","last_fullsized":"2024-05-03T22:14:40.737328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:00:04.697119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036298+0000","last_change":"2024-05-03T22:12:36.020405+0000","last_active":"2024-05-03T22:14:39.036298+0000","last_peered":"2024-05-03T22:14:39.036298+0000","last_clean":"2024-05-03T22:14:39.036298+0000","last_became_active":"2024-05-03T22:12:36.020003+0000","last_became_peered":"2024-05-03T22:12:36.020003+0000","last_unstale":"2024-05-03T22:14:39.036298+0000","last_undegraded":"2024-05-03T22:14:39.036298+0000","last_fullsized":"2024-05-03T22:14:39.036298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:21:49.931145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291248+0000","last_change":"2024-05-03T22:12:52.130467+0000","last_active":"2024-05-03T22:14:38.291248+0000","last_peered":"2024-05-03T22:14:38.291248+0000","last_clean":"2024-05-03T22:14:38.291248+0000","last_became_active":"2024-05-03T22:12:52.129639+0000","last_became_peered":"2024-05-03T22:12:52.129639+0000","last_unstale":"2024-05-03T22:14:38.291248+0000","last_undegraded":"2024-05-03T22:14:38.291248+0000","last_fullsized":"2024-05-03T22:14:38.291248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:31:17.043909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037896+0000","last_change":"2024-05-03T22:12:36.010293+0000","last_active":"2024-05-03T22:14:39.037896+0000","last_peered":"2024-05-03T22:14:39.037896+0000","last_clean":"2024-05-03T22:14:39.037896+0000","last_became_active":"2024-05-03T22:12:36.009682+0000","last_became_peered":"2024-05-03T22:12:36.009682+0000","last_unstale":"2024-05-03T22:14:39.037896+0000","last_undegraded":"2024-05-03T22:14:39.037896+0000","last_fullsized":"2024-05-03T22:14:39.037896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:19:32.824272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":87,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:40.254129+0000","last_change":"2024-05-03T22:12:32.019614+0000","last_active":"2024-05-03T22:14:40.254129+0000","last_peered":"2024-05-03T22:14:40.254129+0000","last_clean":"2024-05-03T22:14:40.254129+0000","last_became_active":"2024-05-03T22:12:32.018880+0000","last_became_peered":"2024-05-03T22:12:32.018880+0000","last_unstale":"2024-05-03T22:14:40.254129+0000","last_undegraded":"2024-05-03T22:14:40.254129+0000","last_fullsized":"2024-05-03T22:14:40.254129+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:01:46.354811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288968+0000","last_change":"2024-05-03T22:12:52.142829+0000","last_active":"2024-05-03T22:14:38.288968+0000","last_peered":"2024-05-03T22:14:38.288968+0000","last_clean":"2024-05-03T22:14:38.288968+0000","last_became_active":"2024-05-03T22:12:52.142289+0000","last_became_peered":"2024-05-03T22:12:52.142289+0000","last_unstale":"2024-05-03T22:14:38.288968+0000","last_undegraded":"2024-05-03T22:14:38.288968+0000","last_fullsized":"2024-05-03T22:14:38.288968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:54:44.815014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.293260+0000","last_change":"2024-05-03T22:12:36.009551+0000","last_active":"2024-05-03T22:14:38.293260+0000","last_peered":"2024-05-03T22:14:38.293260+0000","last_clean":"2024-05-03T22:14:38.293260+0000","last_became_active":"2024-05-03T22:12:36.009180+0000","last_became_peered":"2024-05-03T22:12:36.009180+0000","last_unstale":"2024-05-03T22:14:38.293260+0000","last_undegraded":"2024-05-03T22:14:38.293260+0000","last_fullsized":"2024-05-03T22:14:38.293260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:03:17.824610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283475+0000","last_change":"2024-05-03T22:12:31.988051+0000","last_active":"2024-05-03T22:14:38.283475+0000","last_peered":"2024-05-03T22:14:38.283475+0000","last_clean":"2024-05-03T22:14:38.283475+0000","last_became_active":"2024-05-03T22:12:31.987641+0000","last_became_peered":"2024-05-03T22:12:31.987641+0000","last_unstale":"2024-05-03T22:14:38.283475+0000","last_undegraded":"2024-05-03T22:14:38.283475+0000","last_fullsized":"2024-05-03T22:14:38.283475+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:51:02.824815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":120,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288590+0000","last_change":"2024-05-03T22:10:37.173231+0000","last_active":"2024-05-03T22:14:38.288590+0000","last_peered":"2024-05-03T22:14:38.288590+0000","last_clean":"2024-05-03T22:14:38.288590+0000","last_became_active":"2024-05-03T22:10:37.157400+0000","last_became_peered":"2024-05-03T22:10:37.157400+0000","last_unstale":"2024-05-03T22:14:38.288590+0000","last_undegraded":"2024-05-03T22:14:38.288590+0000","last_fullsized":"2024-05-03T22:14:38.288590+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:05:53.333203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:05:53.333203+0000","last_clean_scrub_stamp":"2024-05-03T22:05:53.333203+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:51:06.825624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038851+0000","last_change":"2024-05-03T22:12:52.137851+0000","last_active":"2024-05-03T22:14:39.038851+0000","last_peered":"2024-05-03T22:14:39.038851+0000","last_clean":"2024-05-03T22:14:39.038851+0000","last_became_active":"2024-05-03T22:12:52.136608+0000","last_became_peered":"2024-05-03T22:12:52.136608+0000","last_unstale":"2024-05-03T22:14:39.038851+0000","last_undegraded":"2024-05-03T22:14:39.038851+0000","last_fullsized":"2024-05-03T22:14:39.038851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:43:59.013159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286653+0000","last_change":"2024-05-03T22:12:36.007079+0000","last_active":"2024-05-03T22:14:38.286653+0000","last_peered":"2024-05-03T22:14:38.286653+0000","last_clean":"2024-05-03T22:14:38.286653+0000","last_became_active":"2024-05-03T22:12:36.006737+0000","last_became_peered":"2024-05-03T22:12:36.006737+0000","last_unstale":"2024-05-03T22:14:38.286653+0000","last_undegraded":"2024-05-03T22:14:38.286653+0000","last_fullsized":"2024-05-03T22:14:38.286653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:24:56.805461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288714+0000","last_change":"2024-05-03T22:12:31.982718+0000","last_active":"2024-05-03T22:14:38.288714+0000","last_peered":"2024-05-03T22:14:38.288714+0000","last_clean":"2024-05-03T22:14:38.288714+0000","last_became_active":"2024-05-03T22:12:31.980502+0000","last_became_peered":"2024-05-03T22:12:31.980502+0000","last_unstale":"2024-05-03T22:14:38.288714+0000","last_undegraded":"2024-05-03T22:14:38.288714+0000","last_fullsized":"2024-05-03T22:14:38.288714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:06:48.543038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286693+0000","last_change":"2024-05-03T22:12:52.130775+0000","last_active":"2024-05-03T22:14:38.286693+0000","last_peered":"2024-05-03T22:14:38.286693+0000","last_clean":"2024-05-03T22:14:38.286693+0000","last_became_active":"2024-05-03T22:12:52.130122+0000","last_became_peered":"2024-05-03T22:12:52.130122+0000","last_unstale":"2024-05-03T22:14:38.286693+0000","last_undegraded":"2024-05-03T22:14:38.286693+0000","last_fullsized":"2024-05-03T22:14:38.286693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:49.308484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.314204+0000","last_change":"2024-05-03T22:14:38.313777+0000","last_active":"2024-05-03T22:14:38.314204+0000","last_peered":"2024-05-03T22:14:38.314204+0000","last_clean":"2024-05-03T22:14:38.314204+0000","last_became_active":"2024-05-03T22:14:38.298126+0000","last_became_peered":"2024-05-03T22:14:38.298126+0000","last_unstale":"2024-05-03T22:14:38.314204+0000","last_undegraded":"2024-05-03T22:14:38.314204+0000","last_fullsized":"2024-05-03T22:14:38.314204+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:24:15.804010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289442+0000","last_change":"2024-05-03T22:12:36.005260+0000","last_active":"2024-05-03T22:14:38.289442+0000","last_peered":"2024-05-03T22:14:38.289442+0000","last_clean":"2024-05-03T22:14:38.289442+0000","last_became_active":"2024-05-03T22:12:36.004942+0000","last_became_peered":"2024-05-03T22:12:36.004942+0000","last_unstale":"2024-05-03T22:14:38.289442+0000","last_undegraded":"2024-05-03T22:14:38.289442+0000","last_fullsized":"2024-05-03T22:14:38.289442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:46.395893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290518+0000","last_change":"2024-05-03T22:12:52.132278+0000","last_active":"2024-05-03T22:14:38.290518+0000","last_peered":"2024-05-03T22:14:38.290518+0000","last_clean":"2024-05-03T22:14:38.290518+0000","last_became_active":"2024-05-03T22:12:52.131836+0000","last_became_peered":"2024-05-03T22:12:52.131836+0000","last_unstale":"2024-05-03T22:14:38.290518+0000","last_undegraded":"2024-05-03T22:14:38.290518+0000","last_fullsized":"2024-05-03T22:14:38.290518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:54:07.305893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'14","reported_seq":59,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285617+0000","last_change":"2024-05-03T22:12:31.978324+0000","last_active":"2024-05-03T22:14:38.285617+0000","last_peered":"2024-05-03T22:14:38.285617+0000","last_clean":"2024-05-03T22:14:38.285617+0000","last_became_active":"2024-05-03T22:12:31.977156+0000","last_became_peered":"2024-05-03T22:12:31.977156+0000","last_unstale":"2024-05-03T22:14:38.285617+0000","last_undegraded":"2024-05-03T22:14:38.285617+0000","last_fullsized":"2024-05-03T22:14:38.285617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:45:28.549187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290903+0000","last_change":"2024-05-03T22:12:36.014986+0000","last_active":"2024-05-03T22:14:38.290903+0000","last_peered":"2024-05-03T22:14:38.290903+0000","last_clean":"2024-05-03T22:14:38.290903+0000","last_became_active":"2024-05-03T22:12:36.014664+0000","last_became_peered":"2024-05-03T22:12:36.014664+0000","last_unstale":"2024-05-03T22:14:38.290903+0000","last_undegraded":"2024-05-03T22:14:38.290903+0000","last_fullsized":"2024-05-03T22:14:38.290903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:46:13.807806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291263+0000","last_change":"2024-05-03T22:12:52.126771+0000","last_active":"2024-05-03T22:14:38.291263+0000","last_peered":"2024-05-03T22:14:38.291263+0000","last_clean":"2024-05-03T22:14:38.291263+0000","last_became_active":"2024-05-03T22:12:52.126257+0000","last_became_peered":"2024-05-03T22:12:52.126257+0000","last_unstale":"2024-05-03T22:14:38.291263+0000","last_undegraded":"2024-05-03T22:14:38.291263+0000","last_fullsized":"2024-05-03T22:14:38.291263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:53:03.823305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283848+0000","last_change":"2024-05-03T22:12:31.981674+0000","last_active":"2024-05-03T22:14:38.283848+0000","last_peered":"2024-05-03T22:14:38.283848+0000","last_clean":"2024-05-03T22:14:38.283848+0000","last_became_active":"2024-05-03T22:12:31.976707+0000","last_became_peered":"2024-05-03T22:12:31.976707+0000","last_unstale":"2024-05-03T22:14:38.283848+0000","last_undegraded":"2024-05-03T22:14:38.283848+0000","last_fullsized":"2024-05-03T22:14:38.283848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:44:21.743865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298440+0000","last_change":"2024-05-03T22:12:35.997309+0000","last_active":"2024-05-03T22:14:38.298440+0000","last_peered":"2024-05-03T22:14:38.298440+0000","last_clean":"2024-05-03T22:14:38.298440+0000","last_became_active":"2024-05-03T22:12:35.996879+0000","last_became_peered":"2024-05-03T22:12:35.996879+0000","last_unstale":"2024-05-03T22:14:38.298440+0000","last_undegraded":"2024-05-03T22:14:38.298440+0000","last_fullsized":"2024-05-03T22:14:38.298440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:01:25.009038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283744+0000","last_change":"2024-05-03T22:12:52.145503+0000","last_active":"2024-05-03T22:14:38.283744+0000","last_peered":"2024-05-03T22:14:38.283744+0000","last_clean":"2024-05-03T22:14:38.283744+0000","last_became_active":"2024-05-03T22:12:52.144719+0000","last_became_peered":"2024-05-03T22:12:52.144719+0000","last_unstale":"2024-05-03T22:14:38.283744+0000","last_undegraded":"2024-05-03T22:14:38.283744+0000","last_fullsized":"2024-05-03T22:14:38.283744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:49:30.683367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.727869+0000","last_change":"2024-05-03T22:12:32.019228+0000","last_active":"2024-05-03T22:14:38.727869+0000","last_peered":"2024-05-03T22:14:38.727869+0000","last_clean":"2024-05-03T22:14:38.727869+0000","last_became_active":"2024-05-03T22:12:32.018648+0000","last_became_peered":"2024-05-03T22:12:32.018648+0000","last_unstale":"2024-05-03T22:14:38.727869+0000","last_undegraded":"2024-05-03T22:14:38.727869+0000","last_fullsized":"2024-05-03T22:14:38.727869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:21.695600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284645+0000","last_change":"2024-05-03T22:12:36.012712+0000","last_active":"2024-05-03T22:14:38.284645+0000","last_peered":"2024-05-03T22:14:38.284645+0000","last_clean":"2024-05-03T22:14:38.284645+0000","last_became_active":"2024-05-03T22:12:36.012278+0000","last_became_peered":"2024-05-03T22:12:36.012278+0000","last_unstale":"2024-05-03T22:14:38.284645+0000","last_undegraded":"2024-05-03T22:14:38.284645+0000","last_fullsized":"2024-05-03T22:14:38.284645+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:16:21.511575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284049+0000","last_change":"2024-05-03T22:12:52.145070+0000","last_active":"2024-05-03T22:14:38.284049+0000","last_peered":"2024-05-03T22:14:38.284049+0000","last_clean":"2024-05-03T22:14:38.284049+0000","last_became_active":"2024-05-03T22:12:52.144071+0000","last_became_peered":"2024-05-03T22:12:52.144071+0000","last_unstale":"2024-05-03T22:14:38.284049+0000","last_undegraded":"2024-05-03T22:14:38.284049+0000","last_fullsized":"2024-05-03T22:14:38.284049+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:44:12.696121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291762+0000","last_change":"2024-05-03T22:12:31.971569+0000","last_active":"2024-05-03T22:14:38.291762+0000","last_peered":"2024-05-03T22:14:38.291762+0000","last_clean":"2024-05-03T22:14:38.291762+0000","last_became_active":"2024-05-03T22:12:31.970883+0000","last_became_peered":"2024-05-03T22:12:31.970883+0000","last_unstale":"2024-05-03T22:14:38.291762+0000","last_undegraded":"2024-05-03T22:14:38.291762+0000","last_fullsized":"2024-05-03T22:14:38.291762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:12:50.629452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286430+0000","last_change":"2024-05-03T22:12:36.019209+0000","last_active":"2024-05-03T22:14:38.286430+0000","last_peered":"2024-05-03T22:14:38.286430+0000","last_clean":"2024-05-03T22:14:38.286430+0000","last_became_active":"2024-05-03T22:12:36.018887+0000","last_became_peered":"2024-05-03T22:12:36.018887+0000","last_unstale":"2024-05-03T22:14:38.286430+0000","last_undegraded":"2024-05-03T22:14:38.286430+0000","last_fullsized":"2024-05-03T22:14:38.286430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:29:36.775592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283400+0000","last_change":"2024-05-03T22:12:52.145179+0000","last_active":"2024-05-03T22:14:38.283400+0000","last_peered":"2024-05-03T22:14:38.283400+0000","last_clean":"2024-05-03T22:14:38.283400+0000","last_became_active":"2024-05-03T22:12:52.144344+0000","last_became_peered":"2024-05-03T22:12:52.144344+0000","last_unstale":"2024-05-03T22:14:38.283400+0000","last_undegraded":"2024-05-03T22:14:38.283400+0000","last_fullsized":"2024-05-03T22:14:38.283400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:54:10.637934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.307151+0000","last_change":"2024-05-03T22:14:38.306297+0000","last_active":"2024-05-03T22:14:38.307151+0000","last_peered":"2024-05-03T22:14:38.307151+0000","last_clean":"2024-05-03T22:14:38.307151+0000","last_became_active":"2024-05-03T22:14:38.298089+0000","last_became_peered":"2024-05-03T22:14:38.298089+0000","last_unstale":"2024-05-03T22:14:38.307151+0000","last_undegraded":"2024-05-03T22:14:38.307151+0000","last_fullsized":"2024-05-03T22:14:38.307151+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:44.456436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290984+0000","last_change":"2024-05-03T22:12:36.002569+0000","last_active":"2024-05-03T22:14:38.290984+0000","last_peered":"2024-05-03T22:14:38.290984+0000","last_clean":"2024-05-03T22:14:38.290984+0000","last_became_active":"2024-05-03T22:12:36.002219+0000","last_became_peered":"2024-05-03T22:12:36.002219+0000","last_unstale":"2024-05-03T22:14:38.290984+0000","last_undegraded":"2024-05-03T22:14:38.290984+0000","last_fullsized":"2024-05-03T22:14:38.290984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:43:56.530139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283411+0000","last_change":"2024-05-03T22:12:52.137365+0000","last_active":"2024-05-03T22:14:38.283411+0000","last_peered":"2024-05-03T22:14:38.283411+0000","last_clean":"2024-05-03T22:14:38.283411+0000","last_became_active":"2024-05-03T22:12:52.136695+0000","last_became_peered":"2024-05-03T22:12:52.136695+0000","last_unstale":"2024-05-03T22:14:38.283411+0000","last_undegraded":"2024-05-03T22:14:38.283411+0000","last_fullsized":"2024-05-03T22:14:38.283411+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:06:05.439487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285095+0000","last_change":"2024-05-03T22:12:31.983289+0000","last_active":"2024-05-03T22:14:38.285095+0000","last_peered":"2024-05-03T22:14:38.285095+0000","last_clean":"2024-05-03T22:14:38.285095+0000","last_became_active":"2024-05-03T22:12:31.982873+0000","last_became_peered":"2024-05-03T22:12:31.982873+0000","last_unstale":"2024-05-03T22:14:38.285095+0000","last_undegraded":"2024-05-03T22:14:38.285095+0000","last_fullsized":"2024-05-03T22:14:38.285095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:50.973960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289050+0000","last_change":"2024-05-03T22:12:36.025173+0000","last_active":"2024-05-03T22:14:38.289050+0000","last_peered":"2024-05-03T22:14:38.289050+0000","last_clean":"2024-05-03T22:14:38.289050+0000","last_became_active":"2024-05-03T22:12:36.021875+0000","last_became_peered":"2024-05-03T22:12:36.021875+0000","last_unstale":"2024-05-03T22:14:38.289050+0000","last_undegraded":"2024-05-03T22:14:38.289050+0000","last_fullsized":"2024-05-03T22:14:38.289050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:05:15.963921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.727951+0000","last_change":"2024-05-03T22:12:52.132608+0000","last_active":"2024-05-03T22:14:38.727951+0000","last_peered":"2024-05-03T22:14:38.727951+0000","last_clean":"2024-05-03T22:14:38.727951+0000","last_became_active":"2024-05-03T22:12:52.132115+0000","last_became_peered":"2024-05-03T22:12:52.132115+0000","last_unstale":"2024-05-03T22:14:38.727951+0000","last_undegraded":"2024-05-03T22:14:38.727951+0000","last_fullsized":"2024-05-03T22:14:38.727951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:01:30.571145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":87,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:40.232093+0000","last_change":"2024-05-03T22:12:32.021562+0000","last_active":"2024-05-03T22:14:40.232093+0000","last_peered":"2024-05-03T22:14:40.232093+0000","last_clean":"2024-05-03T22:14:40.232093+0000","last_became_active":"2024-05-03T22:12:32.020913+0000","last_became_peered":"2024-05-03T22:12:32.020913+0000","last_unstale":"2024-05-03T22:14:40.232093+0000","last_undegraded":"2024-05-03T22:14:40.232093+0000","last_fullsized":"2024-05-03T22:14:40.232093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:02:37.549388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289368+0000","last_change":"2024-05-03T22:12:36.019237+0000","last_active":"2024-05-03T22:14:38.289368+0000","last_peered":"2024-05-03T22:14:38.289368+0000","last_clean":"2024-05-03T22:14:38.289368+0000","last_became_active":"2024-05-03T22:12:36.018411+0000","last_became_peered":"2024-05-03T22:12:36.018411+0000","last_unstale":"2024-05-03T22:14:38.289368+0000","last_undegraded":"2024-05-03T22:14:38.289368+0000","last_fullsized":"2024-05-03T22:14:38.289368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:45:59.701403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.296938+0000","last_change":"2024-05-03T22:12:52.146882+0000","last_active":"2024-05-03T22:14:38.296938+0000","last_peered":"2024-05-03T22:14:38.296938+0000","last_clean":"2024-05-03T22:14:38.296938+0000","last_became_active":"2024-05-03T22:12:52.146316+0000","last_became_peered":"2024-05-03T22:12:52.146316+0000","last_unstale":"2024-05-03T22:14:38.296938+0000","last_undegraded":"2024-05-03T22:14:38.296938+0000","last_fullsized":"2024-05-03T22:14:38.296938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:01:03.443777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038367+0000","last_change":"2024-05-03T22:12:31.983036+0000","last_active":"2024-05-03T22:14:39.038367+0000","last_peered":"2024-05-03T22:14:39.038367+0000","last_clean":"2024-05-03T22:14:39.038367+0000","last_became_active":"2024-05-03T22:12:31.979875+0000","last_became_peered":"2024-05-03T22:12:31.979875+0000","last_unstale":"2024-05-03T22:14:39.038367+0000","last_undegraded":"2024-05-03T22:14:39.038367+0000","last_fullsized":"2024-05-03T22:14:39.038367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:26:56.227766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288764+0000","last_change":"2024-05-03T22:13:37.972323+0000","last_active":"2024-05-03T22:14:38.288764+0000","last_peered":"2024-05-03T22:14:38.288764+0000","last_clean":"2024-05-03T22:14:38.288764+0000","last_became_active":"2024-05-03T22:13:37.971207+0000","last_became_peered":"2024-05-03T22:13:37.971207+0000","last_unstale":"2024-05-03T22:14:38.288764+0000","last_undegraded":"2024-05-03T22:14:38.288764+0000","last_fullsized":"2024-05-03T22:14:38.288764+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:49.939213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036930+0000","last_change":"2024-05-03T22:12:52.125489+0000","last_active":"2024-05-03T22:14:39.036930+0000","last_peered":"2024-05-03T22:14:39.036930+0000","last_clean":"2024-05-03T22:14:39.036930+0000","last_became_active":"2024-05-03T22:12:52.124767+0000","last_became_peered":"2024-05-03T22:12:52.124767+0000","last_unstale":"2024-05-03T22:14:39.036930+0000","last_undegraded":"2024-05-03T22:14:39.036930+0000","last_fullsized":"2024-05-03T22:14:39.036930+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:47:29.027353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":61,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.311637+0000","last_change":"2024-05-03T22:14:38.311637+0000","last_active":"2024-05-03T22:14:38.311637+0000","last_peered":"2024-05-03T22:14:38.311637+0000","last_clean":"2024-05-03T22:14:38.311637+0000","last_became_active":"2024-05-03T22:14:38.299881+0000","last_became_peered":"2024-05-03T22:14:38.299881+0000","last_unstale":"2024-05-03T22:14:38.311637+0000","last_undegraded":"2024-05-03T22:14:38.311637+0000","last_fullsized":"2024-05-03T22:14:38.311637+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:51:27.491122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289571+0000","last_change":"2024-05-03T22:12:36.015753+0000","last_active":"2024-05-03T22:14:38.289571+0000","last_peered":"2024-05-03T22:14:38.289571+0000","last_clean":"2024-05-03T22:14:38.289571+0000","last_became_active":"2024-05-03T22:12:36.011569+0000","last_became_peered":"2024-05-03T22:12:36.011569+0000","last_unstale":"2024-05-03T22:14:38.289571+0000","last_undegraded":"2024-05-03T22:14:38.289571+0000","last_fullsized":"2024-05-03T22:14:38.289571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:30:48.897252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286581+0000","last_change":"2024-05-03T22:12:36.017738+0000","last_active":"2024-05-03T22:14:38.286581+0000","last_peered":"2024-05-03T22:14:38.286581+0000","last_clean":"2024-05-03T22:14:38.286581+0000","last_became_active":"2024-05-03T22:12:36.017293+0000","last_became_peered":"2024-05-03T22:12:36.017293+0000","last_unstale":"2024-05-03T22:14:38.286581+0000","last_undegraded":"2024-05-03T22:14:38.286581+0000","last_fullsized":"2024-05-03T22:14:38.286581+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:20:35.141892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291607+0000","last_change":"2024-05-03T22:13:37.911165+0000","last_active":"2024-05-03T22:14:38.291607+0000","last_peered":"2024-05-03T22:14:38.291607+0000","last_clean":"2024-05-03T22:14:38.291607+0000","last_became_active":"2024-05-03T22:13:37.910476+0000","last_became_peered":"2024-05-03T22:13:37.910476+0000","last_unstale":"2024-05-03T22:14:38.291607+0000","last_undegraded":"2024-05-03T22:14:38.291607+0000","last_fullsized":"2024-05-03T22:14:38.291607+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:07.195308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290909+0000","last_change":"2024-05-03T22:12:36.001119+0000","last_active":"2024-05-03T22:14:38.290909+0000","last_peered":"2024-05-03T22:14:38.290909+0000","last_clean":"2024-05-03T22:14:38.290909+0000","last_became_active":"2024-05-03T22:12:36.000728+0000","last_became_peered":"2024-05-03T22:12:36.000728+0000","last_unstale":"2024-05-03T22:14:38.290909+0000","last_undegraded":"2024-05-03T22:14:38.290909+0000","last_fullsized":"2024-05-03T22:14:38.290909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:02:29.413354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297854+0000","last_change":"2024-05-03T22:12:36.004256+0000","last_active":"2024-05-03T22:14:38.297854+0000","last_peered":"2024-05-03T22:14:38.297854+0000","last_clean":"2024-05-03T22:14:38.297854+0000","last_became_active":"2024-05-03T22:12:36.004002+0000","last_became_peered":"2024-05-03T22:12:36.004002+0000","last_unstale":"2024-05-03T22:14:38.297854+0000","last_undegraded":"2024-05-03T22:14:38.297854+0000","last_fullsized":"2024-05-03T22:14:38.297854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:50:55.748069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289288+0000","last_change":"2024-05-03T22:12:36.006160+0000","last_active":"2024-05-03T22:14:38.289288+0000","last_peered":"2024-05-03T22:14:38.289288+0000","last_clean":"2024-05-03T22:14:38.289288+0000","last_became_active":"2024-05-03T22:12:36.001061+0000","last_became_peered":"2024-05-03T22:12:36.001061+0000","last_unstale":"2024-05-03T22:14:38.289288+0000","last_undegraded":"2024-05-03T22:14:38.289288+0000","last_fullsized":"2024-05-03T22:14:38.289288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:49:32.033970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287632+0000","last_change":"2024-05-03T22:13:37.974073+0000","last_active":"2024-05-03T22:14:38.287632+0000","last_peered":"2024-05-03T22:14:38.287632+0000","last_clean":"2024-05-03T22:14:38.287632+0000","last_became_active":"2024-05-03T22:13:37.973009+0000","last_became_peered":"2024-05-03T22:13:37.973009+0000","last_unstale":"2024-05-03T22:14:38.287632+0000","last_undegraded":"2024-05-03T22:14:38.287632+0000","last_fullsized":"2024-05-03T22:14:38.287632+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:00:37.511026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291383+0000","last_change":"2024-05-03T22:12:36.014463+0000","last_active":"2024-05-03T22:14:38.291383+0000","last_peered":"2024-05-03T22:14:38.291383+0000","last_clean":"2024-05-03T22:14:38.291383+0000","last_became_active":"2024-05-03T22:12:36.014130+0000","last_became_peered":"2024-05-03T22:12:36.014130+0000","last_unstale":"2024-05-03T22:14:38.291383+0000","last_undegraded":"2024-05-03T22:14:38.291383+0000","last_fullsized":"2024-05-03T22:14:38.291383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:44:28.681255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291056+0000","last_change":"2024-05-03T22:12:36.000528+0000","last_active":"2024-05-03T22:14:38.291056+0000","last_peered":"2024-05-03T22:14:38.291056+0000","last_clean":"2024-05-03T22:14:38.291056+0000","last_became_active":"2024-05-03T22:12:35.999985+0000","last_became_peered":"2024-05-03T22:12:35.999985+0000","last_unstale":"2024-05-03T22:14:38.291056+0000","last_undegraded":"2024-05-03T22:14:38.291056+0000","last_fullsized":"2024-05-03T22:14:38.291056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:36:13.835098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037296+0000","last_change":"2024-05-03T22:12:36.010009+0000","last_active":"2024-05-03T22:14:39.037296+0000","last_peered":"2024-05-03T22:14:39.037296+0000","last_clean":"2024-05-03T22:14:39.037296+0000","last_became_active":"2024-05-03T22:12:36.009139+0000","last_became_peered":"2024-05-03T22:12:36.009139+0000","last_unstale":"2024-05-03T22:14:39.037296+0000","last_undegraded":"2024-05-03T22:14:39.037296+0000","last_fullsized":"2024-05-03T22:14:39.037296+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:59.111774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291812+0000","last_change":"2024-05-03T22:12:36.015949+0000","last_active":"2024-05-03T22:14:38.291812+0000","last_peered":"2024-05-03T22:14:38.291812+0000","last_clean":"2024-05-03T22:14:38.291812+0000","last_became_active":"2024-05-03T22:12:36.015597+0000","last_became_peered":"2024-05-03T22:12:36.015597+0000","last_unstale":"2024-05-03T22:14:38.291812+0000","last_undegraded":"2024-05-03T22:14:38.291812+0000","last_fullsized":"2024-05-03T22:14:38.291812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:24:29.855732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728173+0000","last_change":"2024-05-03T22:12:36.013462+0000","last_active":"2024-05-03T22:14:38.728173+0000","last_peered":"2024-05-03T22:14:38.728173+0000","last_clean":"2024-05-03T22:14:38.728173+0000","last_became_active":"2024-05-03T22:12:36.012664+0000","last_became_peered":"2024-05-03T22:12:36.012664+0000","last_unstale":"2024-05-03T22:14:38.728173+0000","last_undegraded":"2024-05-03T22:14:38.728173+0000","last_fullsized":"2024-05-03T22:14:38.728173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:28:53.979742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288826+0000","last_change":"2024-05-03T22:12:36.010367+0000","last_active":"2024-05-03T22:14:38.288826+0000","last_peered":"2024-05-03T22:14:38.288826+0000","last_clean":"2024-05-03T22:14:38.288826+0000","last_became_active":"2024-05-03T22:12:36.009968+0000","last_became_peered":"2024-05-03T22:12:36.009968+0000","last_unstale":"2024-05-03T22:14:38.288826+0000","last_undegraded":"2024-05-03T22:14:38.288826+0000","last_fullsized":"2024-05-03T22:14:38.288826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:34:48.542080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288238+0000","last_change":"2024-05-03T22:12:36.023670+0000","last_active":"2024-05-03T22:14:38.288238+0000","last_peered":"2024-05-03T22:14:38.288238+0000","last_clean":"2024-05-03T22:14:38.288238+0000","last_became_active":"2024-05-03T22:12:36.022774+0000","last_became_peered":"2024-05-03T22:12:36.022774+0000","last_unstale":"2024-05-03T22:14:38.288238+0000","last_undegraded":"2024-05-03T22:14:38.288238+0000","last_fullsized":"2024-05-03T22:14:38.288238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:33:05.929349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65155,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":391,"num_read_kb":264,"num_write":246,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":195465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612652,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":530005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808884,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32892,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712260,"statfs":{"total":95995035648,"available":95961354240,"internally_reserved":0,"allocated":1753088,"data_stored":1174660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005114,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":533919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201346,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1069056,"data_stored":529417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397577,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32824,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712328,"statfs":{"total":95995035648,"available":95961423872,"internally_reserved":0,"allocated":1683456,"data_stored":1127089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561104,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":525718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":585371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738490,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":526783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411437,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1146880,"data_stored":584919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149798,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":525035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953567,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":529401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757335,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32832,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712320,"statfs":{"total":95995035648,"available":95961415680,"internally_reserved":0,"allocated":1691648,"data_stored":1122280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T22:14:46.949 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T22:14:47.389 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:47.601 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:47 smithi082 ceph-mon[28404]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:14:47.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:47 smithi116 ceph-mon[31828]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:14:47.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:47 smithi130 ceph-mon[32417]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:14:48.610 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:48 smithi082 ceph-mon[28404]: pgmap v447: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 655 B/s wr, 8 op/s; 83 B/s, 1 objects/s recovering 2024-05-03T22:14:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:48 smithi116 ceph-mon[31828]: pgmap v447: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 655 B/s wr, 8 op/s; 83 B/s, 1 objects/s recovering 2024-05-03T22:14:48.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:48 smithi130 ceph-mon[32417]: pgmap v447: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 655 B/s wr, 8 op/s; 83 B/s, 1 objects/s recovering 2024-05-03T22:14:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.745+0000 7f2abf000700 1 -- 172.21.15.82:0/1928074982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ab810a3a0 msgr2=0x7f2ab8116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.745+0000 7f2abf000700 1 --2- 172.21.15.82:0/1928074982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ab810a3a0 0x7f2ab8116840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000b0a0 tx=0x7f2ab000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:14:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.745+0000 7f2abf000700 1 -- 172.21.15.82:0/1928074982 shutdown_connections 2024-05-03T22:14:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.745+0000 7f2abf000700 1 --2- 172.21.15.82:0/1928074982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ab810a3a0 0x7f2ab8116840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.745+0000 7f2abf000700 1 --2- 172.21.15.82:0/1928074982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ab810e8b0 0x7f2ab810ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:49.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.745+0000 7f2abf000700 1 --2- 172.21.15.82:0/1928074982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab81099e0 0x7f2ab8109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:49.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.745+0000 7f2abf000700 1 -- 172.21.15.82:0/1928074982 >> 172.21.15.82:0/1928074982 conn(0x7f2ab8079230 msgr2=0x7f2ab81082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:49.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.745+0000 7f2abf000700 1 -- 172.21.15.82:0/1928074982 shutdown_connections 2024-05-03T22:14:49.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.745+0000 7f2abf000700 1 -- 172.21.15.82:0/1928074982 wait complete. 2024-05-03T22:14:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.746+0000 7f2abf000700 1 Processor -- start 2024-05-03T22:14:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.746+0000 7f2abf000700 1 -- start start 2024-05-03T22:14:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.747+0000 7f2abf000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab81099e0 0x7f2ab819ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.747+0000 7f2abf000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ab810a3a0 0x7f2ab81a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.747+0000 7f2abf000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ab810e8b0 0x7f2ab81a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.747+0000 7f2abf000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab8119a90 con 0x7f2ab810a3a0 2024-05-03T22:14:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.747+0000 7f2abf000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab8119910 con 0x7f2ab81099e0 2024-05-03T22:14:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.747+0000 7f2abf000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab8119c10 con 0x7f2ab810e8b0 2024-05-03T22:14:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.747+0000 7f2abd200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ab810a3a0 0x7f2ab81a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.747+0000 7f2abd200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ab810a3a0 0x7f2ab81a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50120/0 (socket says 172.21.15.82:50120) 2024-05-03T22:14:49.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.747+0000 7f2abd200700 1 -- 172.21.15.82:0/3128155599 learned_addr learned my addr 172.21.15.82:0/3128155599 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:49.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.747+0000 7f2abdc00700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab81099e0 0x7f2ab819ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:49.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.747+0000 7f2abe600700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ab810e8b0 0x7f2ab81a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2abd200700 1 -- 172.21.15.82:0/3128155599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ab810e8b0 msgr2=0x7f2ab81a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2abd200700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ab810e8b0 0x7f2ab81a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2abd200700 1 -- 172.21.15.82:0/3128155599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab81099e0 msgr2=0x7f2ab819ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2abd200700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab81099e0 0x7f2ab819ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2abd200700 1 -- 172.21.15.82:0/3128155599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab81a4ee0 con 0x7f2ab810a3a0 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2abe600700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ab810e8b0 0x7f2ab81a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2abd200700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ab810a3a0 0x7f2ab81a0460 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c9b0 tx=0x7f2aa400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2ab6000700 1 -- 172.21.15.82:0/3128155599 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4007b00 con 0x7f2ab810a3a0 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2abf000700 1 -- 172.21.15.82:0/3128155599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab81a51d0 con 0x7f2ab810a3a0 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2ab6000700 1 -- 172.21.15.82:0/3128155599 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2aa4007ca0 con 0x7f2ab810a3a0 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2ab6000700 1 -- 172.21.15.82:0/3128155599 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4018660 con 0x7f2ab810a3a0 2024-05-03T22:14:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.748+0000 7f2abf000700 1 -- 172.21.15.82:0/3128155599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab81aca50 con 0x7f2ab810a3a0 2024-05-03T22:14:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.750+0000 7f2abf000700 1 -- 172.21.15.82:0/3128155599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab806a190 con 0x7f2ab810a3a0 2024-05-03T22:14:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.752+0000 7f2ab6000700 1 -- 172.21.15.82:0/3128155599 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f2aa400f450 con 0x7f2ab810a3a0 2024-05-03T22:14:49.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.754+0000 7f2ab6000700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2aa00b2910 0x7f2aa00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:49.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.754+0000 7f2ab6000700 1 -- 172.21.15.82:0/3128155599 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f2aa40e27a0 con 0x7f2ab810a3a0 2024-05-03T22:14:49.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.754+0000 7f2abdc00700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2aa00b2910 0x7f2aa00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:49.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.755+0000 7f2abdc00700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2aa00b2910 0x7f2aa00b4dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0045b0 tx=0x7f2aac00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:49.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.759+0000 7f2ab6000700 1 -- 172.21.15.82:0/3128155599 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2aa4014030 con 0x7f2ab810a3a0 2024-05-03T22:14:49.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:49.988+0000 7f2abf000700 1 -- 172.21.15.82:0/3128155599 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ab80638e0 con 0x7f2aa00b2910 2024-05-03T22:14:50.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.017+0000 7f2ab6000700 1 -- 172.21.15.82:0/3128155599 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340402 (secure 0 0 0) 0x7f2ab80638e0 con 0x7f2aa00b2910 2024-05-03T22:14:50.021 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:14:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 -- 172.21.15.82:0/3128155599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2aa00b2910 msgr2=0x7f2aa00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2aa00b2910 0x7f2aa00b4dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0045b0 tx=0x7f2aac00b3c0 comp rx=0 tx=0).stop 2024-05-03T22:14:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 -- 172.21.15.82:0/3128155599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ab810a3a0 msgr2=0x7f2ab81a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ab810a3a0 0x7f2ab81a0460 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c9b0 tx=0x7f2aa400ccc0 comp rx=0 tx=0).stop 2024-05-03T22:14:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 -- 172.21.15.82:0/3128155599 shutdown_connections 2024-05-03T22:14:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2aa00b2910 0x7f2aa00b4dd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:50.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ab810e8b0 0x7f2ab81a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ab81099e0 0x7f2ab819ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 --2- 172.21.15.82:0/3128155599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ab810a3a0 0x7f2ab81a0460 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 -- 172.21.15.82:0/3128155599 >> 172.21.15.82:0/3128155599 conn(0x7f2ab8079230 msgr2=0x7f2ab80797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 -- 172.21.15.82:0/3128155599 shutdown_connections 2024-05-03T22:14:50.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:50.025+0000 7f2abf000700 1 -- 172.21.15.82:0/3128155599 wait complete. 2024-05-03T22:14:50.030 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-03T22:14:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:50 smithi116 ceph-mon[31828]: pgmap v448: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 592 B/s wr, 9 op/s; 75 B/s, 1 objects/s recovering 2024-05-03T22:14:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:50 smithi082 ceph-mon[28404]: pgmap v448: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 592 B/s wr, 9 op/s; 75 B/s, 1 objects/s recovering 2024-05-03T22:14:50.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:50 smithi130 ceph-mon[32417]: pgmap v448: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 592 B/s wr, 9 op/s; 75 B/s, 1 objects/s recovering 2024-05-03T22:14:51.139 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":448,"stamp":"2024-05-03T22:14:48.653701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655757,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":512,"num_read_kb":348,"num_write":371,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2952624,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359664,"kb_used_data":14600,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124582160,"statfs":{"total":1151940427776,"available":1151572131840,"internally_reserved":0,"allocated":14950400,"data_stored":8294597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4962,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":48,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.372957"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288498+0000","last_change":"2024-05-03T22:12:36.021433+0000","last_active":"2024-05-03T22:14:38.288498+0000","last_peered":"2024-05-03T22:14:38.288498+0000","last_clean":"2024-05-03T22:14:38.288498+0000","last_became_active":"2024-05-03T22:12:36.019902+0000","last_became_peered":"2024-05-03T22:12:36.019902+0000","last_unstale":"2024-05-03T22:14:38.288498+0000","last_undegraded":"2024-05-03T22:14:38.288498+0000","last_fullsized":"2024-05-03T22:14:38.288498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:08:27.361044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298298+0000","last_change":"2024-05-03T22:12:36.012811+0000","last_active":"2024-05-03T22:14:38.298298+0000","last_peered":"2024-05-03T22:14:38.298298+0000","last_clean":"2024-05-03T22:14:38.298298+0000","last_became_active":"2024-05-03T22:12:36.012491+0000","last_became_peered":"2024-05-03T22:12:36.012491+0000","last_unstale":"2024-05-03T22:14:38.298298+0000","last_undegraded":"2024-05-03T22:14:38.298298+0000","last_fullsized":"2024-05-03T22:14:38.298298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:19:01.773304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297615+0000","last_change":"2024-05-03T22:12:36.009783+0000","last_active":"2024-05-03T22:14:38.297615+0000","last_peered":"2024-05-03T22:14:38.297615+0000","last_clean":"2024-05-03T22:14:38.297615+0000","last_became_active":"2024-05-03T22:12:36.009461+0000","last_became_peered":"2024-05-03T22:12:36.009461+0000","last_unstale":"2024-05-03T22:14:38.297615+0000","last_undegraded":"2024-05-03T22:14:38.297615+0000","last_fullsized":"2024-05-03T22:14:38.297615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:04:17.127323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283737+0000","last_change":"2024-05-03T22:12:36.005887+0000","last_active":"2024-05-03T22:14:38.283737+0000","last_peered":"2024-05-03T22:14:38.283737+0000","last_clean":"2024-05-03T22:14:38.283737+0000","last_became_active":"2024-05-03T22:12:36.005519+0000","last_became_peered":"2024-05-03T22:12:36.005519+0000","last_unstale":"2024-05-03T22:14:38.283737+0000","last_undegraded":"2024-05-03T22:14:38.283737+0000","last_fullsized":"2024-05-03T22:14:38.283737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:15:23.962047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285218+0000","last_change":"2024-05-03T22:12:35.988566+0000","last_active":"2024-05-03T22:14:38.285218+0000","last_peered":"2024-05-03T22:14:38.285218+0000","last_clean":"2024-05-03T22:14:38.285218+0000","last_became_active":"2024-05-03T22:12:35.986766+0000","last_became_peered":"2024-05-03T22:12:35.986766+0000","last_unstale":"2024-05-03T22:14:38.285218+0000","last_undegraded":"2024-05-03T22:14:38.285218+0000","last_fullsized":"2024-05-03T22:14:38.285218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:38:52.877608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036215+0000","last_change":"2024-05-03T22:12:36.013994+0000","last_active":"2024-05-03T22:14:39.036215+0000","last_peered":"2024-05-03T22:14:39.036215+0000","last_clean":"2024-05-03T22:14:39.036215+0000","last_became_active":"2024-05-03T22:12:36.013134+0000","last_became_peered":"2024-05-03T22:12:36.013134+0000","last_unstale":"2024-05-03T22:14:39.036215+0000","last_undegraded":"2024-05-03T22:14:39.036215+0000","last_fullsized":"2024-05-03T22:14:39.036215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:21:47.881727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288833+0000","last_change":"2024-05-03T22:12:36.016165+0000","last_active":"2024-05-03T22:14:38.288833+0000","last_peered":"2024-05-03T22:14:38.288833+0000","last_clean":"2024-05-03T22:14:38.288833+0000","last_became_active":"2024-05-03T22:12:36.009230+0000","last_became_peered":"2024-05-03T22:12:36.009230+0000","last_unstale":"2024-05-03T22:14:38.288833+0000","last_undegraded":"2024-05-03T22:14:38.288833+0000","last_fullsized":"2024-05-03T22:14:38.288833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:27:38.042296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290394+0000","last_change":"2024-05-03T22:12:36.006859+0000","last_active":"2024-05-03T22:14:38.290394+0000","last_peered":"2024-05-03T22:14:38.290394+0000","last_clean":"2024-05-03T22:14:38.290394+0000","last_became_active":"2024-05-03T22:12:36.006396+0000","last_became_peered":"2024-05-03T22:12:36.006396+0000","last_unstale":"2024-05-03T22:14:38.290394+0000","last_undegraded":"2024-05-03T22:14:38.290394+0000","last_fullsized":"2024-05-03T22:14:38.290394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:45:00.863115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728822+0000","last_change":"2024-05-03T22:12:36.020513+0000","last_active":"2024-05-03T22:14:38.728822+0000","last_peered":"2024-05-03T22:14:38.728822+0000","last_clean":"2024-05-03T22:14:38.728822+0000","last_became_active":"2024-05-03T22:12:36.017852+0000","last_became_peered":"2024-05-03T22:12:36.017852+0000","last_unstale":"2024-05-03T22:14:38.728822+0000","last_undegraded":"2024-05-03T22:14:38.728822+0000","last_fullsized":"2024-05-03T22:14:38.728822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:20:33.567258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036789+0000","last_change":"2024-05-03T22:12:36.009729+0000","last_active":"2024-05-03T22:14:39.036789+0000","last_peered":"2024-05-03T22:14:39.036789+0000","last_clean":"2024-05-03T22:14:39.036789+0000","last_became_active":"2024-05-03T22:12:36.007356+0000","last_became_peered":"2024-05-03T22:12:36.007356+0000","last_unstale":"2024-05-03T22:14:39.036789+0000","last_undegraded":"2024-05-03T22:14:39.036789+0000","last_fullsized":"2024-05-03T22:14:39.036789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:49:56.964694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289164+0000","last_change":"2024-05-03T22:12:36.019438+0000","last_active":"2024-05-03T22:14:38.289164+0000","last_peered":"2024-05-03T22:14:38.289164+0000","last_clean":"2024-05-03T22:14:38.289164+0000","last_became_active":"2024-05-03T22:12:36.019049+0000","last_became_peered":"2024-05-03T22:12:36.019049+0000","last_unstale":"2024-05-03T22:14:38.289164+0000","last_undegraded":"2024-05-03T22:14:38.289164+0000","last_fullsized":"2024-05-03T22:14:38.289164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:06:01.344591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283615+0000","last_change":"2024-05-03T22:12:36.015763+0000","last_active":"2024-05-03T22:14:38.283615+0000","last_peered":"2024-05-03T22:14:38.283615+0000","last_clean":"2024-05-03T22:14:38.283615+0000","last_became_active":"2024-05-03T22:12:36.010804+0000","last_became_peered":"2024-05-03T22:12:36.010804+0000","last_unstale":"2024-05-03T22:14:38.283615+0000","last_undegraded":"2024-05-03T22:14:38.283615+0000","last_fullsized":"2024-05-03T22:14:38.283615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:06:14.150027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288985+0000","last_change":"2024-05-03T22:12:36.018442+0000","last_active":"2024-05-03T22:14:38.288985+0000","last_peered":"2024-05-03T22:14:38.288985+0000","last_clean":"2024-05-03T22:14:38.288985+0000","last_became_active":"2024-05-03T22:12:36.017288+0000","last_became_peered":"2024-05-03T22:12:36.017288+0000","last_unstale":"2024-05-03T22:14:38.288985+0000","last_undegraded":"2024-05-03T22:14:38.288985+0000","last_fullsized":"2024-05-03T22:14:38.288985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:06.097579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.296785+0000","last_change":"2024-05-03T22:12:36.015322+0000","last_active":"2024-05-03T22:14:38.296785+0000","last_peered":"2024-05-03T22:14:38.296785+0000","last_clean":"2024-05-03T22:14:38.296785+0000","last_became_active":"2024-05-03T22:12:36.014933+0000","last_became_peered":"2024-05-03T22:12:36.014933+0000","last_unstale":"2024-05-03T22:14:38.296785+0000","last_undegraded":"2024-05-03T22:14:38.296785+0000","last_fullsized":"2024-05-03T22:14:38.296785+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:35:07.654487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.296654+0000","last_change":"2024-05-03T22:12:36.016161+0000","last_active":"2024-05-03T22:14:38.296654+0000","last_peered":"2024-05-03T22:14:38.296654+0000","last_clean":"2024-05-03T22:14:38.296654+0000","last_became_active":"2024-05-03T22:12:36.015827+0000","last_became_peered":"2024-05-03T22:12:36.015827+0000","last_unstale":"2024-05-03T22:14:38.296654+0000","last_undegraded":"2024-05-03T22:14:38.296654+0000","last_fullsized":"2024-05-03T22:14:38.296654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:27.585544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.727721+0000","last_change":"2024-05-03T22:12:36.010741+0000","last_active":"2024-05-03T22:14:38.727721+0000","last_peered":"2024-05-03T22:14:38.727721+0000","last_clean":"2024-05-03T22:14:38.727721+0000","last_became_active":"2024-05-03T22:12:36.010391+0000","last_became_peered":"2024-05-03T22:12:36.010391+0000","last_unstale":"2024-05-03T22:14:38.727721+0000","last_undegraded":"2024-05-03T22:14:38.727721+0000","last_fullsized":"2024-05-03T22:14:38.727721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:58:18.400114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287568+0000","last_change":"2024-05-03T22:12:36.024248+0000","last_active":"2024-05-03T22:14:38.287568+0000","last_peered":"2024-05-03T22:14:38.287568+0000","last_clean":"2024-05-03T22:14:38.287568+0000","last_became_active":"2024-05-03T22:12:36.023864+0000","last_became_peered":"2024-05-03T22:12:36.023864+0000","last_unstale":"2024-05-03T22:14:38.287568+0000","last_undegraded":"2024-05-03T22:14:38.287568+0000","last_fullsized":"2024-05-03T22:14:38.287568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:29:22.455105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285087+0000","last_change":"2024-05-03T22:12:36.006077+0000","last_active":"2024-05-03T22:14:38.285087+0000","last_peered":"2024-05-03T22:14:38.285087+0000","last_clean":"2024-05-03T22:14:38.285087+0000","last_became_active":"2024-05-03T22:12:36.005745+0000","last_became_peered":"2024-05-03T22:12:36.005745+0000","last_unstale":"2024-05-03T22:14:38.285087+0000","last_undegraded":"2024-05-03T22:14:38.285087+0000","last_fullsized":"2024-05-03T22:14:38.285087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:46:47.245132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.292473+0000","last_change":"2024-05-03T22:12:36.001122+0000","last_active":"2024-05-03T22:14:38.292473+0000","last_peered":"2024-05-03T22:14:38.292473+0000","last_clean":"2024-05-03T22:14:38.292473+0000","last_became_active":"2024-05-03T22:12:36.000396+0000","last_became_peered":"2024-05-03T22:12:36.000396+0000","last_unstale":"2024-05-03T22:14:38.292473+0000","last_undegraded":"2024-05-03T22:14:38.292473+0000","last_fullsized":"2024-05-03T22:14:38.292473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:13:50.457303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291420+0000","last_change":"2024-05-03T22:12:52.138524+0000","last_active":"2024-05-03T22:14:38.291420+0000","last_peered":"2024-05-03T22:14:38.291420+0000","last_clean":"2024-05-03T22:14:38.291420+0000","last_became_active":"2024-05-03T22:12:52.136455+0000","last_became_peered":"2024-05-03T22:12:52.136455+0000","last_unstale":"2024-05-03T22:14:38.291420+0000","last_undegraded":"2024-05-03T22:14:38.291420+0000","last_fullsized":"2024-05-03T22:14:38.291420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:46:24.807062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":117,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:42.741634+0000","last_change":"2024-05-03T22:14:38.745729+0000","last_active":"2024-05-03T22:14:42.741634+0000","last_peered":"2024-05-03T22:14:42.741634+0000","last_clean":"2024-05-03T22:14:42.741634+0000","last_became_active":"2024-05-03T22:14:38.730211+0000","last_became_peered":"2024-05-03T22:14:38.730211+0000","last_unstale":"2024-05-03T22:14:42.741634+0000","last_undegraded":"2024-05-03T22:14:42.741634+0000","last_fullsized":"2024-05-03T22:14:42.741634+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:23:32.539747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290952+0000","last_change":"2024-05-03T22:12:36.008931+0000","last_active":"2024-05-03T22:14:38.290952+0000","last_peered":"2024-05-03T22:14:38.290952+0000","last_clean":"2024-05-03T22:14:38.290952+0000","last_became_active":"2024-05-03T22:12:36.008550+0000","last_became_peered":"2024-05-03T22:12:36.008550+0000","last_unstale":"2024-05-03T22:14:38.290952+0000","last_undegraded":"2024-05-03T22:14:38.290952+0000","last_fullsized":"2024-05-03T22:14:38.290952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:14.542598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283133+0000","last_change":"2024-05-03T22:13:37.973509+0000","last_active":"2024-05-03T22:14:38.283133+0000","last_peered":"2024-05-03T22:14:38.283133+0000","last_clean":"2024-05-03T22:14:38.283133+0000","last_became_active":"2024-05-03T22:13:37.972160+0000","last_became_peered":"2024-05-03T22:13:37.972160+0000","last_unstale":"2024-05-03T22:14:38.283133+0000","last_undegraded":"2024-05-03T22:14:38.283133+0000","last_fullsized":"2024-05-03T22:14:38.283133+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:04.292667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291284+0000","last_change":"2024-05-03T22:12:32.023501+0000","last_active":"2024-05-03T22:14:38.291284+0000","last_peered":"2024-05-03T22:14:38.291284+0000","last_clean":"2024-05-03T22:14:38.291284+0000","last_became_active":"2024-05-03T22:12:32.022961+0000","last_became_peered":"2024-05-03T22:12:32.022961+0000","last_unstale":"2024-05-03T22:14:38.291284+0000","last_undegraded":"2024-05-03T22:14:38.291284+0000","last_fullsized":"2024-05-03T22:14:38.291284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:03:42.477600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298613+0000","last_change":"2024-05-03T22:12:36.003449+0000","last_active":"2024-05-03T22:14:38.298613+0000","last_peered":"2024-05-03T22:14:38.298613+0000","last_clean":"2024-05-03T22:14:38.298613+0000","last_became_active":"2024-05-03T22:12:36.002257+0000","last_became_peered":"2024-05-03T22:12:36.002257+0000","last_unstale":"2024-05-03T22:14:38.298613+0000","last_undegraded":"2024-05-03T22:14:38.298613+0000","last_fullsized":"2024-05-03T22:14:38.298613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:52:38.409271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283373+0000","last_change":"2024-05-03T22:12:52.143583+0000","last_active":"2024-05-03T22:14:38.283373+0000","last_peered":"2024-05-03T22:14:38.283373+0000","last_clean":"2024-05-03T22:14:38.283373+0000","last_became_active":"2024-05-03T22:12:52.142656+0000","last_became_peered":"2024-05-03T22:12:52.142656+0000","last_unstale":"2024-05-03T22:14:38.283373+0000","last_undegraded":"2024-05-03T22:14:38.283373+0000","last_fullsized":"2024-05-03T22:14:38.283373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:13:37.342909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285654+0000","last_change":"2024-05-03T22:12:31.985223+0000","last_active":"2024-05-03T22:14:38.285654+0000","last_peered":"2024-05-03T22:14:38.285654+0000","last_clean":"2024-05-03T22:14:38.285654+0000","last_became_active":"2024-05-03T22:12:31.984728+0000","last_became_peered":"2024-05-03T22:12:31.984728+0000","last_unstale":"2024-05-03T22:14:38.285654+0000","last_undegraded":"2024-05-03T22:14:38.285654+0000","last_fullsized":"2024-05-03T22:14:38.285654+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:16.493672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728320+0000","last_change":"2024-05-03T22:12:35.999341+0000","last_active":"2024-05-03T22:14:38.728320+0000","last_peered":"2024-05-03T22:14:38.728320+0000","last_clean":"2024-05-03T22:14:38.728320+0000","last_became_active":"2024-05-03T22:12:35.998263+0000","last_became_peered":"2024-05-03T22:12:35.998263+0000","last_unstale":"2024-05-03T22:14:38.728320+0000","last_undegraded":"2024-05-03T22:14:38.728320+0000","last_fullsized":"2024-05-03T22:14:38.728320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:48:23.344678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283271+0000","last_change":"2024-05-03T22:12:52.137263+0000","last_active":"2024-05-03T22:14:38.283271+0000","last_peered":"2024-05-03T22:14:38.283271+0000","last_clean":"2024-05-03T22:14:38.283271+0000","last_became_active":"2024-05-03T22:12:52.136252+0000","last_became_peered":"2024-05-03T22:12:52.136252+0000","last_unstale":"2024-05-03T22:14:38.283271+0000","last_undegraded":"2024-05-03T22:14:38.283271+0000","last_fullsized":"2024-05-03T22:14:38.283271+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:51:13.215710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285267+0000","last_change":"2024-05-03T22:12:31.981027+0000","last_active":"2024-05-03T22:14:38.285267+0000","last_peered":"2024-05-03T22:14:38.285267+0000","last_clean":"2024-05-03T22:14:38.285267+0000","last_became_active":"2024-05-03T22:12:31.980525+0000","last_became_peered":"2024-05-03T22:12:31.980525+0000","last_unstale":"2024-05-03T22:14:38.285267+0000","last_undegraded":"2024-05-03T22:14:38.285267+0000","last_fullsized":"2024-05-03T22:14:38.285267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:45:00.651947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038089+0000","last_change":"2024-05-03T22:12:36.018950+0000","last_active":"2024-05-03T22:14:39.038089+0000","last_peered":"2024-05-03T22:14:39.038089+0000","last_clean":"2024-05-03T22:14:39.038089+0000","last_became_active":"2024-05-03T22:12:36.018617+0000","last_became_peered":"2024-05-03T22:12:36.018617+0000","last_unstale":"2024-05-03T22:14:39.038089+0000","last_undegraded":"2024-05-03T22:14:39.038089+0000","last_fullsized":"2024-05-03T22:14:39.038089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:14:03.619225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.292214+0000","last_change":"2024-05-03T22:12:52.127174+0000","last_active":"2024-05-03T22:14:38.292214+0000","last_peered":"2024-05-03T22:14:38.292214+0000","last_clean":"2024-05-03T22:14:38.292214+0000","last_became_active":"2024-05-03T22:12:52.125762+0000","last_became_peered":"2024-05-03T22:12:52.125762+0000","last_unstale":"2024-05-03T22:14:38.292214+0000","last_undegraded":"2024-05-03T22:14:38.292214+0000","last_fullsized":"2024-05-03T22:14:38.292214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:21:20.502831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'6","reported_seq":93,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:44.245698+0000","last_change":"2024-05-03T22:12:31.983721+0000","last_active":"2024-05-03T22:14:44.245698+0000","last_peered":"2024-05-03T22:14:44.245698+0000","last_clean":"2024-05-03T22:14:44.245698+0000","last_became_active":"2024-05-03T22:12:31.983192+0000","last_became_peered":"2024-05-03T22:12:31.983192+0000","last_unstale":"2024-05-03T22:14:44.245698+0000","last_undegraded":"2024-05-03T22:14:44.245698+0000","last_fullsized":"2024-05-03T22:14:44.245698+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:02:28.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284799+0000","last_change":"2024-05-03T22:12:36.012909+0000","last_active":"2024-05-03T22:14:38.284799+0000","last_peered":"2024-05-03T22:14:38.284799+0000","last_clean":"2024-05-03T22:14:38.284799+0000","last_became_active":"2024-05-03T22:12:36.011402+0000","last_became_peered":"2024-05-03T22:12:36.011402+0000","last_unstale":"2024-05-03T22:14:38.284799+0000","last_undegraded":"2024-05-03T22:14:38.284799+0000","last_fullsized":"2024-05-03T22:14:38.284799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:46:31.464317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291628+0000","last_change":"2024-05-03T22:13:37.973869+0000","last_active":"2024-05-03T22:14:38.291628+0000","last_peered":"2024-05-03T22:14:38.291628+0000","last_clean":"2024-05-03T22:14:38.291628+0000","last_became_active":"2024-05-03T22:13:37.972089+0000","last_became_peered":"2024-05-03T22:13:37.972089+0000","last_unstale":"2024-05-03T22:14:38.291628+0000","last_undegraded":"2024-05-03T22:14:38.291628+0000","last_fullsized":"2024-05-03T22:14:38.291628+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:18:00.510183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,10],"acting":[2,6,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036203+0000","last_change":"2024-05-03T22:12:31.984789+0000","last_active":"2024-05-03T22:14:39.036203+0000","last_peered":"2024-05-03T22:14:39.036203+0000","last_clean":"2024-05-03T22:14:39.036203+0000","last_became_active":"2024-05-03T22:12:31.980106+0000","last_became_peered":"2024-05-03T22:12:31.980106+0000","last_unstale":"2024-05-03T22:14:39.036203+0000","last_undegraded":"2024-05-03T22:14:39.036203+0000","last_fullsized":"2024-05-03T22:14:39.036203+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:50:09.564802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038196+0000","last_change":"2024-05-03T22:13:37.973316+0000","last_active":"2024-05-03T22:14:39.038196+0000","last_peered":"2024-05-03T22:14:39.038196+0000","last_clean":"2024-05-03T22:14:39.038196+0000","last_became_active":"2024-05-03T22:13:37.972152+0000","last_became_peered":"2024-05-03T22:13:37.972152+0000","last_unstale":"2024-05-03T22:14:39.038196+0000","last_undegraded":"2024-05-03T22:14:39.038196+0000","last_fullsized":"2024-05-03T22:14:39.038196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:23:21.940322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287404+0000","last_change":"2024-05-03T22:12:52.145126+0000","last_active":"2024-05-03T22:14:38.287404+0000","last_peered":"2024-05-03T22:14:38.287404+0000","last_clean":"2024-05-03T22:14:38.287404+0000","last_became_active":"2024-05-03T22:12:52.144544+0000","last_became_peered":"2024-05-03T22:12:52.144544+0000","last_unstale":"2024-05-03T22:14:38.287404+0000","last_undegraded":"2024-05-03T22:14:38.287404+0000","last_fullsized":"2024-05-03T22:14:38.287404+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:59:54.069750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287087+0000","last_change":"2024-05-03T22:12:31.978411+0000","last_active":"2024-05-03T22:14:38.287087+0000","last_peered":"2024-05-03T22:14:38.287087+0000","last_clean":"2024-05-03T22:14:38.287087+0000","last_became_active":"2024-05-03T22:12:31.976914+0000","last_became_peered":"2024-05-03T22:12:31.976914+0000","last_unstale":"2024-05-03T22:14:38.287087+0000","last_undegraded":"2024-05-03T22:14:38.287087+0000","last_fullsized":"2024-05-03T22:14:38.287087+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:52:05.545111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290646+0000","last_change":"2024-05-03T22:12:36.014624+0000","last_active":"2024-05-03T22:14:38.290646+0000","last_peered":"2024-05-03T22:14:38.290646+0000","last_clean":"2024-05-03T22:14:38.290646+0000","last_became_active":"2024-05-03T22:12:36.012531+0000","last_became_peered":"2024-05-03T22:12:36.012531+0000","last_unstale":"2024-05-03T22:14:38.290646+0000","last_undegraded":"2024-05-03T22:14:38.290646+0000","last_fullsized":"2024-05-03T22:14:38.290646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:19:46.840442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297996+0000","last_change":"2024-05-03T22:12:52.137187+0000","last_active":"2024-05-03T22:14:38.297996+0000","last_peered":"2024-05-03T22:14:38.297996+0000","last_clean":"2024-05-03T22:14:38.297996+0000","last_became_active":"2024-05-03T22:12:52.136764+0000","last_became_peered":"2024-05-03T22:12:52.136764+0000","last_unstale":"2024-05-03T22:14:38.297996+0000","last_undegraded":"2024-05-03T22:14:38.297996+0000","last_fullsized":"2024-05-03T22:14:38.297996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:54:00.922048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037241+0000","last_change":"2024-05-03T22:12:31.982086+0000","last_active":"2024-05-03T22:14:39.037241+0000","last_peered":"2024-05-03T22:14:39.037241+0000","last_clean":"2024-05-03T22:14:39.037241+0000","last_became_active":"2024-05-03T22:12:31.981464+0000","last_became_peered":"2024-05-03T22:12:31.981464+0000","last_unstale":"2024-05-03T22:14:39.037241+0000","last_undegraded":"2024-05-03T22:14:39.037241+0000","last_fullsized":"2024-05-03T22:14:39.037241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:22.450640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283028+0000","last_change":"2024-05-03T22:12:36.015808+0000","last_active":"2024-05-03T22:14:38.283028+0000","last_peered":"2024-05-03T22:14:38.283028+0000","last_clean":"2024-05-03T22:14:38.283028+0000","last_became_active":"2024-05-03T22:12:36.015496+0000","last_became_peered":"2024-05-03T22:12:36.015496+0000","last_unstale":"2024-05-03T22:14:38.283028+0000","last_undegraded":"2024-05-03T22:14:38.283028+0000","last_fullsized":"2024-05-03T22:14:38.283028+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:12:18.316985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291624+0000","last_change":"2024-05-03T22:12:52.131977+0000","last_active":"2024-05-03T22:14:38.291624+0000","last_peered":"2024-05-03T22:14:38.291624+0000","last_clean":"2024-05-03T22:14:38.291624+0000","last_became_active":"2024-05-03T22:12:52.131120+0000","last_became_peered":"2024-05-03T22:12:52.131120+0000","last_unstale":"2024-05-03T22:14:38.291624+0000","last_undegraded":"2024-05-03T22:14:38.291624+0000","last_fullsized":"2024-05-03T22:14:38.291624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:38:28.239495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":128,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:45.245390+0000","last_change":"2024-05-03T22:12:31.977238+0000","last_active":"2024-05-03T22:14:45.245390+0000","last_peered":"2024-05-03T22:14:45.245390+0000","last_clean":"2024-05-03T22:14:45.245390+0000","last_became_active":"2024-05-03T22:12:31.975006+0000","last_became_peered":"2024-05-03T22:12:31.975006+0000","last_unstale":"2024-05-03T22:14:45.245390+0000","last_undegraded":"2024-05-03T22:14:45.245390+0000","last_fullsized":"2024-05-03T22:14:45.245390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:01.030733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728502+0000","last_change":"2024-05-03T22:12:36.007750+0000","last_active":"2024-05-03T22:14:38.728502+0000","last_peered":"2024-05-03T22:14:38.728502+0000","last_clean":"2024-05-03T22:14:38.728502+0000","last_became_active":"2024-05-03T22:12:36.005505+0000","last_became_peered":"2024-05-03T22:12:36.005505+0000","last_unstale":"2024-05-03T22:14:38.728502+0000","last_undegraded":"2024-05-03T22:14:38.728502+0000","last_fullsized":"2024-05-03T22:14:38.728502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:37:28.409920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283140+0000","last_change":"2024-05-03T22:12:52.142733+0000","last_active":"2024-05-03T22:14:38.283140+0000","last_peered":"2024-05-03T22:14:38.283140+0000","last_clean":"2024-05-03T22:14:38.283140+0000","last_became_active":"2024-05-03T22:12:52.142186+0000","last_became_peered":"2024-05-03T22:12:52.142186+0000","last_unstale":"2024-05-03T22:14:38.283140+0000","last_undegraded":"2024-05-03T22:14:38.283140+0000","last_fullsized":"2024-05-03T22:14:38.283140+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:05:12.226021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289088+0000","last_change":"2024-05-03T22:12:31.984945+0000","last_active":"2024-05-03T22:14:38.289088+0000","last_peered":"2024-05-03T22:14:38.289088+0000","last_clean":"2024-05-03T22:14:38.289088+0000","last_became_active":"2024-05-03T22:12:31.982844+0000","last_became_peered":"2024-05-03T22:12:31.982844+0000","last_unstale":"2024-05-03T22:14:38.289088+0000","last_undegraded":"2024-05-03T22:14:38.289088+0000","last_fullsized":"2024-05-03T22:14:38.289088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:51:13.520574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298901+0000","last_change":"2024-05-03T22:12:36.010250+0000","last_active":"2024-05-03T22:14:38.298901+0000","last_peered":"2024-05-03T22:14:38.298901+0000","last_clean":"2024-05-03T22:14:38.298901+0000","last_became_active":"2024-05-03T22:12:36.009867+0000","last_became_peered":"2024-05-03T22:12:36.009867+0000","last_unstale":"2024-05-03T22:14:38.298901+0000","last_undegraded":"2024-05-03T22:14:38.298901+0000","last_fullsized":"2024-05-03T22:14:38.298901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:21:07.114667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283475+0000","last_change":"2024-05-03T22:13:37.973331+0000","last_active":"2024-05-03T22:14:38.283475+0000","last_peered":"2024-05-03T22:14:38.283475+0000","last_clean":"2024-05-03T22:14:38.283475+0000","last_became_active":"2024-05-03T22:13:37.972030+0000","last_became_peered":"2024-05-03T22:13:37.972030+0000","last_unstale":"2024-05-03T22:14:38.283475+0000","last_undegraded":"2024-05-03T22:14:38.283475+0000","last_fullsized":"2024-05-03T22:14:38.283475+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:11:18.105975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037779+0000","last_change":"2024-05-03T22:12:32.021662+0000","last_active":"2024-05-03T22:14:39.037779+0000","last_peered":"2024-05-03T22:14:39.037779+0000","last_clean":"2024-05-03T22:14:39.037779+0000","last_became_active":"2024-05-03T22:12:32.021128+0000","last_became_peered":"2024-05-03T22:12:32.021128+0000","last_unstale":"2024-05-03T22:14:39.037779+0000","last_undegraded":"2024-05-03T22:14:39.037779+0000","last_fullsized":"2024-05-03T22:14:39.037779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:08:02.608160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728461+0000","last_change":"2024-05-03T22:13:37.973105+0000","last_active":"2024-05-03T22:14:38.728461+0000","last_peered":"2024-05-03T22:14:38.728461+0000","last_clean":"2024-05-03T22:14:38.728461+0000","last_became_active":"2024-05-03T22:13:37.971963+0000","last_became_peered":"2024-05-03T22:13:37.971963+0000","last_unstale":"2024-05-03T22:14:38.728461+0000","last_undegraded":"2024-05-03T22:14:38.728461+0000","last_fullsized":"2024-05-03T22:14:38.728461+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:22:50.092753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283115+0000","last_change":"2024-05-03T22:12:52.140596+0000","last_active":"2024-05-03T22:14:38.283115+0000","last_peered":"2024-05-03T22:14:38.283115+0000","last_clean":"2024-05-03T22:14:38.283115+0000","last_became_active":"2024-05-03T22:12:52.140185+0000","last_became_peered":"2024-05-03T22:12:52.140185+0000","last_unstale":"2024-05-03T22:14:38.283115+0000","last_undegraded":"2024-05-03T22:14:38.283115+0000","last_fullsized":"2024-05-03T22:14:38.283115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:01:53.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'35","reported_seq":168,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:45.263171+0000","last_change":"2024-05-03T22:12:31.984670+0000","last_active":"2024-05-03T22:14:45.263171+0000","last_peered":"2024-05-03T22:14:45.263171+0000","last_clean":"2024-05-03T22:14:45.263171+0000","last_became_active":"2024-05-03T22:12:31.983939+0000","last_became_peered":"2024-05-03T22:12:31.983939+0000","last_unstale":"2024-05-03T22:14:45.263171+0000","last_undegraded":"2024-05-03T22:14:45.263171+0000","last_fullsized":"2024-05-03T22:14:45.263171+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:29:13.702952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57951,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":89,"num_read_kb":100,"num_write":37,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285294+0000","last_change":"2024-05-03T22:12:36.010032+0000","last_active":"2024-05-03T22:14:38.285294+0000","last_peered":"2024-05-03T22:14:38.285294+0000","last_clean":"2024-05-03T22:14:38.285294+0000","last_became_active":"2024-05-03T22:12:36.009682+0000","last_became_peered":"2024-05-03T22:12:36.009682+0000","last_unstale":"2024-05-03T22:14:38.285294+0000","last_undegraded":"2024-05-03T22:14:38.285294+0000","last_fullsized":"2024-05-03T22:14:38.285294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:58.307939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038671+0000","last_change":"2024-05-03T22:12:52.137858+0000","last_active":"2024-05-03T22:14:39.038671+0000","last_peered":"2024-05-03T22:14:39.038671+0000","last_clean":"2024-05-03T22:14:39.038671+0000","last_became_active":"2024-05-03T22:12:52.137343+0000","last_became_peered":"2024-05-03T22:12:52.137343+0000","last_unstale":"2024-05-03T22:14:39.038671+0000","last_undegraded":"2024-05-03T22:14:39.038671+0000","last_fullsized":"2024-05-03T22:14:39.038671+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:30:20.534943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291954+0000","last_change":"2024-05-03T22:12:31.986574+0000","last_active":"2024-05-03T22:14:38.291954+0000","last_peered":"2024-05-03T22:14:38.291954+0000","last_clean":"2024-05-03T22:14:38.291954+0000","last_became_active":"2024-05-03T22:12:31.986168+0000","last_became_peered":"2024-05-03T22:12:31.986168+0000","last_unstale":"2024-05-03T22:14:38.291954+0000","last_undegraded":"2024-05-03T22:14:38.291954+0000","last_fullsized":"2024-05-03T22:14:38.291954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:09:22.184243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287336+0000","last_change":"2024-05-03T22:12:36.008859+0000","last_active":"2024-05-03T22:14:38.287336+0000","last_peered":"2024-05-03T22:14:38.287336+0000","last_clean":"2024-05-03T22:14:38.287336+0000","last_became_active":"2024-05-03T22:12:36.008301+0000","last_became_peered":"2024-05-03T22:12:36.008301+0000","last_unstale":"2024-05-03T22:14:38.287336+0000","last_undegraded":"2024-05-03T22:14:38.287336+0000","last_fullsized":"2024-05-03T22:14:38.287336+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:09:51.945525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288086+0000","last_change":"2024-05-03T22:12:52.143678+0000","last_active":"2024-05-03T22:14:38.288086+0000","last_peered":"2024-05-03T22:14:38.288086+0000","last_clean":"2024-05-03T22:14:38.288086+0000","last_became_active":"2024-05-03T22:12:52.143240+0000","last_became_peered":"2024-05-03T22:12:52.143240+0000","last_unstale":"2024-05-03T22:14:38.288086+0000","last_undegraded":"2024-05-03T22:14:38.288086+0000","last_fullsized":"2024-05-03T22:14:38.288086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:03.078230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037591+0000","last_change":"2024-05-03T22:12:31.987181+0000","last_active":"2024-05-03T22:14:39.037591+0000","last_peered":"2024-05-03T22:14:39.037591+0000","last_clean":"2024-05-03T22:14:39.037591+0000","last_became_active":"2024-05-03T22:12:31.986795+0000","last_became_peered":"2024-05-03T22:12:31.986795+0000","last_unstale":"2024-05-03T22:14:39.037591+0000","last_undegraded":"2024-05-03T22:14:39.037591+0000","last_fullsized":"2024-05-03T22:14:39.037591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:03.871175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289467+0000","last_change":"2024-05-03T22:12:36.023303+0000","last_active":"2024-05-03T22:14:38.289467+0000","last_peered":"2024-05-03T22:14:38.289467+0000","last_clean":"2024-05-03T22:14:38.289467+0000","last_became_active":"2024-05-03T22:12:36.022969+0000","last_became_peered":"2024-05-03T22:12:36.022969+0000","last_unstale":"2024-05-03T22:14:38.289467+0000","last_undegraded":"2024-05-03T22:14:38.289467+0000","last_fullsized":"2024-05-03T22:14:38.289467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:08:19.277423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283869+0000","last_change":"2024-05-03T22:12:52.145449+0000","last_active":"2024-05-03T22:14:38.283869+0000","last_peered":"2024-05-03T22:14:38.283869+0000","last_clean":"2024-05-03T22:14:38.283869+0000","last_became_active":"2024-05-03T22:12:52.144652+0000","last_became_peered":"2024-05-03T22:12:52.144652+0000","last_unstale":"2024-05-03T22:14:38.283869+0000","last_undegraded":"2024-05-03T22:14:38.283869+0000","last_fullsized":"2024-05-03T22:14:38.283869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:03:17.916994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":92,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:45.269812+0000","last_change":"2024-05-03T22:12:31.986355+0000","last_active":"2024-05-03T22:14:45.269812+0000","last_peered":"2024-05-03T22:14:45.269812+0000","last_clean":"2024-05-03T22:14:45.269812+0000","last_became_active":"2024-05-03T22:12:31.985927+0000","last_became_peered":"2024-05-03T22:12:31.985927+0000","last_unstale":"2024-05-03T22:14:45.269812+0000","last_undegraded":"2024-05-03T22:14:45.269812+0000","last_fullsized":"2024-05-03T22:14:45.269812+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:25:41.683036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288851+0000","last_change":"2024-05-03T22:13:37.973243+0000","last_active":"2024-05-03T22:14:38.288851+0000","last_peered":"2024-05-03T22:14:38.288851+0000","last_clean":"2024-05-03T22:14:38.288851+0000","last_became_active":"2024-05-03T22:13:37.972204+0000","last_became_peered":"2024-05-03T22:13:37.972204+0000","last_unstale":"2024-05-03T22:14:38.288851+0000","last_undegraded":"2024-05-03T22:14:38.288851+0000","last_fullsized":"2024-05-03T22:14:38.288851+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:58:23.537262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289736+0000","last_change":"2024-05-03T22:12:52.137933+0000","last_active":"2024-05-03T22:14:38.289736+0000","last_peered":"2024-05-03T22:14:38.289736+0000","last_clean":"2024-05-03T22:14:38.289736+0000","last_became_active":"2024-05-03T22:12:52.137339+0000","last_became_peered":"2024-05-03T22:12:52.137339+0000","last_unstale":"2024-05-03T22:14:38.289736+0000","last_undegraded":"2024-05-03T22:14:38.289736+0000","last_fullsized":"2024-05-03T22:14:38.289736+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:10:11.514234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":62,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284464+0000","last_change":"2024-05-03T22:12:32.023719+0000","last_active":"2024-05-03T22:14:38.284464+0000","last_peered":"2024-05-03T22:14:38.284464+0000","last_clean":"2024-05-03T22:14:38.284464+0000","last_became_active":"2024-05-03T22:12:32.022649+0000","last_became_peered":"2024-05-03T22:12:32.022649+0000","last_unstale":"2024-05-03T22:14:38.284464+0000","last_undegraded":"2024-05-03T22:14:38.284464+0000","last_fullsized":"2024-05-03T22:14:38.284464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:24:46.321843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037569+0000","last_change":"2024-05-03T22:12:36.019586+0000","last_active":"2024-05-03T22:14:39.037569+0000","last_peered":"2024-05-03T22:14:39.037569+0000","last_clean":"2024-05-03T22:14:39.037569+0000","last_became_active":"2024-05-03T22:12:36.019209+0000","last_became_peered":"2024-05-03T22:12:36.019209+0000","last_unstale":"2024-05-03T22:14:39.037569+0000","last_undegraded":"2024-05-03T22:14:39.037569+0000","last_fullsized":"2024-05-03T22:14:39.037569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:05:31.897550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037235+0000","last_change":"2024-05-03T22:12:52.137116+0000","last_active":"2024-05-03T22:14:39.037235+0000","last_peered":"2024-05-03T22:14:39.037235+0000","last_clean":"2024-05-03T22:14:39.037235+0000","last_became_active":"2024-05-03T22:12:52.135908+0000","last_became_peered":"2024-05-03T22:12:52.135908+0000","last_unstale":"2024-05-03T22:14:39.037235+0000","last_undegraded":"2024-05-03T22:14:39.037235+0000","last_fullsized":"2024-05-03T22:14:39.037235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:44.728662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284955+0000","last_change":"2024-05-03T22:12:31.982743+0000","last_active":"2024-05-03T22:14:38.284955+0000","last_peered":"2024-05-03T22:14:38.284955+0000","last_clean":"2024-05-03T22:14:38.284955+0000","last_became_active":"2024-05-03T22:12:31.982181+0000","last_became_peered":"2024-05-03T22:12:31.982181+0000","last_unstale":"2024-05-03T22:14:38.284955+0000","last_undegraded":"2024-05-03T22:14:38.284955+0000","last_fullsized":"2024-05-03T22:14:38.284955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:55:32.178361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288347+0000","last_change":"2024-05-03T22:12:36.017581+0000","last_active":"2024-05-03T22:14:38.288347+0000","last_peered":"2024-05-03T22:14:38.288347+0000","last_clean":"2024-05-03T22:14:38.288347+0000","last_became_active":"2024-05-03T22:12:36.017156+0000","last_became_peered":"2024-05-03T22:12:36.017156+0000","last_unstale":"2024-05-03T22:14:38.288347+0000","last_undegraded":"2024-05-03T22:14:38.288347+0000","last_fullsized":"2024-05-03T22:14:38.288347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:05:47.432249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284751+0000","last_change":"2024-05-03T22:12:52.149798+0000","last_active":"2024-05-03T22:14:38.284751+0000","last_peered":"2024-05-03T22:14:38.284751+0000","last_clean":"2024-05-03T22:14:38.284751+0000","last_became_active":"2024-05-03T22:12:52.149184+0000","last_became_peered":"2024-05-03T22:12:52.149184+0000","last_unstale":"2024-05-03T22:14:38.284751+0000","last_undegraded":"2024-05-03T22:14:38.284751+0000","last_fullsized":"2024-05-03T22:14:38.284751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:21:38.968847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283619+0000","last_change":"2024-05-03T22:12:32.022315+0000","last_active":"2024-05-03T22:14:38.283619+0000","last_peered":"2024-05-03T22:14:38.283619+0000","last_clean":"2024-05-03T22:14:38.283619+0000","last_became_active":"2024-05-03T22:12:32.021730+0000","last_became_peered":"2024-05-03T22:12:32.021730+0000","last_unstale":"2024-05-03T22:14:38.283619+0000","last_undegraded":"2024-05-03T22:14:38.283619+0000","last_fullsized":"2024-05-03T22:14:38.283619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:26.485434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036593+0000","last_change":"2024-05-03T22:12:36.004242+0000","last_active":"2024-05-03T22:14:39.036593+0000","last_peered":"2024-05-03T22:14:39.036593+0000","last_clean":"2024-05-03T22:14:39.036593+0000","last_became_active":"2024-05-03T22:12:36.003811+0000","last_became_peered":"2024-05-03T22:12:36.003811+0000","last_unstale":"2024-05-03T22:14:39.036593+0000","last_undegraded":"2024-05-03T22:14:39.036593+0000","last_fullsized":"2024-05-03T22:14:39.036593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:16:57.058316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289573+0000","last_change":"2024-05-03T22:12:52.125889+0000","last_active":"2024-05-03T22:14:38.289573+0000","last_peered":"2024-05-03T22:14:38.289573+0000","last_clean":"2024-05-03T22:14:38.289573+0000","last_became_active":"2024-05-03T22:12:52.125401+0000","last_became_peered":"2024-05-03T22:12:52.125401+0000","last_unstale":"2024-05-03T22:14:38.289573+0000","last_undegraded":"2024-05-03T22:14:38.289573+0000","last_fullsized":"2024-05-03T22:14:38.289573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:32:11.112125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'6","reported_seq":94,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:45.751615+0000","last_change":"2024-05-03T22:12:31.981194+0000","last_active":"2024-05-03T22:14:45.751615+0000","last_peered":"2024-05-03T22:14:45.751615+0000","last_clean":"2024-05-03T22:14:45.751615+0000","last_became_active":"2024-05-03T22:12:31.980685+0000","last_became_peered":"2024-05-03T22:12:31.980685+0000","last_unstale":"2024-05-03T22:14:45.751615+0000","last_undegraded":"2024-05-03T22:14:45.751615+0000","last_fullsized":"2024-05-03T22:14:45.751615+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:00:04.697119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036298+0000","last_change":"2024-05-03T22:12:36.020405+0000","last_active":"2024-05-03T22:14:39.036298+0000","last_peered":"2024-05-03T22:14:39.036298+0000","last_clean":"2024-05-03T22:14:39.036298+0000","last_became_active":"2024-05-03T22:12:36.020003+0000","last_became_peered":"2024-05-03T22:12:36.020003+0000","last_unstale":"2024-05-03T22:14:39.036298+0000","last_undegraded":"2024-05-03T22:14:39.036298+0000","last_fullsized":"2024-05-03T22:14:39.036298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:21:49.931145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291248+0000","last_change":"2024-05-03T22:12:52.130467+0000","last_active":"2024-05-03T22:14:38.291248+0000","last_peered":"2024-05-03T22:14:38.291248+0000","last_clean":"2024-05-03T22:14:38.291248+0000","last_became_active":"2024-05-03T22:12:52.129639+0000","last_became_peered":"2024-05-03T22:12:52.129639+0000","last_unstale":"2024-05-03T22:14:38.291248+0000","last_undegraded":"2024-05-03T22:14:38.291248+0000","last_fullsized":"2024-05-03T22:14:38.291248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:31:17.043909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037896+0000","last_change":"2024-05-03T22:12:36.010293+0000","last_active":"2024-05-03T22:14:39.037896+0000","last_peered":"2024-05-03T22:14:39.037896+0000","last_clean":"2024-05-03T22:14:39.037896+0000","last_became_active":"2024-05-03T22:12:36.009682+0000","last_became_peered":"2024-05-03T22:12:36.009682+0000","last_unstale":"2024-05-03T22:14:39.037896+0000","last_undegraded":"2024-05-03T22:14:39.037896+0000","last_fullsized":"2024-05-03T22:14:39.037896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:19:32.824272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":92,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:45.268592+0000","last_change":"2024-05-03T22:12:32.019614+0000","last_active":"2024-05-03T22:14:45.268592+0000","last_peered":"2024-05-03T22:14:45.268592+0000","last_clean":"2024-05-03T22:14:45.268592+0000","last_became_active":"2024-05-03T22:12:32.018880+0000","last_became_peered":"2024-05-03T22:12:32.018880+0000","last_unstale":"2024-05-03T22:14:45.268592+0000","last_undegraded":"2024-05-03T22:14:45.268592+0000","last_fullsized":"2024-05-03T22:14:45.268592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:01:46.354811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288968+0000","last_change":"2024-05-03T22:12:52.142829+0000","last_active":"2024-05-03T22:14:38.288968+0000","last_peered":"2024-05-03T22:14:38.288968+0000","last_clean":"2024-05-03T22:14:38.288968+0000","last_became_active":"2024-05-03T22:12:52.142289+0000","last_became_peered":"2024-05-03T22:12:52.142289+0000","last_unstale":"2024-05-03T22:14:38.288968+0000","last_undegraded":"2024-05-03T22:14:38.288968+0000","last_fullsized":"2024-05-03T22:14:38.288968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:54:44.815014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.293260+0000","last_change":"2024-05-03T22:12:36.009551+0000","last_active":"2024-05-03T22:14:38.293260+0000","last_peered":"2024-05-03T22:14:38.293260+0000","last_clean":"2024-05-03T22:14:38.293260+0000","last_became_active":"2024-05-03T22:12:36.009180+0000","last_became_peered":"2024-05-03T22:12:36.009180+0000","last_unstale":"2024-05-03T22:14:38.293260+0000","last_undegraded":"2024-05-03T22:14:38.293260+0000","last_fullsized":"2024-05-03T22:14:38.293260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:03:17.824610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283475+0000","last_change":"2024-05-03T22:12:31.988051+0000","last_active":"2024-05-03T22:14:38.283475+0000","last_peered":"2024-05-03T22:14:38.283475+0000","last_clean":"2024-05-03T22:14:38.283475+0000","last_became_active":"2024-05-03T22:12:31.987641+0000","last_became_peered":"2024-05-03T22:12:31.987641+0000","last_unstale":"2024-05-03T22:14:38.283475+0000","last_undegraded":"2024-05-03T22:14:38.283475+0000","last_fullsized":"2024-05-03T22:14:38.283475+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:51:02.824815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":120,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288590+0000","last_change":"2024-05-03T22:10:37.173231+0000","last_active":"2024-05-03T22:14:38.288590+0000","last_peered":"2024-05-03T22:14:38.288590+0000","last_clean":"2024-05-03T22:14:38.288590+0000","last_became_active":"2024-05-03T22:10:37.157400+0000","last_became_peered":"2024-05-03T22:10:37.157400+0000","last_unstale":"2024-05-03T22:14:38.288590+0000","last_undegraded":"2024-05-03T22:14:38.288590+0000","last_fullsized":"2024-05-03T22:14:38.288590+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:05:53.333203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:05:53.333203+0000","last_clean_scrub_stamp":"2024-05-03T22:05:53.333203+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:51:06.825624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038851+0000","last_change":"2024-05-03T22:12:52.137851+0000","last_active":"2024-05-03T22:14:39.038851+0000","last_peered":"2024-05-03T22:14:39.038851+0000","last_clean":"2024-05-03T22:14:39.038851+0000","last_became_active":"2024-05-03T22:12:52.136608+0000","last_became_peered":"2024-05-03T22:12:52.136608+0000","last_unstale":"2024-05-03T22:14:39.038851+0000","last_undegraded":"2024-05-03T22:14:39.038851+0000","last_fullsized":"2024-05-03T22:14:39.038851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:43:59.013159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286653+0000","last_change":"2024-05-03T22:12:36.007079+0000","last_active":"2024-05-03T22:14:38.286653+0000","last_peered":"2024-05-03T22:14:38.286653+0000","last_clean":"2024-05-03T22:14:38.286653+0000","last_became_active":"2024-05-03T22:12:36.006737+0000","last_became_peered":"2024-05-03T22:12:36.006737+0000","last_unstale":"2024-05-03T22:14:38.286653+0000","last_undegraded":"2024-05-03T22:14:38.286653+0000","last_fullsized":"2024-05-03T22:14:38.286653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:24:56.805461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288714+0000","last_change":"2024-05-03T22:12:31.982718+0000","last_active":"2024-05-03T22:14:38.288714+0000","last_peered":"2024-05-03T22:14:38.288714+0000","last_clean":"2024-05-03T22:14:38.288714+0000","last_became_active":"2024-05-03T22:12:31.980502+0000","last_became_peered":"2024-05-03T22:12:31.980502+0000","last_unstale":"2024-05-03T22:14:38.288714+0000","last_undegraded":"2024-05-03T22:14:38.288714+0000","last_fullsized":"2024-05-03T22:14:38.288714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:06:48.543038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286693+0000","last_change":"2024-05-03T22:12:52.130775+0000","last_active":"2024-05-03T22:14:38.286693+0000","last_peered":"2024-05-03T22:14:38.286693+0000","last_clean":"2024-05-03T22:14:38.286693+0000","last_became_active":"2024-05-03T22:12:52.130122+0000","last_became_peered":"2024-05-03T22:12:52.130122+0000","last_unstale":"2024-05-03T22:14:38.286693+0000","last_undegraded":"2024-05-03T22:14:38.286693+0000","last_fullsized":"2024-05-03T22:14:38.286693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:49.308484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.314204+0000","last_change":"2024-05-03T22:14:38.313777+0000","last_active":"2024-05-03T22:14:38.314204+0000","last_peered":"2024-05-03T22:14:38.314204+0000","last_clean":"2024-05-03T22:14:38.314204+0000","last_became_active":"2024-05-03T22:14:38.298126+0000","last_became_peered":"2024-05-03T22:14:38.298126+0000","last_unstale":"2024-05-03T22:14:38.314204+0000","last_undegraded":"2024-05-03T22:14:38.314204+0000","last_fullsized":"2024-05-03T22:14:38.314204+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:24:15.804010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289442+0000","last_change":"2024-05-03T22:12:36.005260+0000","last_active":"2024-05-03T22:14:38.289442+0000","last_peered":"2024-05-03T22:14:38.289442+0000","last_clean":"2024-05-03T22:14:38.289442+0000","last_became_active":"2024-05-03T22:12:36.004942+0000","last_became_peered":"2024-05-03T22:12:36.004942+0000","last_unstale":"2024-05-03T22:14:38.289442+0000","last_undegraded":"2024-05-03T22:14:38.289442+0000","last_fullsized":"2024-05-03T22:14:38.289442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:46.395893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290518+0000","last_change":"2024-05-03T22:12:52.132278+0000","last_active":"2024-05-03T22:14:38.290518+0000","last_peered":"2024-05-03T22:14:38.290518+0000","last_clean":"2024-05-03T22:14:38.290518+0000","last_became_active":"2024-05-03T22:12:52.131836+0000","last_became_peered":"2024-05-03T22:12:52.131836+0000","last_unstale":"2024-05-03T22:14:38.290518+0000","last_undegraded":"2024-05-03T22:14:38.290518+0000","last_fullsized":"2024-05-03T22:14:38.290518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:54:07.305893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'14","reported_seq":59,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285617+0000","last_change":"2024-05-03T22:12:31.978324+0000","last_active":"2024-05-03T22:14:38.285617+0000","last_peered":"2024-05-03T22:14:38.285617+0000","last_clean":"2024-05-03T22:14:38.285617+0000","last_became_active":"2024-05-03T22:12:31.977156+0000","last_became_peered":"2024-05-03T22:12:31.977156+0000","last_unstale":"2024-05-03T22:14:38.285617+0000","last_undegraded":"2024-05-03T22:14:38.285617+0000","last_fullsized":"2024-05-03T22:14:38.285617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:45:28.549187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290950+0000","last_change":"2024-05-03T22:12:36.014986+0000","last_active":"2024-05-03T22:14:38.290950+0000","last_peered":"2024-05-03T22:14:38.290950+0000","last_clean":"2024-05-03T22:14:38.290950+0000","last_became_active":"2024-05-03T22:12:36.014664+0000","last_became_peered":"2024-05-03T22:12:36.014664+0000","last_unstale":"2024-05-03T22:14:38.290950+0000","last_undegraded":"2024-05-03T22:14:38.290950+0000","last_fullsized":"2024-05-03T22:14:38.290950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:46:13.807806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291263+0000","last_change":"2024-05-03T22:12:52.126771+0000","last_active":"2024-05-03T22:14:38.291263+0000","last_peered":"2024-05-03T22:14:38.291263+0000","last_clean":"2024-05-03T22:14:38.291263+0000","last_became_active":"2024-05-03T22:12:52.126257+0000","last_became_peered":"2024-05-03T22:12:52.126257+0000","last_unstale":"2024-05-03T22:14:38.291263+0000","last_undegraded":"2024-05-03T22:14:38.291263+0000","last_fullsized":"2024-05-03T22:14:38.291263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:53:03.823305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283848+0000","last_change":"2024-05-03T22:12:31.981674+0000","last_active":"2024-05-03T22:14:38.283848+0000","last_peered":"2024-05-03T22:14:38.283848+0000","last_clean":"2024-05-03T22:14:38.283848+0000","last_became_active":"2024-05-03T22:12:31.976707+0000","last_became_peered":"2024-05-03T22:12:31.976707+0000","last_unstale":"2024-05-03T22:14:38.283848+0000","last_undegraded":"2024-05-03T22:14:38.283848+0000","last_fullsized":"2024-05-03T22:14:38.283848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:44:21.743865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298489+0000","last_change":"2024-05-03T22:12:35.997309+0000","last_active":"2024-05-03T22:14:38.298489+0000","last_peered":"2024-05-03T22:14:38.298489+0000","last_clean":"2024-05-03T22:14:38.298489+0000","last_became_active":"2024-05-03T22:12:35.996879+0000","last_became_peered":"2024-05-03T22:12:35.996879+0000","last_unstale":"2024-05-03T22:14:38.298489+0000","last_undegraded":"2024-05-03T22:14:38.298489+0000","last_fullsized":"2024-05-03T22:14:38.298489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:01:25.009038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283744+0000","last_change":"2024-05-03T22:12:52.145503+0000","last_active":"2024-05-03T22:14:38.283744+0000","last_peered":"2024-05-03T22:14:38.283744+0000","last_clean":"2024-05-03T22:14:38.283744+0000","last_became_active":"2024-05-03T22:12:52.144719+0000","last_became_peered":"2024-05-03T22:12:52.144719+0000","last_unstale":"2024-05-03T22:14:38.283744+0000","last_undegraded":"2024-05-03T22:14:38.283744+0000","last_fullsized":"2024-05-03T22:14:38.283744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:49:30.683367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.727869+0000","last_change":"2024-05-03T22:12:32.019228+0000","last_active":"2024-05-03T22:14:38.727869+0000","last_peered":"2024-05-03T22:14:38.727869+0000","last_clean":"2024-05-03T22:14:38.727869+0000","last_became_active":"2024-05-03T22:12:32.018648+0000","last_became_peered":"2024-05-03T22:12:32.018648+0000","last_unstale":"2024-05-03T22:14:38.727869+0000","last_undegraded":"2024-05-03T22:14:38.727869+0000","last_fullsized":"2024-05-03T22:14:38.727869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:21.695600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284715+0000","last_change":"2024-05-03T22:12:36.012712+0000","last_active":"2024-05-03T22:14:38.284715+0000","last_peered":"2024-05-03T22:14:38.284715+0000","last_clean":"2024-05-03T22:14:38.284715+0000","last_became_active":"2024-05-03T22:12:36.012278+0000","last_became_peered":"2024-05-03T22:12:36.012278+0000","last_unstale":"2024-05-03T22:14:38.284715+0000","last_undegraded":"2024-05-03T22:14:38.284715+0000","last_fullsized":"2024-05-03T22:14:38.284715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:16:21.511575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284049+0000","last_change":"2024-05-03T22:12:52.145070+0000","last_active":"2024-05-03T22:14:38.284049+0000","last_peered":"2024-05-03T22:14:38.284049+0000","last_clean":"2024-05-03T22:14:38.284049+0000","last_became_active":"2024-05-03T22:12:52.144071+0000","last_became_peered":"2024-05-03T22:12:52.144071+0000","last_unstale":"2024-05-03T22:14:38.284049+0000","last_undegraded":"2024-05-03T22:14:38.284049+0000","last_fullsized":"2024-05-03T22:14:38.284049+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:44:12.696121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291762+0000","last_change":"2024-05-03T22:12:31.971569+0000","last_active":"2024-05-03T22:14:38.291762+0000","last_peered":"2024-05-03T22:14:38.291762+0000","last_clean":"2024-05-03T22:14:38.291762+0000","last_became_active":"2024-05-03T22:12:31.970883+0000","last_became_peered":"2024-05-03T22:12:31.970883+0000","last_unstale":"2024-05-03T22:14:38.291762+0000","last_undegraded":"2024-05-03T22:14:38.291762+0000","last_fullsized":"2024-05-03T22:14:38.291762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:12:50.629452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286430+0000","last_change":"2024-05-03T22:12:36.019209+0000","last_active":"2024-05-03T22:14:38.286430+0000","last_peered":"2024-05-03T22:14:38.286430+0000","last_clean":"2024-05-03T22:14:38.286430+0000","last_became_active":"2024-05-03T22:12:36.018887+0000","last_became_peered":"2024-05-03T22:12:36.018887+0000","last_unstale":"2024-05-03T22:14:38.286430+0000","last_undegraded":"2024-05-03T22:14:38.286430+0000","last_fullsized":"2024-05-03T22:14:38.286430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:29:36.775592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283400+0000","last_change":"2024-05-03T22:12:52.145179+0000","last_active":"2024-05-03T22:14:38.283400+0000","last_peered":"2024-05-03T22:14:38.283400+0000","last_clean":"2024-05-03T22:14:38.283400+0000","last_became_active":"2024-05-03T22:12:52.144344+0000","last_became_peered":"2024-05-03T22:12:52.144344+0000","last_unstale":"2024-05-03T22:14:38.283400+0000","last_undegraded":"2024-05-03T22:14:38.283400+0000","last_fullsized":"2024-05-03T22:14:38.283400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:54:10.637934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.307151+0000","last_change":"2024-05-03T22:14:38.306297+0000","last_active":"2024-05-03T22:14:38.307151+0000","last_peered":"2024-05-03T22:14:38.307151+0000","last_clean":"2024-05-03T22:14:38.307151+0000","last_became_active":"2024-05-03T22:14:38.298089+0000","last_became_peered":"2024-05-03T22:14:38.298089+0000","last_unstale":"2024-05-03T22:14:38.307151+0000","last_undegraded":"2024-05-03T22:14:38.307151+0000","last_fullsized":"2024-05-03T22:14:38.307151+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:44.456436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290984+0000","last_change":"2024-05-03T22:12:36.002569+0000","last_active":"2024-05-03T22:14:38.290984+0000","last_peered":"2024-05-03T22:14:38.290984+0000","last_clean":"2024-05-03T22:14:38.290984+0000","last_became_active":"2024-05-03T22:12:36.002219+0000","last_became_peered":"2024-05-03T22:12:36.002219+0000","last_unstale":"2024-05-03T22:14:38.290984+0000","last_undegraded":"2024-05-03T22:14:38.290984+0000","last_fullsized":"2024-05-03T22:14:38.290984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:43:56.530139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283411+0000","last_change":"2024-05-03T22:12:52.137365+0000","last_active":"2024-05-03T22:14:38.283411+0000","last_peered":"2024-05-03T22:14:38.283411+0000","last_clean":"2024-05-03T22:14:38.283411+0000","last_became_active":"2024-05-03T22:12:52.136695+0000","last_became_peered":"2024-05-03T22:12:52.136695+0000","last_unstale":"2024-05-03T22:14:38.283411+0000","last_undegraded":"2024-05-03T22:14:38.283411+0000","last_fullsized":"2024-05-03T22:14:38.283411+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:06:05.439487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285151+0000","last_change":"2024-05-03T22:12:31.983289+0000","last_active":"2024-05-03T22:14:38.285151+0000","last_peered":"2024-05-03T22:14:38.285151+0000","last_clean":"2024-05-03T22:14:38.285151+0000","last_became_active":"2024-05-03T22:12:31.982873+0000","last_became_peered":"2024-05-03T22:12:31.982873+0000","last_unstale":"2024-05-03T22:14:38.285151+0000","last_undegraded":"2024-05-03T22:14:38.285151+0000","last_fullsized":"2024-05-03T22:14:38.285151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:50.973960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289190+0000","last_change":"2024-05-03T22:12:36.025173+0000","last_active":"2024-05-03T22:14:38.289190+0000","last_peered":"2024-05-03T22:14:38.289190+0000","last_clean":"2024-05-03T22:14:38.289190+0000","last_became_active":"2024-05-03T22:12:36.021875+0000","last_became_peered":"2024-05-03T22:12:36.021875+0000","last_unstale":"2024-05-03T22:14:38.289190+0000","last_undegraded":"2024-05-03T22:14:38.289190+0000","last_fullsized":"2024-05-03T22:14:38.289190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:05:15.963921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.727951+0000","last_change":"2024-05-03T22:12:52.132608+0000","last_active":"2024-05-03T22:14:38.727951+0000","last_peered":"2024-05-03T22:14:38.727951+0000","last_clean":"2024-05-03T22:14:38.727951+0000","last_became_active":"2024-05-03T22:12:52.132115+0000","last_became_peered":"2024-05-03T22:12:52.132115+0000","last_unstale":"2024-05-03T22:14:38.727951+0000","last_undegraded":"2024-05-03T22:14:38.727951+0000","last_fullsized":"2024-05-03T22:14:38.727951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:01:30.571145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":93,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:46.249858+0000","last_change":"2024-05-03T22:12:32.021562+0000","last_active":"2024-05-03T22:14:46.249858+0000","last_peered":"2024-05-03T22:14:46.249858+0000","last_clean":"2024-05-03T22:14:46.249858+0000","last_became_active":"2024-05-03T22:12:32.020913+0000","last_became_peered":"2024-05-03T22:12:32.020913+0000","last_unstale":"2024-05-03T22:14:46.249858+0000","last_undegraded":"2024-05-03T22:14:46.249858+0000","last_fullsized":"2024-05-03T22:14:46.249858+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:02:37.549388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289368+0000","last_change":"2024-05-03T22:12:36.019237+0000","last_active":"2024-05-03T22:14:38.289368+0000","last_peered":"2024-05-03T22:14:38.289368+0000","last_clean":"2024-05-03T22:14:38.289368+0000","last_became_active":"2024-05-03T22:12:36.018411+0000","last_became_peered":"2024-05-03T22:12:36.018411+0000","last_unstale":"2024-05-03T22:14:38.289368+0000","last_undegraded":"2024-05-03T22:14:38.289368+0000","last_fullsized":"2024-05-03T22:14:38.289368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:45:59.701403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.296938+0000","last_change":"2024-05-03T22:12:52.146882+0000","last_active":"2024-05-03T22:14:38.296938+0000","last_peered":"2024-05-03T22:14:38.296938+0000","last_clean":"2024-05-03T22:14:38.296938+0000","last_became_active":"2024-05-03T22:12:52.146316+0000","last_became_peered":"2024-05-03T22:12:52.146316+0000","last_unstale":"2024-05-03T22:14:38.296938+0000","last_undegraded":"2024-05-03T22:14:38.296938+0000","last_fullsized":"2024-05-03T22:14:38.296938+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:01:03.443777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038367+0000","last_change":"2024-05-03T22:12:31.983036+0000","last_active":"2024-05-03T22:14:39.038367+0000","last_peered":"2024-05-03T22:14:39.038367+0000","last_clean":"2024-05-03T22:14:39.038367+0000","last_became_active":"2024-05-03T22:12:31.979875+0000","last_became_peered":"2024-05-03T22:12:31.979875+0000","last_unstale":"2024-05-03T22:14:39.038367+0000","last_undegraded":"2024-05-03T22:14:39.038367+0000","last_fullsized":"2024-05-03T22:14:39.038367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:26:56.227766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288764+0000","last_change":"2024-05-03T22:13:37.972323+0000","last_active":"2024-05-03T22:14:38.288764+0000","last_peered":"2024-05-03T22:14:38.288764+0000","last_clean":"2024-05-03T22:14:38.288764+0000","last_became_active":"2024-05-03T22:13:37.971207+0000","last_became_peered":"2024-05-03T22:13:37.971207+0000","last_unstale":"2024-05-03T22:14:38.288764+0000","last_undegraded":"2024-05-03T22:14:38.288764+0000","last_fullsized":"2024-05-03T22:14:38.288764+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:49.939213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036930+0000","last_change":"2024-05-03T22:12:52.125489+0000","last_active":"2024-05-03T22:14:39.036930+0000","last_peered":"2024-05-03T22:14:39.036930+0000","last_clean":"2024-05-03T22:14:39.036930+0000","last_became_active":"2024-05-03T22:12:52.124767+0000","last_became_peered":"2024-05-03T22:12:52.124767+0000","last_unstale":"2024-05-03T22:14:39.036930+0000","last_undegraded":"2024-05-03T22:14:39.036930+0000","last_fullsized":"2024-05-03T22:14:39.036930+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:47:29.027353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":62,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.312346+0000","last_change":"2024-05-03T22:14:38.311637+0000","last_active":"2024-05-03T22:14:38.312346+0000","last_peered":"2024-05-03T22:14:38.312346+0000","last_clean":"2024-05-03T22:14:38.312346+0000","last_became_active":"2024-05-03T22:14:38.299881+0000","last_became_peered":"2024-05-03T22:14:38.299881+0000","last_unstale":"2024-05-03T22:14:38.312346+0000","last_undegraded":"2024-05-03T22:14:38.312346+0000","last_fullsized":"2024-05-03T22:14:38.312346+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:51:27.491122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289571+0000","last_change":"2024-05-03T22:12:36.015753+0000","last_active":"2024-05-03T22:14:38.289571+0000","last_peered":"2024-05-03T22:14:38.289571+0000","last_clean":"2024-05-03T22:14:38.289571+0000","last_became_active":"2024-05-03T22:12:36.011569+0000","last_became_peered":"2024-05-03T22:12:36.011569+0000","last_unstale":"2024-05-03T22:14:38.289571+0000","last_undegraded":"2024-05-03T22:14:38.289571+0000","last_fullsized":"2024-05-03T22:14:38.289571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:30:48.897252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286581+0000","last_change":"2024-05-03T22:12:36.017738+0000","last_active":"2024-05-03T22:14:38.286581+0000","last_peered":"2024-05-03T22:14:38.286581+0000","last_clean":"2024-05-03T22:14:38.286581+0000","last_became_active":"2024-05-03T22:12:36.017293+0000","last_became_peered":"2024-05-03T22:12:36.017293+0000","last_unstale":"2024-05-03T22:14:38.286581+0000","last_undegraded":"2024-05-03T22:14:38.286581+0000","last_fullsized":"2024-05-03T22:14:38.286581+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:20:35.141892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291607+0000","last_change":"2024-05-03T22:13:37.911165+0000","last_active":"2024-05-03T22:14:38.291607+0000","last_peered":"2024-05-03T22:14:38.291607+0000","last_clean":"2024-05-03T22:14:38.291607+0000","last_became_active":"2024-05-03T22:13:37.910476+0000","last_became_peered":"2024-05-03T22:13:37.910476+0000","last_unstale":"2024-05-03T22:14:38.291607+0000","last_undegraded":"2024-05-03T22:14:38.291607+0000","last_fullsized":"2024-05-03T22:14:38.291607+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:07.195308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290909+0000","last_change":"2024-05-03T22:12:36.001119+0000","last_active":"2024-05-03T22:14:38.290909+0000","last_peered":"2024-05-03T22:14:38.290909+0000","last_clean":"2024-05-03T22:14:38.290909+0000","last_became_active":"2024-05-03T22:12:36.000728+0000","last_became_peered":"2024-05-03T22:12:36.000728+0000","last_unstale":"2024-05-03T22:14:38.290909+0000","last_undegraded":"2024-05-03T22:14:38.290909+0000","last_fullsized":"2024-05-03T22:14:38.290909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:02:29.413354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297854+0000","last_change":"2024-05-03T22:12:36.004256+0000","last_active":"2024-05-03T22:14:38.297854+0000","last_peered":"2024-05-03T22:14:38.297854+0000","last_clean":"2024-05-03T22:14:38.297854+0000","last_became_active":"2024-05-03T22:12:36.004002+0000","last_became_peered":"2024-05-03T22:12:36.004002+0000","last_unstale":"2024-05-03T22:14:38.297854+0000","last_undegraded":"2024-05-03T22:14:38.297854+0000","last_fullsized":"2024-05-03T22:14:38.297854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:50:55.748069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289338+0000","last_change":"2024-05-03T22:12:36.006160+0000","last_active":"2024-05-03T22:14:38.289338+0000","last_peered":"2024-05-03T22:14:38.289338+0000","last_clean":"2024-05-03T22:14:38.289338+0000","last_became_active":"2024-05-03T22:12:36.001061+0000","last_became_peered":"2024-05-03T22:12:36.001061+0000","last_unstale":"2024-05-03T22:14:38.289338+0000","last_undegraded":"2024-05-03T22:14:38.289338+0000","last_fullsized":"2024-05-03T22:14:38.289338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:49:32.033970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287632+0000","last_change":"2024-05-03T22:13:37.974073+0000","last_active":"2024-05-03T22:14:38.287632+0000","last_peered":"2024-05-03T22:14:38.287632+0000","last_clean":"2024-05-03T22:14:38.287632+0000","last_became_active":"2024-05-03T22:13:37.973009+0000","last_became_peered":"2024-05-03T22:13:37.973009+0000","last_unstale":"2024-05-03T22:14:38.287632+0000","last_undegraded":"2024-05-03T22:14:38.287632+0000","last_fullsized":"2024-05-03T22:14:38.287632+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:00:37.511026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291431+0000","last_change":"2024-05-03T22:12:36.014463+0000","last_active":"2024-05-03T22:14:38.291431+0000","last_peered":"2024-05-03T22:14:38.291431+0000","last_clean":"2024-05-03T22:14:38.291431+0000","last_became_active":"2024-05-03T22:12:36.014130+0000","last_became_peered":"2024-05-03T22:12:36.014130+0000","last_unstale":"2024-05-03T22:14:38.291431+0000","last_undegraded":"2024-05-03T22:14:38.291431+0000","last_fullsized":"2024-05-03T22:14:38.291431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:44:28.681255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291878+0000","last_change":"2024-05-03T22:12:36.000528+0000","last_active":"2024-05-03T22:14:38.291878+0000","last_peered":"2024-05-03T22:14:38.291878+0000","last_clean":"2024-05-03T22:14:38.291878+0000","last_became_active":"2024-05-03T22:12:35.999985+0000","last_became_peered":"2024-05-03T22:12:35.999985+0000","last_unstale":"2024-05-03T22:14:38.291878+0000","last_undegraded":"2024-05-03T22:14:38.291878+0000","last_fullsized":"2024-05-03T22:14:38.291878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:36:13.835098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037474+0000","last_change":"2024-05-03T22:12:36.010009+0000","last_active":"2024-05-03T22:14:39.037474+0000","last_peered":"2024-05-03T22:14:39.037474+0000","last_clean":"2024-05-03T22:14:39.037474+0000","last_became_active":"2024-05-03T22:12:36.009139+0000","last_became_peered":"2024-05-03T22:12:36.009139+0000","last_unstale":"2024-05-03T22:14:39.037474+0000","last_undegraded":"2024-05-03T22:14:39.037474+0000","last_fullsized":"2024-05-03T22:14:39.037474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:59.111774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291812+0000","last_change":"2024-05-03T22:12:36.015949+0000","last_active":"2024-05-03T22:14:38.291812+0000","last_peered":"2024-05-03T22:14:38.291812+0000","last_clean":"2024-05-03T22:14:38.291812+0000","last_became_active":"2024-05-03T22:12:36.015597+0000","last_became_peered":"2024-05-03T22:12:36.015597+0000","last_unstale":"2024-05-03T22:14:38.291812+0000","last_undegraded":"2024-05-03T22:14:38.291812+0000","last_fullsized":"2024-05-03T22:14:38.291812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:24:29.855732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728173+0000","last_change":"2024-05-03T22:12:36.013462+0000","last_active":"2024-05-03T22:14:38.728173+0000","last_peered":"2024-05-03T22:14:38.728173+0000","last_clean":"2024-05-03T22:14:38.728173+0000","last_became_active":"2024-05-03T22:12:36.012664+0000","last_became_peered":"2024-05-03T22:12:36.012664+0000","last_unstale":"2024-05-03T22:14:38.728173+0000","last_undegraded":"2024-05-03T22:14:38.728173+0000","last_fullsized":"2024-05-03T22:14:38.728173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:28:53.979742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288826+0000","last_change":"2024-05-03T22:12:36.010367+0000","last_active":"2024-05-03T22:14:38.288826+0000","last_peered":"2024-05-03T22:14:38.288826+0000","last_clean":"2024-05-03T22:14:38.288826+0000","last_became_active":"2024-05-03T22:12:36.009968+0000","last_became_peered":"2024-05-03T22:12:36.009968+0000","last_unstale":"2024-05-03T22:14:38.288826+0000","last_undegraded":"2024-05-03T22:14:38.288826+0000","last_fullsized":"2024-05-03T22:14:38.288826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:34:48.542080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288238+0000","last_change":"2024-05-03T22:12:36.023670+0000","last_active":"2024-05-03T22:14:38.288238+0000","last_peered":"2024-05-03T22:14:38.288238+0000","last_clean":"2024-05-03T22:14:38.288238+0000","last_became_active":"2024-05-03T22:12:36.022774+0000","last_became_peered":"2024-05-03T22:12:36.022774+0000","last_unstale":"2024-05-03T22:14:38.288238+0000","last_undegraded":"2024-05-03T22:14:38.288238+0000","last_fullsized":"2024-05-03T22:14:38.288238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:33:05.929349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65155,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":436,"num_read_kb":284,"num_write":246,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":195465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612652,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":530005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808885,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32892,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712260,"statfs":{"total":95995035648,"available":95961354240,"internally_reserved":0,"allocated":1753088,"data_stored":1174660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005114,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":533919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201347,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1069056,"data_stored":529417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397578,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32824,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712328,"statfs":{"total":95995035648,"available":95961423872,"internally_reserved":0,"allocated":1683456,"data_stored":1127089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561105,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":525718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":585371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738491,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":526783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411438,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1146880,"data_stored":584919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149799,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":525035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953568,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":529401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757336,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32832,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712320,"statfs":{"total":95995035648,"available":95961415680,"internally_reserved":0,"allocated":1691648,"data_stored":1122280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T22:14:51.144 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-03T22:14:51.145 INFO:tasks.cephadm:Setting up client nodes... 2024-05-03T22:14:51.145 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-03T22:14:51.634 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:51.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:51 smithi116 ceph-mon[31828]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:14:51.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:51 smithi082 ceph-mon[28404]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:14:51.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:51 smithi130 ceph-mon[32417]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:14:52.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:52 smithi116 ceph-mon[31828]: pgmap v449: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 10 op/s; 65 B/s, 1 objects/s recovering 2024-05-03T22:14:52.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:52 smithi082 ceph-mon[28404]: pgmap v449: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 10 op/s; 65 B/s, 1 objects/s recovering 2024-05-03T22:14:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:52 smithi130 ceph-mon[32417]: pgmap v449: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 10 op/s; 65 B/s, 1 objects/s recovering 2024-05-03T22:14:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.028+0000 7fc0aec00700 1 -- 172.21.15.82:0/3325118335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8106950 msgr2=0x7fc0a8106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.028+0000 7fc0aec00700 1 --2- 172.21.15.82:0/3325118335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8106950 0x7fc0a8106db0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc0940099c0 tx=0x7fc094009cd0 comp rx=0 tx=0).stop 2024-05-03T22:14:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.029+0000 7fc0aec00700 1 -- 172.21.15.82:0/3325118335 shutdown_connections 2024-05-03T22:14:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.029+0000 7fc0aec00700 1 --2- 172.21.15.82:0/3325118335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a81072f0 0x7fc0a810dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.029+0000 7fc0aec00700 1 --2- 172.21.15.82:0/3325118335 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0a8105750 0x7fc0a8105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.029+0000 7fc0aec00700 1 --2- 172.21.15.82:0/3325118335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8106950 0x7fc0a8106db0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.029+0000 7fc0aec00700 1 -- 172.21.15.82:0/3325118335 >> 172.21.15.82:0/3325118335 conn(0x7fc0a8100cf0 msgr2=0x7fc0a8103130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.029+0000 7fc0aec00700 1 -- 172.21.15.82:0/3325118335 shutdown_connections 2024-05-03T22:14:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.029+0000 7fc0aec00700 1 -- 172.21.15.82:0/3325118335 wait complete. 2024-05-03T22:14:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.031+0000 7fc0aec00700 1 Processor -- start 2024-05-03T22:14:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.031+0000 7fc0aec00700 1 -- start start 2024-05-03T22:14:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.031+0000 7fc0aec00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8105750 0x7fc0a819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.031+0000 7fc0aec00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8106950 0x7fc0a819bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0aec00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0a81072f0 0x7fc0a81a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0aec00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81110a0 con 0x7fc0a8105750 2024-05-03T22:14:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0aec00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8110f20 con 0x7fc0a81072f0 2024-05-03T22:14:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0aec00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8111220 con 0x7fc0a8106950 2024-05-03T22:14:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0a7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8105750 0x7fc0a819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0a7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8105750 0x7fc0a819b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48420/0 (socket says 172.21.15.82:48420) 2024-05-03T22:14:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0a7e00700 1 -- 172.21.15.82:0/3038674912 learned_addr learned my addr 172.21.15.82:0/3038674912 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0a7400700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8106950 0x7fc0a819bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0acc00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0a81072f0 0x7fc0a81a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0a7e00700 1 -- 172.21.15.82:0/3038674912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8106950 msgr2=0x7fc0a819bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0a7e00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8106950 0x7fc0a819bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0a7e00700 1 -- 172.21.15.82:0/3038674912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0a81072f0 msgr2=0x7fc0a81a2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0a7e00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0a81072f0 0x7fc0a81a2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0a7e00700 1 -- 172.21.15.82:0/3038674912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a81a32c0 con 0x7fc0a8105750 2024-05-03T22:14:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.032+0000 7fc0acc00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0a81072f0 0x7fc0a81a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:14:54.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.033+0000 7fc0a7e00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8105750 0x7fc0a819b660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc09800d9b0 tx=0x7fc09800dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:54.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.033+0000 7fc0a4c00700 1 -- 172.21.15.82:0/3038674912 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098017030 con 0x7fc0a8105750 2024-05-03T22:14:54.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.033+0000 7fc0a4c00700 1 -- 172.21.15.82:0/3038674912 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0980044b0 con 0x7fc0a8105750 2024-05-03T22:14:54.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.033+0000 7fc0a4c00700 1 -- 172.21.15.82:0/3038674912 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0980038e0 con 0x7fc0a8105750 2024-05-03T22:14:54.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.033+0000 7fc0aec00700 1 -- 172.21.15.82:0/3038674912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a81a35b0 con 0x7fc0a8105750 2024-05-03T22:14:54.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.033+0000 7fc0aec00700 1 -- 172.21.15.82:0/3038674912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a81a3b40 con 0x7fc0a8105750 2024-05-03T22:14:54.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.034+0000 7fc0aec00700 1 -- 172.21.15.82:0/3038674912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a80519e0 con 0x7fc0a8105750 2024-05-03T22:14:54.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.037+0000 7fc0a4c00700 1 -- 172.21.15.82:0/3038674912 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc09801a070 con 0x7fc0a8105750 2024-05-03T22:14:54.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.038+0000 7fc0a4c00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc08c0b2a30 0x7fc08c0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:54.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.038+0000 7fc0a4c00700 1 -- 172.21.15.82:0/3038674912 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fc0980e2440 con 0x7fc0a8105750 2024-05-03T22:14:54.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.039+0000 7fc0a7400700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc08c0b2a30 0x7fc08c0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:54.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.039+0000 7fc0a7400700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc08c0b2a30 0x7fc08c0b4ef0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc094000c00 tx=0x7fc09401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:54.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.041+0000 7fc0a4c00700 1 -- 172.21.15.82:0/3038674912 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc0980a9cc0 con 0x7fc0a8105750 2024-05-03T22:14:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.374+0000 7fc0aec00700 1 -- 172.21.15.82:0/3038674912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc0a802e510 con 0x7fc0a8105750 2024-05-03T22:14:54.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.381+0000 7fc0a4c00700 1 -- 172.21.15.82:0/3038674912 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v34) ==== 170+0+59 (secure 0 0 0) 0x7fc0980a95c0 con 0x7fc0a8105750 2024-05-03T22:14:54.383 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-05-03T22:14:54.383 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDeYTVmXv9wFhAAhI0/e7dmgbm2OzpXx+Eb+w== 2024-05-03T22:14:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.385+0000 7fc0aec00700 1 -- 172.21.15.82:0/3038674912 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc08c0b2a30 msgr2=0x7fc08c0b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.385+0000 7fc0aec00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc08c0b2a30 0x7fc08c0b4ef0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc094000c00 tx=0x7fc09401a040 comp rx=0 tx=0).stop 2024-05-03T22:14:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.385+0000 7fc0aec00700 1 -- 172.21.15.82:0/3038674912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8105750 msgr2=0x7fc0a819b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.385+0000 7fc0aec00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8105750 0x7fc0a819b660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc09800d9b0 tx=0x7fc09800dd70 comp rx=0 tx=0).stop 2024-05-03T22:14:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.385+0000 7fc0aec00700 1 -- 172.21.15.82:0/3038674912 shutdown_connections 2024-05-03T22:14:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.385+0000 7fc0aec00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc08c0b2a30 0x7fc08c0b4ef0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.385+0000 7fc0aec00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8105750 0x7fc0a819b660 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.385+0000 7fc0aec00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0a81072f0 0x7fc0a81a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.385+0000 7fc0aec00700 1 --2- 172.21.15.82:0/3038674912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0a8106950 0x7fc0a819bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.385+0000 7fc0aec00700 1 -- 172.21.15.82:0/3038674912 >> 172.21.15.82:0/3038674912 conn(0x7fc0a8100cf0 msgr2=0x7fc0a8109c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.386+0000 7fc0aec00700 1 -- 172.21.15.82:0/3038674912 shutdown_connections 2024-05-03T22:14:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:54.386+0000 7fc0aec00700 1 -- 172.21.15.82:0/3038674912 wait complete. 2024-05-03T22:14:54.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:54 smithi116 ceph-mon[31828]: pgmap v450: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:14:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:54 smithi082 ceph-mon[28404]: pgmap v450: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:14:54.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:54 smithi130 ceph-mon[32417]: pgmap v450: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:14:55.482 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:14:55.483 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-03T22:14:55.483 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-03T22:14:55.623 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-03T22:14:55.623 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-03T22:14:55.623 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-03T22:14:55.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:55 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3038674912' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-03T22:14:55.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:55 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3038674912' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-03T22:14:55.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:55 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3038674912' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-03T22:14:55.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:55 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3038674912' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-03T22:14:55.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:55 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3038674912' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-03T22:14:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:55 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3038674912' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-03T22:14:56.112 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:14:56.514 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:56 smithi082 ceph-mon[28404]: pgmap v451: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:14:56.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:56 smithi130 ceph-mon[32417]: pgmap v451: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:14:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:56 smithi116 ceph-mon[31828]: pgmap v451: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:14:57.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:57 smithi116 ceph-mon[31828]: pgmap v452: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:14:57.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:57 smithi082 ceph-mon[28404]: pgmap v452: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:14:57.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:57 smithi130 ceph-mon[32417]: pgmap v452: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:14:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.644+0000 7f823f800700 1 -- 172.21.15.82:0/1137983138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8238075ff0 msgr2=0x7f823810f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.644+0000 7f823f800700 1 --2- 172.21.15.82:0/1137983138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8238075ff0 0x7f823810f960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8224009990 tx=0x7f8224009ca0 comp rx=0 tx=0).stop 2024-05-03T22:14:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.645+0000 7f823f800700 1 -- 172.21.15.82:0/1137983138 shutdown_connections 2024-05-03T22:14:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.645+0000 7f823f800700 1 --2- 172.21.15.82:0/1137983138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f823810fea0 0x7f8238112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.645+0000 7f823f800700 1 --2- 172.21.15.82:0/1137983138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82380756d0 0x7f8238075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.645+0000 7f823f800700 1 --2- 172.21.15.82:0/1137983138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8238075ff0 0x7f823810f960 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.645+0000 7f823f800700 1 -- 172.21.15.82:0/1137983138 >> 172.21.15.82:0/1137983138 conn(0x7f823807a600 msgr2=0x7f823807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.645+0000 7f823f800700 1 -- 172.21.15.82:0/1137983138 shutdown_connections 2024-05-03T22:14:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.645+0000 7f823f800700 1 -- 172.21.15.82:0/1137983138 wait complete. 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.646+0000 7f823f800700 1 Processor -- start 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.646+0000 7f823f800700 1 -- start start 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.646+0000 7f823f800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82380756d0 0x7f82381a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.646+0000 7f823f800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8238075ff0 0x7f82381a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.646+0000 7f823f800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f823810fea0 0x7f823819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.646+0000 7f823f800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8238115760 con 0x7f8238075ff0 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.646+0000 7f823f800700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f82381155e0 con 0x7f823810fea0 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.646+0000 7f823f800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82381158e0 con 0x7f82380756d0 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.647+0000 7f8237e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8238075ff0 0x7f82381a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.647+0000 7f8237e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8238075ff0 0x7f82381a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48438/0 (socket says 172.21.15.82:48438) 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.647+0000 7f8237e00700 1 -- 172.21.15.82:0/2426214828 learned_addr learned my addr 172.21.15.82:0/2426214828 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:14:58.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.647+0000 7f823d800700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f823810fea0 0x7f823819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.647+0000 7f823ce00700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82380756d0 0x7f82381a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.647+0000 7f8237e00700 1 -- 172.21.15.82:0/2426214828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82380756d0 msgr2=0x7f82381a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.647+0000 7f8237e00700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82380756d0 0x7f82381a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.647+0000 7f8237e00700 1 -- 172.21.15.82:0/2426214828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f823810fea0 msgr2=0x7f823819ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.647+0000 7f8237e00700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f823810fea0 0x7f823819ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:58.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.647+0000 7f8237e00700 1 -- 172.21.15.82:0/2426214828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823819c1c0 con 0x7f8238075ff0 2024-05-03T22:14:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.648+0000 7f8237e00700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8238075ff0 0x7f82381a1de0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8224000c00 tx=0x7f8224005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.648+0000 7f8235600700 1 -- 172.21.15.82:0/2426214828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224027070 con 0x7f8238075ff0 2024-05-03T22:14:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.648+0000 7f8235600700 1 -- 172.21.15.82:0/2426214828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f822400fb80 con 0x7f8238075ff0 2024-05-03T22:14:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.648+0000 7f8235600700 1 -- 172.21.15.82:0/2426214828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224022c00 con 0x7f8238075ff0 2024-05-03T22:14:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.648+0000 7f823f800700 1 -- 172.21.15.82:0/2426214828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823819c450 con 0x7f8238075ff0 2024-05-03T22:14:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.648+0000 7f823f800700 1 -- 172.21.15.82:0/2426214828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82381a8770 con 0x7f8238075ff0 2024-05-03T22:14:58.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.649+0000 7f823f800700 1 -- 172.21.15.82:0/2426214828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f823806a190 con 0x7f8238075ff0 2024-05-03T22:14:58.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.651+0000 7f8235600700 1 -- 172.21.15.82:0/2426214828 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f822402a070 con 0x7f8238075ff0 2024-05-03T22:14:58.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.653+0000 7f8235600700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f82200b2910 0x7f82200b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:14:58.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.653+0000 7f8235600700 1 -- 172.21.15.82:0/2426214828 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f82240e3710 con 0x7f8238075ff0 2024-05-03T22:14:58.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.653+0000 7f823ce00700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f82200b2910 0x7f82200b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:14:58.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.654+0000 7f823ce00700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f82200b2910 0x7f82200b4dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f823819cba0 tx=0x7f822c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:14:58.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.657+0000 7f8235600700 1 -- 172.21.15.82:0/2426214828 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8224013070 con 0x7f8238075ff0 2024-05-03T22:14:58.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.956+0000 7f823f800700 1 -- 172.21.15.82:0/2426214828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f823802e510 con 0x7f8238075ff0 2024-05-03T22:14:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.974+0000 7f8235600700 1 -- 172.21.15.82:0/2426214828 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288646 (secure 0 0 0) 0x7f82240aaf40 con 0x7f8238075ff0 2024-05-03T22:14:58.981 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:14:58.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 -- 172.21.15.82:0/2426214828 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f82200b2910 msgr2=0x7f82200b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:58.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f82200b2910 0x7f82200b4dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f823819cba0 tx=0x7f822c009040 comp rx=0 tx=0).stop 2024-05-03T22:14:58.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 -- 172.21.15.82:0/2426214828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8238075ff0 msgr2=0x7f82381a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:14:58.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8238075ff0 0x7f82381a1de0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8224000c00 tx=0x7f8224005ef0 comp rx=0 tx=0).stop 2024-05-03T22:14:58.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 -- 172.21.15.82:0/2426214828 shutdown_connections 2024-05-03T22:14:58.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f82200b2910 0x7f82200b4dd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:58.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f823810fea0 0x7f823819ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:58.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82380756d0 0x7f82381a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:58.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 --2- 172.21.15.82:0/2426214828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8238075ff0 0x7f82381a1de0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:14:58.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 -- 172.21.15.82:0/2426214828 >> 172.21.15.82:0/2426214828 conn(0x7f823807a600 msgr2=0x7f82381006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:14:58.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 -- 172.21.15.82:0/2426214828 shutdown_connections 2024-05-03T22:14:58.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:14:58.980+0000 7f823f800700 1 -- 172.21.15.82:0/2426214828 wait complete. 2024-05-03T22:14:59.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:59 smithi082 ceph-mon[28404]: pgmap v453: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:14:59.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:14:59 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2426214828' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-03T22:15:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:59 smithi130 ceph-mon[32417]: pgmap v453: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:15:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:14:59 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2426214828' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-03T22:15:00.028 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3338115086},{"type":"v1","addr":"172.21.15.82:6801","nonce":3338115086}]},"active_addr":"172.21.15.82:6801/3338115086","active_change":"2024-05-03T22:02:36.416826+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34109,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.82:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":4029246176}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1421988440}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3516363289}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":663615015}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2469441919}]}]} 2024-05-03T22:15:00.034 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-03T22:15:00.034 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-03T22:15:00.034 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:15:00.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:59 smithi116 ceph-mon[31828]: pgmap v453: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:15:00.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:14:59 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2426214828' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-03T22:15:00.481 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:01 smithi082 ceph-mon[28404]: pgmap v454: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:15:02.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:01 smithi130 ceph-mon[32417]: pgmap v454: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:15:02.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:01 smithi116 ceph-mon[31828]: pgmap v454: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:15:02.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.924+0000 7f44e4e00700 1 -- 172.21.15.82:0/3263856956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e010b680 msgr2=0x7f44e010ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:02.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.924+0000 7f44e4e00700 1 --2- 172.21.15.82:0/3263856956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e010b680 0x7f44e010ba60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f44d00099c0 tx=0x7f44d0009cd0 comp rx=0 tx=0).stop 2024-05-03T22:15:02.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.924+0000 7f44e4e00700 1 -- 172.21.15.82:0/3263856956 shutdown_connections 2024-05-03T22:15:02.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.924+0000 7f44e4e00700 1 --2- 172.21.15.82:0/3263856956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e010b680 0x7f44e010ba60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:02.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.924+0000 7f44e4e00700 1 --2- 172.21.15.82:0/3263856956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44e0105f90 0x7f44e0112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:02.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.924+0000 7f44e4e00700 1 --2- 172.21.15.82:0/3263856956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e01055d0 0x7f44e0105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:02.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.924+0000 7f44e4e00700 1 -- 172.21.15.82:0/3263856956 >> 172.21.15.82:0/3263856956 conn(0x7f44e01010e0 msgr2=0x7f44e0103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:02.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.924+0000 7f44e4e00700 1 -- 172.21.15.82:0/3263856956 shutdown_connections 2024-05-03T22:15:02.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.924+0000 7f44e4e00700 1 -- 172.21.15.82:0/3263856956 wait complete. 2024-05-03T22:15:02.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.926+0000 7f44e4e00700 1 Processor -- start 2024-05-03T22:15:02.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.926+0000 7f44e4e00700 1 -- start start 2024-05-03T22:15:02.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.926+0000 7f44e4e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e01055d0 0x7f44e01a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:02.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.926+0000 7f44e4e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0105f90 0x7f44e01a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:02.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.926+0000 7f44e4e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44e010b680 0x7f44e019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:02.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.926+0000 7f44e4e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f44e01156a0 con 0x7f44e0105f90 2024-05-03T22:15:02.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.926+0000 7f44e4e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0115520 con 0x7f44e010b680 2024-05-03T22:15:02.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.926+0000 7f44e4e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0115820 con 0x7f44e01055d0 2024-05-03T22:15:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.927+0000 7f44dea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0105f90 0x7f44e01a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.927+0000 7f44dea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0105f90 0x7f44e01a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48448/0 (socket says 172.21.15.82:48448) 2024-05-03T22:15:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.927+0000 7f44dea00700 1 -- 172.21.15.82:0/1652738903 learned_addr learned my addr 172.21.15.82:0/1652738903 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.927+0000 7f44dfe00700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44e010b680 0x7f44e019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.927+0000 7f44df400700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e01055d0 0x7f44e01a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.927+0000 7f44dea00700 1 -- 172.21.15.82:0/1652738903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e01055d0 msgr2=0x7f44e01a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.927+0000 7f44dea00700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e01055d0 0x7f44e01a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.927+0000 7f44dea00700 1 -- 172.21.15.82:0/1652738903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44e010b680 msgr2=0x7f44e019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.927+0000 7f44dea00700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44e010b680 0x7f44e019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.927+0000 7f44dea00700 1 -- 172.21.15.82:0/1652738903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e019c080 con 0x7f44e0105f90 2024-05-03T22:15:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.927+0000 7f44df400700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e01055d0 0x7f44e01a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:15:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.928+0000 7f44dea00700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0105f90 0x7f44e01a1c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00d980 tx=0x7f44cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.928+0000 7f44d7e00700 1 -- 172.21.15.82:0/1652738903 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc017070 con 0x7f44e0105f90 2024-05-03T22:15:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.928+0000 7f44d7e00700 1 -- 172.21.15.82:0/1652738903 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44cc005020 con 0x7f44e0105f90 2024-05-03T22:15:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.928+0000 7f44e4e00700 1 -- 172.21.15.82:0/1652738903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e019c370 con 0x7f44e0105f90 2024-05-03T22:15:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.928+0000 7f44d7e00700 1 -- 172.21.15.82:0/1652738903 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc009ab0 con 0x7f44e0105f90 2024-05-03T22:15:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.928+0000 7f44e4e00700 1 -- 172.21.15.82:0/1652738903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e01a85e0 con 0x7f44e0105f90 2024-05-03T22:15:02.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.930+0000 7f44e4e00700 1 -- 172.21.15.82:0/1652738903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e006a190 con 0x7f44e0105f90 2024-05-03T22:15:02.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.933+0000 7f44d7e00700 1 -- 172.21.15.82:0/1652738903 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f44cc0051d0 con 0x7f44e0105f90 2024-05-03T22:15:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.934+0000 7f44d7e00700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f44c40b2990 0x7f44c40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.934+0000 7f44d7e00700 1 -- 172.21.15.82:0/1652738903 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f44cc0e2a90 con 0x7f44e0105f90 2024-05-03T22:15:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.934+0000 7f44df400700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f44c40b2990 0x7f44c40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.935+0000 7f44df400700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f44c40b2990 0x7f44c40b4e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f44e010a700 tx=0x7f44d001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:02.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:02.936+0000 7f44d7e00700 1 -- 172.21.15.82:0/1652738903 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f44cc020020 con 0x7f44e0105f90 2024-05-03T22:15:03.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.174+0000 7f44e4e00700 1 -- 172.21.15.82:0/1652738903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44e002e510 con 0x7f44e0105f90 2024-05-03T22:15:03.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.176+0000 7f44d7e00700 1 -- 172.21.15.82:0/1652738903 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24803 (secure 0 0 0) 0x7f44cc0aa2b0 con 0x7f44e0105f90 2024-05-03T22:15:03.179 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:15:03.179 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:14:38.277415+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:12:30.512363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:12:34.936483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:12:50.095758+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:15:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.180+0000 7f44e4e00700 1 -- 172.21.15.82:0/1652738903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f44c40b2990 msgr2=0x7f44c40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.180+0000 7f44e4e00700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f44c40b2990 0x7f44c40b4e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f44e010a700 tx=0x7f44d001a040 comp rx=0 tx=0).stop 2024-05-03T22:15:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.180+0000 7f44e4e00700 1 -- 172.21.15.82:0/1652738903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0105f90 msgr2=0x7f44e01a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.180+0000 7f44e4e00700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0105f90 0x7f44e01a1c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00d980 tx=0x7f44cc00dc90 comp rx=0 tx=0).stop 2024-05-03T22:15:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.180+0000 7f44e4e00700 1 -- 172.21.15.82:0/1652738903 shutdown_connections 2024-05-03T22:15:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.180+0000 7f44e4e00700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f44c40b2990 0x7f44c40b4e50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.180+0000 7f44e4e00700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44e010b680 0x7f44e019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.180+0000 7f44e4e00700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44e01055d0 0x7f44e01a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.180+0000 7f44e4e00700 1 --2- 172.21.15.82:0/1652738903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0105f90 0x7f44e01a1c50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.180+0000 7f44e4e00700 1 -- 172.21.15.82:0/1652738903 >> 172.21.15.82:0/1652738903 conn(0x7f44e01010e0 msgr2=0x7f44e01027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.181+0000 7f44e4e00700 1 -- 172.21.15.82:0/1652738903 shutdown_connections 2024-05-03T22:15:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:03.181+0000 7f44e4e00700 1 -- 172.21.15.82:0/1652738903 wait complete. 2024-05-03T22:15:03.908 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:03 smithi082 ceph-mon[28404]: pgmap v455: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:15:03.908 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:03 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1652738903' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:15:03.987 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:03 smithi116 ceph-mon[31828]: pgmap v455: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:15:03.987 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:03 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1652738903' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:15:04.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:03 smithi130 ceph-mon[32417]: pgmap v455: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:15:04.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:03 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1652738903' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:15:04.181 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-03T22:15:04.182 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:15:04.660 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:05.942 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:05 smithi116 ceph-mon[31828]: pgmap v456: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:15:06.035 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:05 smithi130 ceph-mon[32417]: pgmap v456: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:15:06.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:05 smithi082 ceph-mon[28404]: pgmap v456: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:15:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.088+0000 7f4b48400700 1 -- 172.21.15.82:0/1445401426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b400756d0 msgr2=0x7f4b40075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.088+0000 7f4b48400700 1 --2- 172.21.15.82:0/1445401426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b400756d0 0x7f4b40075ab0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009990 tx=0x7f4b34009ca0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.089+0000 7f4b48400700 1 -- 172.21.15.82:0/1445401426 shutdown_connections 2024-05-03T22:15:07.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.089+0000 7f4b48400700 1 --2- 172.21.15.82:0/1445401426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b400756d0 0x7f4b40075ab0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.089+0000 7f4b48400700 1 --2- 172.21.15.82:0/1445401426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b40114670 0x7f4b40116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.089+0000 7f4b48400700 1 --2- 172.21.15.82:0/1445401426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b40075ff0 0x7f4b40114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.089+0000 7f4b48400700 1 -- 172.21.15.82:0/1445401426 >> 172.21.15.82:0/1445401426 conn(0x7f4b4007a600 msgr2=0x7f4b4007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:07.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.089+0000 7f4b48400700 1 -- 172.21.15.82:0/1445401426 shutdown_connections 2024-05-03T22:15:07.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.089+0000 7f4b48400700 1 -- 172.21.15.82:0/1445401426 wait complete. 2024-05-03T22:15:07.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.090+0000 7f4b48400700 1 Processor -- start 2024-05-03T22:15:07.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.090+0000 7f4b48400700 1 -- start start 2024-05-03T22:15:07.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.090+0000 7f4b48400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b400756d0 0x7f4b401a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:07.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.090+0000 7f4b48400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b40075ff0 0x7f4b401a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:07.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.090+0000 7f4b48400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b40114670 0x7f4b401a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:07.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.090+0000 7f4b48400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4b40119b50 con 0x7f4b40114670 2024-05-03T22:15:07.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.090+0000 7f4b48400700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401199d0 con 0x7f4b40075ff0 2024-05-03T22:15:07.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.090+0000 7f4b48400700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4b40119cd0 con 0x7f4b400756d0 2024-05-03T22:15:07.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.091+0000 7f4b46400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b40114670 0x7f4b401a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.091+0000 7f4b46400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b40114670 0x7f4b401a4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37792/0 (socket says 172.21.15.82:37792) 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.091+0000 7f4b46400700 1 -- 172.21.15.82:0/3517228731 learned_addr learned my addr 172.21.15.82:0/3517228731 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.091+0000 7f4b45a00700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b400756d0 0x7f4b401a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.091+0000 7f4b45000700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b40075ff0 0x7f4b401a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.091+0000 7f4b46400700 1 -- 172.21.15.82:0/3517228731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b400756d0 msgr2=0x7f4b401a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.091+0000 7f4b46400700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b400756d0 0x7f4b401a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.091+0000 7f4b46400700 1 -- 172.21.15.82:0/3517228731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b40075ff0 msgr2=0x7f4b401a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.091+0000 7f4b46400700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b40075ff0 0x7f4b401a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.091+0000 7f4b46400700 1 -- 172.21.15.82:0/3517228731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b401a50d0 con 0x7f4b40114670 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.092+0000 7f4b46400700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b40114670 0x7f4b401a4990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b380094f0 tx=0x7f4b3800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.092+0000 7f4b3e000700 1 -- 172.21.15.82:0/3517228731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38004db0 con 0x7f4b40114670 2024-05-03T22:15:07.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.092+0000 7f4b3e000700 1 -- 172.21.15.82:0/3517228731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b38009e20 con 0x7f4b40114670 2024-05-03T22:15:07.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.092+0000 7f4b3e000700 1 -- 172.21.15.82:0/3517228731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38015400 con 0x7f4b40114670 2024-05-03T22:15:07.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.092+0000 7f4b48400700 1 -- 172.21.15.82:0/3517228731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b401a53c0 con 0x7f4b40114670 2024-05-03T22:15:07.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.092+0000 7f4b48400700 1 -- 172.21.15.82:0/3517228731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b401acc40 con 0x7f4b40114670 2024-05-03T22:15:07.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.093+0000 7f4b48400700 1 -- 172.21.15.82:0/3517228731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b4006a190 con 0x7f4b40114670 2024-05-03T22:15:07.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.096+0000 7f4b3e000700 1 -- 172.21.15.82:0/3517228731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f4b38005260 con 0x7f4b40114670 2024-05-03T22:15:07.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.097+0000 7f4b3e000700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4b280b2990 0x7f4b280b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:07.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.098+0000 7f4b3e000700 1 -- 172.21.15.82:0/3517228731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f4b380e28d0 con 0x7f4b40114670 2024-05-03T22:15:07.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.098+0000 7f4b45a00700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4b280b2990 0x7f4b280b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:07.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.098+0000 7f4b45a00700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4b280b2990 0x7f4b280b4e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400b2e0 tx=0x7f4b34005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:07.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.100+0000 7f4b3e000700 1 -- 172.21.15.82:0/3517228731 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4b38010070 con 0x7f4b40114670 2024-05-03T22:15:07.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.332+0000 7f4b48400700 1 -- 172.21.15.82:0/3517228731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b401a1420 con 0x7f4b40114670 2024-05-03T22:15:07.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.336+0000 7f4b3e000700 1 -- 172.21.15.82:0/3517228731 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24803 (secure 0 0 0) 0x7f4b401a1420 con 0x7f4b40114670 2024-05-03T22:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:14:38.277415+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:12:30.512363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:12:34.936483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:12:50.095758+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:15:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.339+0000 7f4b48400700 1 -- 172.21.15.82:0/3517228731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4b280b2990 msgr2=0x7f4b280b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.339+0000 7f4b48400700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4b280b2990 0x7f4b280b4e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400b2e0 tx=0x7f4b34005fb0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.339+0000 7f4b48400700 1 -- 172.21.15.82:0/3517228731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b40114670 msgr2=0x7f4b401a4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.339+0000 7f4b48400700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b40114670 0x7f4b401a4990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b380094f0 tx=0x7f4b3800d3b0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.340+0000 7f4b48400700 1 -- 172.21.15.82:0/3517228731 shutdown_connections 2024-05-03T22:15:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.340+0000 7f4b48400700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4b280b2990 0x7f4b280b4e50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.340+0000 7f4b48400700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b40114670 0x7f4b401a4990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.340+0000 7f4b48400700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b400756d0 0x7f4b401a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.340+0000 7f4b48400700 1 --2- 172.21.15.82:0/3517228731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b40075ff0 0x7f4b401a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.340+0000 7f4b48400700 1 -- 172.21.15.82:0/3517228731 >> 172.21.15.82:0/3517228731 conn(0x7f4b4007a600 msgr2=0x7f4b40110170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:07.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.340+0000 7f4b48400700 1 -- 172.21.15.82:0/3517228731 shutdown_connections 2024-05-03T22:15:07.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:07.340+0000 7f4b48400700 1 -- 172.21.15.82:0/3517228731 wait complete. 2024-05-03T22:15:08.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:07 smithi130 ceph-mon[32417]: pgmap v457: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:15:08.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:07 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3517228731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:15:08.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:07 smithi116 ceph-mon[31828]: pgmap v457: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:15:08.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:07 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3517228731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:15:08.218 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:07 smithi082 ceph-mon[28404]: pgmap v457: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:15:08.218 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:07 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3517228731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:15:08.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-03T22:15:08.273 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-03T22:15:08.273 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-03T22:15:08.274 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-03T22:15:08.274 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-03T22:15:08.274 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-03T22:15:08.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-03T22:15:08.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-03T22:15:08.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-03T22:15:08.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-03T22:15:08.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-03T22:15:08.277 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-03T22:15:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.381 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.406 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.409 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.425 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.482 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:09.859 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:09 smithi082 ceph-mon[28404]: pgmap v458: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-03T22:15:10.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:09 smithi130 ceph-mon[32417]: pgmap v458: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-03T22:15:10.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:09 smithi116 ceph-mon[31828]: pgmap v458: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-03T22:15:11.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:11 smithi082 ceph-mon[28404]: pgmap v459: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:15:12.026 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:11 smithi130 ceph-mon[32417]: pgmap v459: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:15:12.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:11 smithi116 ceph-mon[31828]: pgmap v459: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:15:14.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:13 smithi082 ceph-mon[28404]: pgmap v460: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:15:14.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:13 smithi130 ceph-mon[32417]: pgmap v460: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:15:14.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:13 smithi116 ceph-mon[31828]: pgmap v460: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:15:16.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:15 smithi082 ceph-mon[28404]: pgmap v461: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:15:16.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:15 smithi130 ceph-mon[32417]: pgmap v461: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:15:16.036 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:15 smithi116 ceph-mon[31828]: pgmap v461: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:15:18.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:17 smithi116 ceph-mon[31828]: pgmap v462: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:15:18.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:17 smithi082 ceph-mon[28404]: pgmap v462: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:15:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:17 smithi130 ceph-mon[32417]: pgmap v462: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:15:19.844 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:19 smithi082 ceph-mon[28404]: pgmap v463: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:15:20.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:19 smithi116 ceph-mon[31828]: pgmap v463: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:15:20.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:19 smithi130 ceph-mon[32417]: pgmap v463: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:15:22.113 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:21 smithi082 ceph-mon[28404]: pgmap v464: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:15:22.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:21 smithi116 ceph-mon[31828]: pgmap v464: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:15:22.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:21 smithi130 ceph-mon[32417]: pgmap v464: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:15:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.108+0000 7fb65e200700 1 -- 172.21.15.82:0/3577134426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb658109ad0 msgr2=0x7fb658109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.108+0000 7fb65e200700 1 --2- 172.21.15.82:0/3577134426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb658109ad0 0x7fb658109f50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb640009990 tx=0x7fb640009ca0 comp rx=0 tx=0).stop 2024-05-03T22:15:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.108+0000 7fb65e200700 1 -- 172.21.15.82:0/3577134426 shutdown_connections 2024-05-03T22:15:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.108+0000 7fb65e200700 1 --2- 172.21.15.82:0/3577134426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65810a490 0x7fb6581169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.108+0000 7fb65e200700 1 --2- 172.21.15.82:0/3577134426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65810fb60 0x7fb65810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.108+0000 7fb65e200700 1 --2- 172.21.15.82:0/3577134426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb658109ad0 0x7fb658109f50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.108+0000 7fb65e200700 1 -- 172.21.15.82:0/3577134426 >> 172.21.15.82:0/3577134426 conn(0x7fb658076c70 msgr2=0x7fb6581082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.108+0000 7fb65e200700 1 -- 172.21.15.82:0/3577134426 shutdown_connections 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.108+0000 7fb65e200700 1 -- 172.21.15.82:0/3577134426 wait complete. 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.110+0000 7fb65e200700 1 Processor -- start 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.110+0000 7fb65e200700 1 -- start start 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.111+0000 7fb65e200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb658109ad0 0x7fb6581a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.111+0000 7fb65e200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65810a490 0x7fb6581a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.111+0000 7fb65e200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65810fb60 0x7fb6581a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.111+0000 7fb65e200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb658119c70 con 0x7fb658109ad0 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.111+0000 7fb65e200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb658119af0 con 0x7fb65810fb60 2024-05-03T22:15:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.111+0000 7fb65e200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb658119df0 con 0x7fb65810a490 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.111+0000 7fb657400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb658109ad0 0x7fb6581a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.111+0000 7fb657400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb658109ad0 0x7fb6581a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40598/0 (socket says 172.21.15.82:40598) 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.111+0000 7fb657400700 1 -- 172.21.15.82:0/1004399315 learned_addr learned my addr 172.21.15.82:0/1004399315 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.112+0000 7fb64ea00700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65810a490 0x7fb6581a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.112+0000 7fb657e00700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65810fb60 0x7fb6581a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.112+0000 7fb657400700 1 -- 172.21.15.82:0/1004399315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65810a490 msgr2=0x7fb6581a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.112+0000 7fb657400700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb65810a490 0x7fb6581a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.112+0000 7fb657400700 1 -- 172.21.15.82:0/1004399315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65810fb60 msgr2=0x7fb6581a4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.112+0000 7fb657400700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65810fb60 0x7fb6581a4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.112+0000 7fb657400700 1 -- 172.21.15.82:0/1004399315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6581a5240 con 0x7fb658109ad0 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.112+0000 7fb657e00700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65810fb60 0x7fb6581a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.112+0000 7fb657400700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb658109ad0 0x7fb6581a0230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb64800b530 tx=0x7fb64800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.113+0000 7fb654c00700 1 -- 172.21.15.82:0/1004399315 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648015020 con 0x7fb658109ad0 2024-05-03T22:15:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.113+0000 7fb654c00700 1 -- 172.21.15.82:0/1004399315 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb648011cc0 con 0x7fb658109ad0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.113+0000 7fb65e200700 1 -- 172.21.15.82:0/1004399315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6581a5530 con 0x7fb658109ad0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.113+0000 7fb654c00700 1 -- 172.21.15.82:0/1004399315 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648010dc0 con 0x7fb658109ad0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.113+0000 7fb65e200700 1 -- 172.21.15.82:0/1004399315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6581acdb0 con 0x7fb658109ad0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.114+0000 7fb65e200700 1 -- 172.21.15.82:0/1004399315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb658063c30 con 0x7fb658109ad0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.116+0000 7fb654c00700 1 -- 172.21.15.82:0/1004399315 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb648018020 con 0x7fb658109ad0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.118+0000 7fb654c00700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb63c0b2910 0x7fb63c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.118+0000 7fb654c00700 1 -- 172.21.15.82:0/1004399315 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fb6480e1f20 con 0x7fb658109ad0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.118+0000 7fb64ea00700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb63c0b2910 0x7fb63c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.118+0000 7fb654c00700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365] conn(0x7fb63c0bdc10 0x7fb63c0c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.118+0000 7fb654c00700 1 -- 172.21.15.82:0/1004399315 --> [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb63c0c0760 con 0x7fb63c0bdc10 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.118+0000 7fb654c00700 1 -- 172.21.15.82:0/1004399315 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fb6480e4540 con 0x7fb658109ad0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.119+0000 7fb64ea00700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb63c0b2910 0x7fb63c0b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb640003760 tx=0x7fb64000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.119+0000 7fb657e00700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365] conn(0x7fb63c0bdc10 0x7fb63c0c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.120+0000 7fb657e00700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365] conn(0x7fb63c0bdc10 0x7fb63c0c0090 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.123+0000 7fb654c00700 1 -- 172.21.15.82:0/1004399315 <== osd.2 v2:172.21.15.130:6800/2477946365 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb63c0c0760 con 0x7fb63c0bdc10 2024-05-03T22:15:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.141+0000 7fb65e200700 1 -- 172.21.15.82:0/1004399315 --> [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb658064030 con 0x7fb63c0bdc10 2024-05-03T22:15:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.142+0000 7fb654c00700 1 -- 172.21.15.82:0/1004399315 <== osd.2 v2:172.21.15.130:6800/2477946365 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb658064030 con 0x7fb63c0bdc10 2024-05-03T22:15:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.143+0000 7fb65e200700 1 -- 172.21.15.82:0/1004399315 >> [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365] conn(0x7fb63c0bdc10 msgr2=0x7fb63c0c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.143+0000 7fb65e200700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365] conn(0x7fb63c0bdc10 0x7fb63c0c0090 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.143+0000 7fb65e200700 1 -- 172.21.15.82:0/1004399315 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb63c0b2910 msgr2=0x7fb63c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.143+0000 7fb65e200700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb63c0b2910 0x7fb63c0b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb640003760 tx=0x7fb64000b540 comp rx=0 tx=0).stop 2024-05-03T22:15:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.143+0000 7fb65e200700 1 -- 172.21.15.82:0/1004399315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb658109ad0 msgr2=0x7fb6581a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.143+0000 7fb65e200700 1 --2- 172.21.15.82:0/1004399315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb658109ad0 0x7fb6581a0230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb64800b530 tx=0x7fb64800b840 comp rx=0 tx=0).stop 2024-05-03T22:15:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.143+0000 7fb657e00700 1 -- 172.21.15.82:0/1004399315 reap_dead start 2024-05-03T22:15:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.143+0000 7fb65e200700 1 -- 172.21.15.82:0/1004399315 shutdown_connections 2024-05-03T22:15:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.143+0000 7fb65e200700 1 -- 172.21.15.82:0/1004399315 >> 172.21.15.82:0/1004399315 conn(0x7fb658076c70 msgr2=0x7fb658077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.143+0000 7fb65e200700 1 -- 172.21.15.82:0/1004399315 shutdown_connections 2024-05-03T22:15:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:22.143+0000 7fb65e200700 1 -- 172.21.15.82:0/1004399315 wait complete. 2024-05-03T22:15:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:23 smithi082 ceph-mon[28404]: pgmap v465: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:15:24.080 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:23 smithi130 ceph-mon[32417]: pgmap v465: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:15:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.014+0000 7f195b200700 1 -- 172.21.15.82:0/1396045200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195c104f60 msgr2=0x7f195c10d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.014+0000 7f195b200700 1 --2- 172.21.15.82:0/1396045200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195c104f60 0x7f195c10d450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1944009990 tx=0x7f1944009ca0 comp rx=0 tx=0).stop 2024-05-03T22:15:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.014+0000 7f195b200700 1 -- 172.21.15.82:0/1396045200 shutdown_connections 2024-05-03T22:15:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.014+0000 7f195b200700 1 --2- 172.21.15.82:0/1396045200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c10da20 0x7f195c10fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.014+0000 7f195b200700 1 --2- 172.21.15.82:0/1396045200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f195c104640 0x7f195c104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.014+0000 7f195b200700 1 --2- 172.21.15.82:0/1396045200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195c104f60 0x7f195c10d450 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.014+0000 7f195b200700 1 -- 172.21.15.82:0/1396045200 >> 172.21.15.82:0/1396045200 conn(0x7f195c0fde30 msgr2=0x7f195c100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.014+0000 7f195b200700 1 -- 172.21.15.82:0/1396045200 shutdown_connections 2024-05-03T22:15:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.014+0000 7f195b200700 1 -- 172.21.15.82:0/1396045200 wait complete. 2024-05-03T22:15:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.016+0000 7f195b200700 1 Processor -- start 2024-05-03T22:15:24.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.016+0000 7f195b200700 1 -- start start 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.017+0000 7f195b200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c104640 0x7f195c1a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.017+0000 7f195b200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f195c104f60 0x7f195c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.017+0000 7f195b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195c10da20 0x7f195c19bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.017+0000 7f195b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f195c1134e0 con 0x7f195c10da20 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.017+0000 7f195b200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f195c113360 con 0x7f195c104f60 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.017+0000 7f195b200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f195c113660 con 0x7f195c104640 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.017+0000 7f195a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195c10da20 0x7f195c19bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.018+0000 7f1959e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c104640 0x7f195c1a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.018+0000 7f195a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195c10da20 0x7f195c19bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32844/0 (socket says 172.21.15.82:32844) 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.018+0000 7f195a800700 1 -- 172.21.15.82:0/3411871303 learned_addr learned my addr 172.21.15.82:0/3411871303 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.018+0000 7f1959400700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f195c104f60 0x7f195c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.018+0000 7f195a800700 1 -- 172.21.15.82:0/3411871303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c104640 msgr2=0x7f195c1a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.018+0000 7f195a800700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c104640 0x7f195c1a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.018+0000 7f195a800700 1 -- 172.21.15.82:0/3411871303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f195c104f60 msgr2=0x7f195c1a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.018+0000 7f195a800700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f195c104f60 0x7f195c1a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.018+0000 7f195a800700 1 -- 172.21.15.82:0/3411871303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195c19c400 con 0x7f195c10da20 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.018+0000 7f1959400700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f195c104f60 0x7f195c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.019+0000 7f195a800700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195c10da20 0x7f195c19bb20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1954007ee0 tx=0x7f195400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.019+0000 7f1952a00700 1 -- 172.21.15.82:0/3411871303 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195400dbd0 con 0x7f195c10da20 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.019+0000 7f1952a00700 1 -- 172.21.15.82:0/3411871303 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f195400dd70 con 0x7f195c10da20 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.019+0000 7f1952a00700 1 -- 172.21.15.82:0/3411871303 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19540058d0 con 0x7f195c10da20 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.019+0000 7f195b200700 1 -- 172.21.15.82:0/3411871303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195c19c6f0 con 0x7f195c10da20 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.019+0000 7f195b200700 1 -- 172.21.15.82:0/3411871303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f195c1a89d0 con 0x7f195c10da20 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.020+0000 7f195b200700 1 -- 172.21.15.82:0/3411871303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f195c063b30 con 0x7f195c10da20 2024-05-03T22:15:24.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.024+0000 7f1952a00700 1 -- 172.21.15.82:0/3411871303 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f195401a020 con 0x7f195c10da20 2024-05-03T22:15:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.025+0000 7f1952a00700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f19400b2990 0x7f19400b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.025+0000 7f1952a00700 1 -- 172.21.15.82:0/3411871303 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f19540e2570 con 0x7f195c10da20 2024-05-03T22:15:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.025+0000 7f1959e00700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f19400b2990 0x7f19400b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.025+0000 7f1952a00700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667] conn(0x7f19400bdc90 0x7f19400c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.026+0000 7f1952a00700 1 -- 172.21.15.82:0/3411871303 --> [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19400c07e0 con 0x7f19400bdc90 2024-05-03T22:15:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.026+0000 7f1952a00700 1 -- 172.21.15.82:0/3411871303 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f19540e2920 con 0x7f195c10da20 2024-05-03T22:15:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.026+0000 7f1959e00700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f19400b2990 0x7f19400b4e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f194c005950 tx=0x7f194c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.026+0000 7f1959400700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667] conn(0x7f19400bdc90 0x7f19400c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.028+0000 7f1959400700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667] conn(0x7f19400bdc90 0x7f19400c0110 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.032+0000 7f1952a00700 1 -- 172.21.15.82:0/3411871303 <== osd.4 v2:172.21.15.116:6808/3493188667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19400c07e0 con 0x7f19400bdc90 2024-05-03T22:15:24.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.051+0000 7f195b200700 1 -- 172.21.15.82:0/3411871303 --> [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f195c064020 con 0x7f19400bdc90 2024-05-03T22:15:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.052+0000 7f1952a00700 1 -- 172.21.15.82:0/3411871303 <== osd.4 v2:172.21.15.116:6808/3493188667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f195c064020 con 0x7f19400bdc90 2024-05-03T22:15:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.053+0000 7f195b200700 1 -- 172.21.15.82:0/3411871303 >> [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667] conn(0x7f19400bdc90 msgr2=0x7f19400c0110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.053+0000 7f195b200700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667] conn(0x7f19400bdc90 0x7f19400c0110 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.053+0000 7f195b200700 1 -- 172.21.15.82:0/3411871303 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f19400b2990 msgr2=0x7f19400b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.053+0000 7f195b200700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f19400b2990 0x7f19400b4e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f194c005950 tx=0x7f194c00b410 comp rx=0 tx=0).stop 2024-05-03T22:15:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.053+0000 7f195b200700 1 -- 172.21.15.82:0/3411871303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195c10da20 msgr2=0x7f195c19bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:24.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.053+0000 7f195b200700 1 --2- 172.21.15.82:0/3411871303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f195c10da20 0x7f195c19bb20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1954007ee0 tx=0x7f195400d3b0 comp rx=0 tx=0).stop 2024-05-03T22:15:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.053+0000 7f195a800700 1 -- 172.21.15.82:0/3411871303 reap_dead start 2024-05-03T22:15:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.053+0000 7f195b200700 1 -- 172.21.15.82:0/3411871303 shutdown_connections 2024-05-03T22:15:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.053+0000 7f195b200700 1 -- 172.21.15.82:0/3411871303 >> 172.21.15.82:0/3411871303 conn(0x7f195c0fde30 msgr2=0x7f195c100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.053+0000 7f195b200700 1 -- 172.21.15.82:0/3411871303 shutdown_connections 2024-05-03T22:15:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.053+0000 7f195b200700 1 -- 172.21.15.82:0/3411871303 wait complete. 2024-05-03T22:15:24.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:23 smithi116 ceph-mon[31828]: pgmap v465: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:15:25.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.128+0000 7f4264600700 1 -- 172.21.15.82:0/3664736061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c104100 msgr2=0x7f425c108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:25.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.128+0000 7f4264600700 1 --2- 172.21.15.82:0/3664736061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c104100 0x7f425c108120 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f42480099c0 tx=0x7f4248009cd0 comp rx=0 tx=0).stop 2024-05-03T22:15:25.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.128+0000 7f4264600700 1 -- 172.21.15.82:0/3664736061 shutdown_connections 2024-05-03T22:15:25.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.128+0000 7f4264600700 1 --2- 172.21.15.82:0/3664736061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f425c108850 0x7f425c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.128+0000 7f4264600700 1 --2- 172.21.15.82:0/3664736061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f425c103750 0x7f425c103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.128+0000 7f4264600700 1 --2- 172.21.15.82:0/3664736061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c104100 0x7f425c108120 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.128+0000 7f4264600700 1 -- 172.21.15.82:0/3664736061 >> 172.21.15.82:0/3664736061 conn(0x7f425c07a600 msgr2=0x7f425c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.128+0000 7f4264600700 1 -- 172.21.15.82:0/3664736061 shutdown_connections 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.128+0000 7f4264600700 1 -- 172.21.15.82:0/3664736061 wait complete. 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.129+0000 7f4264600700 1 Processor -- start 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.129+0000 7f4264600700 1 -- start start 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.129+0000 7f4264600700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f425c103750 0x7f425c1a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4264600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f425c104100 0x7f425c1a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4264600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c108850 0x7f425c19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4264600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f425c113540 con 0x7f425c108850 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4264600700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f425c1133c0 con 0x7f425c103750 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4264600700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f425c1136c0 con 0x7f425c104100 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4262600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c108850 0x7f425c19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4262600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c108850 0x7f425c19ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32874/0 (socket says 172.21.15.82:32874) 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4262600700 1 -- 172.21.15.82:0/186443177 learned_addr learned my addr 172.21.15.82:0/186443177 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4261c00700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f425c103750 0x7f425c1a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4261200700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f425c104100 0x7f425c1a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4262600700 1 -- 172.21.15.82:0/186443177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f425c104100 msgr2=0x7f425c1a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4262600700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f425c104100 0x7f425c1a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4262600700 1 -- 172.21.15.82:0/186443177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f425c103750 msgr2=0x7f425c1a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4262600700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f425c103750 0x7f425c1a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.130+0000 7f4262600700 1 -- 172.21.15.82:0/186443177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425c19c1c0 con 0x7f425c108850 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.131+0000 7f4262600700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c108850 0x7f425c19ba60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f425400b550 tx=0x7f425400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.131+0000 7f425a000700 1 -- 172.21.15.82:0/186443177 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4254015020 con 0x7f425c108850 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.131+0000 7f425a000700 1 -- 172.21.15.82:0/186443177 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4254011cc0 con 0x7f425c108850 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.131+0000 7f4264600700 1 -- 172.21.15.82:0/186443177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425c19c4b0 con 0x7f425c108850 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.131+0000 7f425a000700 1 -- 172.21.15.82:0/186443177 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4254010c80 con 0x7f425c108850 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.131+0000 7f4264600700 1 -- 172.21.15.82:0/186443177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f425c1a8770 con 0x7f425c108850 2024-05-03T22:15:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.132+0000 7f4264600700 1 -- 172.21.15.82:0/186443177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f425c10fa80 con 0x7f425c108850 2024-05-03T22:15:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.135+0000 7f425a000700 1 -- 172.21.15.82:0/186443177 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f4254018020 con 0x7f425c108850 2024-05-03T22:15:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.136+0000 7f425a000700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f42440b2990 0x7f42440b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.136+0000 7f425a000700 1 -- 172.21.15.82:0/186443177 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f42540e23e0 con 0x7f425c108850 2024-05-03T22:15:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.136+0000 7f4261c00700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f42440b2990 0x7f42440b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.137+0000 7f425a000700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646] conn(0x7f42440bdc90 0x7f42440c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.137+0000 7f425a000700 1 -- 172.21.15.82:0/186443177 --> [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4254018ec0 con 0x7f42440bdc90 2024-05-03T22:15:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.137+0000 7f425a000700 1 -- 172.21.15.82:0/186443177 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f42540e2790 con 0x7f425c108850 2024-05-03T22:15:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.137+0000 7f4261200700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646] conn(0x7f42440bdc90 0x7f42440c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.137+0000 7f4261c00700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f42440b2990 0x7f42440b4e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4250009550 tx=0x7f42500091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.138+0000 7f4261200700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646] conn(0x7f42440bdc90 0x7f42440c0110 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.139+0000 7f425a000700 1 -- 172.21.15.82:0/186443177 <== osd.0 v2:172.21.15.82:6802/1505062646 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4254018ec0 con 0x7f42440bdc90 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.160+0000 7f4264600700 1 -- 172.21.15.82:0/186443177 --> [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f425c104be0 con 0x7f42440bdc90 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.160+0000 7f425a000700 1 -- 172.21.15.82:0/186443177 <== osd.0 v2:172.21.15.82:6802/1505062646 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f425c104be0 con 0x7f42440bdc90 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.161+0000 7f4264600700 1 -- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646] conn(0x7f42440bdc90 msgr2=0x7f42440c0110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.161+0000 7f4264600700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646] conn(0x7f42440bdc90 0x7f42440c0110 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.161+0000 7f4264600700 1 -- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f42440b2990 msgr2=0x7f42440b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.161+0000 7f4264600700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f42440b2990 0x7f42440b4e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4250009550 tx=0x7f42500091b0 comp rx=0 tx=0).stop 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.161+0000 7f4264600700 1 -- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c108850 msgr2=0x7f425c19ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.161+0000 7f4264600700 1 --2- 172.21.15.82:0/186443177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f425c108850 0x7f425c19ba60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f425400b550 tx=0x7f425400b860 comp rx=0 tx=0).stop 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.161+0000 7f4262600700 1 -- 172.21.15.82:0/186443177 reap_dead start 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.161+0000 7f4264600700 1 -- 172.21.15.82:0/186443177 shutdown_connections 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.161+0000 7f4264600700 1 -- 172.21.15.82:0/186443177 >> 172.21.15.82:0/186443177 conn(0x7f425c07a600 msgr2=0x7f425c101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.161+0000 7f4264600700 1 -- 172.21.15.82:0/186443177 shutdown_connections 2024-05-03T22:15:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:24.161+0000 7f4264600700 1 -- 172.21.15.82:0/186443177 wait complete. 2024-05-03T22:15:26.096 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:25 smithi082 ceph-mon[28404]: pgmap v466: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:15:26.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:25 smithi116 ceph-mon[31828]: pgmap v466: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:15:26.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:25 smithi130 ceph-mon[32417]: pgmap v466: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:15:27.167 INFO:teuthology.orchestra.run.smithi082.stdout:34359738499 2024-05-03T22:15:27.167 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-03T22:15:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.427+0000 7f679b000700 1 -- 172.21.15.82:0/2759445004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67941033d0 msgr2=0x7f6794103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.427+0000 7f679b000700 1 --2- 172.21.15.82:0/2759445004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67941033d0 0x7f6794103850 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6780009990 tx=0x7f6780009ca0 comp rx=0 tx=0).stop 2024-05-03T22:15:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.427+0000 7f679b000700 1 -- 172.21.15.82:0/2759445004 shutdown_connections 2024-05-03T22:15:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.427+0000 7f679b000700 1 --2- 172.21.15.82:0/2759445004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6794103d90 0x7f67941102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.427+0000 7f679b000700 1 --2- 172.21.15.82:0/2759445004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6794109460 0x7f6794109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.427+0000 7f679b000700 1 --2- 172.21.15.82:0/2759445004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67941033d0 0x7f6794103850 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.427+0000 7f679b000700 1 -- 172.21.15.82:0/2759445004 >> 172.21.15.82:0/2759445004 conn(0x7f67940fef20 msgr2=0x7f6794101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.427+0000 7f679b000700 1 -- 172.21.15.82:0/2759445004 shutdown_connections 2024-05-03T22:15:27.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.427+0000 7f679b000700 1 -- 172.21.15.82:0/2759445004 wait complete. 2024-05-03T22:15:27.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.428+0000 7f679b000700 1 Processor -- start 2024-05-03T22:15:27.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.429+0000 7f679b000700 1 -- start start 2024-05-03T22:15:27.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.429+0000 7f679b000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67941033d0 0x7f679419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:27.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.429+0000 7f679b000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6794103d90 0x7f679419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:27.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.429+0000 7f679b000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6794109460 0x7f67941997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:27.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.429+0000 7f679b000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f67941134f0 con 0x7f67941033d0 2024-05-03T22:15:27.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.429+0000 7f679b000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6794113370 con 0x7f6794109460 2024-05-03T22:15:27.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.429+0000 7f679b000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6794113670 con 0x7f6794103d90 2024-05-03T22:15:27.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.429+0000 7f6799c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67941033d0 0x7f679419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:27.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.429+0000 7f6799c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67941033d0 0x7f679419f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32924/0 (socket says 172.21.15.82:32924) 2024-05-03T22:15:27.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.429+0000 7f6799c00700 1 -- 172.21.15.82:0/2249739188 learned_addr learned my addr 172.21.15.82:0/2249739188 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:27.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.430+0000 7f6799200700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6794103d90 0x7f679419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:27.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.430+0000 7f679a600700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6794109460 0x7f67941997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:27.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.430+0000 7f6799c00700 1 -- 172.21.15.82:0/2249739188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6794103d90 msgr2=0x7f679419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:27.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.430+0000 7f6799c00700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6794103d90 0x7f679419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:27.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.430+0000 7f6799c00700 1 -- 172.21.15.82:0/2249739188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6794109460 msgr2=0x7f67941997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:27.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.430+0000 7f6799c00700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6794109460 0x7f67941997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.430+0000 7f6799c00700 1 -- 172.21.15.82:0/2249739188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6794199fd0 con 0x7f67941033d0 2024-05-03T22:15:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.430+0000 7f6799c00700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67941033d0 0x7f679419f670 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f678800c9b0 tx=0x7f678800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.431+0000 7f6792000700 1 -- 172.21.15.82:0/2249739188 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788007b00 con 0x7f67941033d0 2024-05-03T22:15:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.431+0000 7f6792000700 1 -- 172.21.15.82:0/2249739188 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6788007ca0 con 0x7f67941033d0 2024-05-03T22:15:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.431+0000 7f679b000700 1 -- 172.21.15.82:0/2249739188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679419a2c0 con 0x7f67941033d0 2024-05-03T22:15:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.431+0000 7f6792000700 1 -- 172.21.15.82:0/2249739188 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788018660 con 0x7f67941033d0 2024-05-03T22:15:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.431+0000 7f679b000700 1 -- 172.21.15.82:0/2249739188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67940756d0 con 0x7f67941033d0 2024-05-03T22:15:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.432+0000 7f679b000700 1 -- 172.21.15.82:0/2249739188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6794063c30 con 0x7f67941033d0 2024-05-03T22:15:27.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.435+0000 7f6792000700 1 -- 172.21.15.82:0/2249739188 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f678800f450 con 0x7f67941033d0 2024-05-03T22:15:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.436+0000 7f6792000700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f677c0b2910 0x7f677c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.436+0000 7f6792000700 1 -- 172.21.15.82:0/2249739188 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f67880e2c60 con 0x7f67941033d0 2024-05-03T22:15:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.436+0000 7f6799200700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f677c0b2910 0x7f677c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:27.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.437+0000 7f6792000700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455] conn(0x7f677c0bdc10 0x7f677c0c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.437+0000 7f6792000700 1 -- 172.21.15.82:0/2249739188 --> [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6788007e50 con 0x7f677c0bdc10 2024-05-03T22:15:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.437+0000 7f6792000700 1 -- 172.21.15.82:0/2249739188 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f67880e30b0 con 0x7f67941033d0 2024-05-03T22:15:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.437+0000 7f679a600700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455] conn(0x7f677c0bdc10 0x7f677c0c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:27.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.437+0000 7f6799200700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f677c0b2910 0x7f677c0b4dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f678000b5c0 tx=0x7f678001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.438+0000 7f679a600700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455] conn(0x7f677c0bdc10 0x7f677c0c0090 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.440+0000 7f6792000700 1 -- 172.21.15.82:0/2249739188 <== osd.5 v2:172.21.15.130:6808/378786455 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6788007e50 con 0x7f677c0bdc10 2024-05-03T22:15:27.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.461+0000 7f679b000700 1 -- 172.21.15.82:0/2249739188 --> [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f67940640b0 con 0x7f677c0bdc10 2024-05-03T22:15:27.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.462+0000 7f6792000700 1 -- 172.21.15.82:0/2249739188 <== osd.5 v2:172.21.15.130:6808/378786455 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f67940640b0 con 0x7f677c0bdc10 2024-05-03T22:15:27.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.462+0000 7f679b000700 1 -- 172.21.15.82:0/2249739188 >> [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455] conn(0x7f677c0bdc10 msgr2=0x7f677c0c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:27.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.462+0000 7f679b000700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455] conn(0x7f677c0bdc10 0x7f677c0c0090 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:27.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.462+0000 7f679b000700 1 -- 172.21.15.82:0/2249739188 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f677c0b2910 msgr2=0x7f677c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:27.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.462+0000 7f679b000700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f677c0b2910 0x7f677c0b4dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f678000b5c0 tx=0x7f678001a040 comp rx=0 tx=0).stop 2024-05-03T22:15:27.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.462+0000 7f679b000700 1 -- 172.21.15.82:0/2249739188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67941033d0 msgr2=0x7f679419f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.462+0000 7f679b000700 1 --2- 172.21.15.82:0/2249739188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67941033d0 0x7f679419f670 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f678800c9b0 tx=0x7f678800cd70 comp rx=0 tx=0).stop 2024-05-03T22:15:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.462+0000 7f679a600700 1 -- 172.21.15.82:0/2249739188 reap_dead start 2024-05-03T22:15:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.462+0000 7f679b000700 1 -- 172.21.15.82:0/2249739188 shutdown_connections 2024-05-03T22:15:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.462+0000 7f679b000700 1 -- 172.21.15.82:0/2249739188 >> 172.21.15.82:0/2249739188 conn(0x7f67940fef20 msgr2=0x7f67940ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.463+0000 7f679b000700 1 -- 172.21.15.82:0/2249739188 shutdown_connections 2024-05-03T22:15:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:27.463+0000 7f679b000700 1 -- 172.21.15.82:0/2249739188 wait complete. 2024-05-03T22:15:28.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:27 smithi116 ceph-mon[31828]: pgmap v467: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:15:28.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:27 smithi082 ceph-mon[28404]: pgmap v467: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:15:28.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:27 smithi130 ceph-mon[32417]: pgmap v467: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:15:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.423+0000 7f3b3e000700 1 -- 172.21.15.82:0/377172772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38106070 msgr2=0x7f3b38112580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.423+0000 7f3b3e000700 1 --2- 172.21.15.82:0/377172772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38106070 0x7f3b38112580 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000b0a0 tx=0x7f3b3000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:15:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.423+0000 7f3b3e000700 1 -- 172.21.15.82:0/377172772 shutdown_connections 2024-05-03T22:15:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.423+0000 7f3b3e000700 1 --2- 172.21.15.82:0/377172772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b38106070 0x7f3b38112580 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.423+0000 7f3b3e000700 1 --2- 172.21.15.82:0/377172772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b3810b6b0 0x7f3b3810ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.423+0000 7f3b3e000700 1 --2- 172.21.15.82:0/377172772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b381056b0 0x7f3b38105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.423+0000 7f3b3e000700 1 -- 172.21.15.82:0/377172772 >> 172.21.15.82:0/377172772 conn(0x7f3b38101180 msgr2=0x7f3b381035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.423+0000 7f3b3e000700 1 -- 172.21.15.82:0/377172772 shutdown_connections 2024-05-03T22:15:28.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.423+0000 7f3b3e000700 1 -- 172.21.15.82:0/377172772 wait complete. 2024-05-03T22:15:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.424+0000 7f3b3e000700 1 Processor -- start 2024-05-03T22:15:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.424+0000 7f3b3e000700 1 -- start start 2024-05-03T22:15:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.425+0000 7f3b3e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b381056b0 0x7f3b381a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.425+0000 7f3b3e000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b38106070 0x7f3b381a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.425+0000 7f3b3e000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b3810b6b0 0x7f3b3819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.425+0000 7f3b3e000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381157a0 con 0x7f3b381056b0 2024-05-03T22:15:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.425+0000 7f3b3e000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38115620 con 0x7f3b38106070 2024-05-03T22:15:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.425+0000 7f3b3e000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38115920 con 0x7f3b3810b6b0 2024-05-03T22:15:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.425+0000 7f3b37400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b381056b0 0x7f3b381a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.425+0000 7f3b37400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b381056b0 0x7f3b381a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32946/0 (socket says 172.21.15.82:32946) 2024-05-03T22:15:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.425+0000 7f3b37400700 1 -- 172.21.15.82:0/187657052 learned_addr learned my addr 172.21.15.82:0/187657052 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.425+0000 7f3b36a00700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b38106070 0x7f3b381a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.425+0000 7f3b37e00700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b3810b6b0 0x7f3b3819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.426+0000 7f3b37400700 1 -- 172.21.15.82:0/187657052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b3810b6b0 msgr2=0x7f3b3819baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.426+0000 7f3b37400700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b3810b6b0 0x7f3b3819baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.426+0000 7f3b37400700 1 -- 172.21.15.82:0/187657052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b38106070 msgr2=0x7f3b381a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.426+0000 7f3b37400700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b38106070 0x7f3b381a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.426+0000 7f3b37400700 1 -- 172.21.15.82:0/187657052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3819c200 con 0x7f3b381056b0 2024-05-03T22:15:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.426+0000 7f3b37400700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b381056b0 0x7f3b381a18e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800c920 tx=0x7f3b2800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.426+0000 7f3b2fe00700 1 -- 172.21.15.82:0/187657052 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b28007b00 con 0x7f3b381056b0 2024-05-03T22:15:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.426+0000 7f3b2fe00700 1 -- 172.21.15.82:0/187657052 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b28004cc0 con 0x7f3b381056b0 2024-05-03T22:15:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.426+0000 7f3b3e000700 1 -- 172.21.15.82:0/187657052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3819c4f0 con 0x7f3b381056b0 2024-05-03T22:15:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.426+0000 7f3b2fe00700 1 -- 172.21.15.82:0/187657052 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b280054f0 con 0x7f3b381056b0 2024-05-03T22:15:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.426+0000 7f3b3e000700 1 -- 172.21.15.82:0/187657052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b381a87b0 con 0x7f3b381056b0 2024-05-03T22:15:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.427+0000 7f3b3e000700 1 -- 172.21.15.82:0/187657052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b38063c30 con 0x7f3b381056b0 2024-05-03T22:15:28.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.430+0000 7f3b2fe00700 1 -- 172.21.15.82:0/187657052 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3b28007ca0 con 0x7f3b381056b0 2024-05-03T22:15:28.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.431+0000 7f3b2fe00700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3b1c0b2910 0x7f3b1c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:28.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.432+0000 7f3b2fe00700 1 -- 172.21.15.82:0/187657052 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f3b280e27e0 con 0x7f3b381056b0 2024-05-03T22:15:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.432+0000 7f3b36a00700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3b1c0b2910 0x7f3b1c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.432+0000 7f3b2fe00700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775] conn(0x7f3b1c0bdc10 0x7f3b1c0c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.432+0000 7f3b2fe00700 1 -- 172.21.15.82:0/187657052 --> [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b1c0c0760 con 0x7f3b1c0bdc10 2024-05-03T22:15:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.432+0000 7f3b2fe00700 1 -- 172.21.15.82:0/187657052 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f3b280e2b90 con 0x7f3b381056b0 2024-05-03T22:15:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.432+0000 7f3b36a00700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3b1c0b2910 0x7f3b1c0b4dd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b24005950 tx=0x7f3b240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.433+0000 7f3b37e00700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775] conn(0x7f3b1c0bdc10 0x7f3b1c0c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:28.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.433+0000 7f3b37e00700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775] conn(0x7f3b1c0bdc10 0x7f3b1c0c0090 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:28.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.436+0000 7f3b2fe00700 1 -- 172.21.15.82:0/187657052 <== osd.11 v2:172.21.15.130:6824/2407047775 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b1c0c0760 con 0x7f3b1c0bdc10 2024-05-03T22:15:28.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.454+0000 7f3b3e000700 1 -- 172.21.15.82:0/187657052 --> [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b380640b0 con 0x7f3b1c0bdc10 2024-05-03T22:15:28.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.455+0000 7f3b2fe00700 1 -- 172.21.15.82:0/187657052 <== osd.11 v2:172.21.15.130:6824/2407047775 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3b380640b0 con 0x7f3b1c0bdc10 2024-05-03T22:15:28.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.456+0000 7f3b3e000700 1 -- 172.21.15.82:0/187657052 >> [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775] conn(0x7f3b1c0bdc10 msgr2=0x7f3b1c0c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:28.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.456+0000 7f3b3e000700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775] conn(0x7f3b1c0bdc10 0x7f3b1c0c0090 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:28.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.456+0000 7f3b3e000700 1 -- 172.21.15.82:0/187657052 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3b1c0b2910 msgr2=0x7f3b1c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:28.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.456+0000 7f3b3e000700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3b1c0b2910 0x7f3b1c0b4dd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b24005950 tx=0x7f3b240058e0 comp rx=0 tx=0).stop 2024-05-03T22:15:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.456+0000 7f3b3e000700 1 -- 172.21.15.82:0/187657052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b381056b0 msgr2=0x7f3b381a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.456+0000 7f3b3e000700 1 --2- 172.21.15.82:0/187657052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b381056b0 0x7f3b381a18e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800c920 tx=0x7f3b2800cce0 comp rx=0 tx=0).stop 2024-05-03T22:15:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.456+0000 7f3b37e00700 1 -- 172.21.15.82:0/187657052 reap_dead start 2024-05-03T22:15:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.456+0000 7f3b3e000700 1 -- 172.21.15.82:0/187657052 shutdown_connections 2024-05-03T22:15:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.456+0000 7f3b3e000700 1 -- 172.21.15.82:0/187657052 >> 172.21.15.82:0/187657052 conn(0x7f3b38101180 msgr2=0x7f3b381018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.456+0000 7f3b3e000700 1 -- 172.21.15.82:0/187657052 shutdown_connections 2024-05-03T22:15:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:28.456+0000 7f3b3e000700 1 -- 172.21.15.82:0/187657052 wait complete. 2024-05-03T22:15:29.132 INFO:teuthology.orchestra.run.smithi082.stdout:77309411446 2024-05-03T22:15:29.132 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-03T22:15:30.066 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:29 smithi082 ceph-mon[28404]: pgmap v468: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:15:30.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:29 smithi116 ceph-mon[31828]: pgmap v468: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:15:30.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:29 smithi130 ceph-mon[32417]: pgmap v468: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:15:31.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.553+0000 7f8a0fa00700 1 -- 172.21.15.82:0/445550696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a08106080 msgr2=0x7f8a08112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.553+0000 7f8a0fa00700 1 --2- 172.21.15.82:0/445550696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a08106080 0x7f8a08112590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000b0a0 tx=0x7f8a0000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:15:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.554+0000 7f8a0fa00700 1 -- 172.21.15.82:0/445550696 shutdown_connections 2024-05-03T22:15:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.554+0000 7f8a0fa00700 1 --2- 172.21.15.82:0/445550696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a08106080 0x7f8a08112590 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.554+0000 7f8a0fa00700 1 --2- 172.21.15.82:0/445550696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a0810b6c0 0x7f8a0810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.554+0000 7f8a0fa00700 1 --2- 172.21.15.82:0/445550696 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a081056c0 0x7f8a08105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.554+0000 7f8a0fa00700 1 -- 172.21.15.82:0/445550696 >> 172.21.15.82:0/445550696 conn(0x7f8a081011b0 msgr2=0x7f8a081035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.554+0000 7f8a0fa00700 1 -- 172.21.15.82:0/445550696 shutdown_connections 2024-05-03T22:15:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.554+0000 7f8a0fa00700 1 -- 172.21.15.82:0/445550696 wait complete. 2024-05-03T22:15:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.555+0000 7f8a0fa00700 1 Processor -- start 2024-05-03T22:15:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.555+0000 7f8a0fa00700 1 -- start start 2024-05-03T22:15:31.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.555+0000 7f8a0fa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a081056c0 0x7f8a0819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.555+0000 7f8a0fa00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a08106080 0x7f8a0819c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.555+0000 7f8a0fa00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a0810b6c0 0x7f8a081a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.555+0000 7f8a0fa00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a08115770 con 0x7f8a081056c0 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.555+0000 7f8a0fa00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8a081155f0 con 0x7f8a0810b6c0 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.555+0000 7f8a0fa00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a081158f0 con 0x7f8a08106080 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.556+0000 7f8a0d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a081056c0 0x7f8a0819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.556+0000 7f8a0d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a081056c0 0x7f8a0819bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32898/0 (socket says 172.21.15.82:32898) 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.556+0000 7f8a0d000700 1 -- 172.21.15.82:0/1394249645 learned_addr learned my addr 172.21.15.82:0/1394249645 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.556+0000 7f8a0da00700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a0810b6c0 0x7f8a081a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.556+0000 7f8a07e00700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a08106080 0x7f8a0819c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.556+0000 7f8a0d000700 1 -- 172.21.15.82:0/1394249645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a08106080 msgr2=0x7f8a0819c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.556+0000 7f8a0d000700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a08106080 0x7f8a0819c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.556+0000 7f8a0d000700 1 -- 172.21.15.82:0/1394249645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a0810b6c0 msgr2=0x7f8a081a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.556+0000 7f8a0d000700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a0810b6c0 0x7f8a081a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.556+0000 7f8a0d000700 1 -- 172.21.15.82:0/1394249645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a081a0d30 con 0x7f8a081056c0 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.556+0000 7f8a07e00700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a08106080 0x7f8a0819c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.557+0000 7f8a0d000700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a081056c0 0x7f8a0819bd70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00d980 tx=0x7f89fc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.557+0000 7f8a05600700 1 -- 172.21.15.82:0/1394249645 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc017070 con 0x7f8a081056c0 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.557+0000 7f8a05600700 1 -- 172.21.15.82:0/1394249645 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89fc004830 con 0x7f8a081056c0 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.557+0000 7f8a0fa00700 1 -- 172.21.15.82:0/1394249645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a081a1020 con 0x7f8a081056c0 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.557+0000 7f8a05600700 1 -- 172.21.15.82:0/1394249645 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0053a0 con 0x7f8a081056c0 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.557+0000 7f8a0fa00700 1 -- 172.21.15.82:0/1394249645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a081a88a0 con 0x7f8a081056c0 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.558+0000 7f8a0fa00700 1 -- 172.21.15.82:0/1394249645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a08063bb0 con 0x7f8a081056c0 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.560+0000 7f8a05600700 1 -- 172.21.15.82:0/1394249645 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f89fc0049e0 con 0x7f8a081056c0 2024-05-03T22:15:31.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.562+0000 7f8a05600700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f89f00b2910 0x7f89f00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.562+0000 7f8a05600700 1 -- 172.21.15.82:0/1394249645 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f89fc0e2c40 con 0x7f8a081056c0 2024-05-03T22:15:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.562+0000 7f8a07e00700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f89f00b2910 0x7f89f00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.562+0000 7f8a05600700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608] conn(0x7f89f00bdc10 0x7f89f00c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.562+0000 7f8a05600700 1 -- 172.21.15.82:0/1394249645 --> [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89fc01ae70 con 0x7f89f00bdc10 2024-05-03T22:15:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.562+0000 7f8a05600700 1 -- 172.21.15.82:0/1394249645 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f89fc0e2ff0 con 0x7f8a081056c0 2024-05-03T22:15:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.563+0000 7f8a07e00700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f89f00b2910 0x7f89f00b4dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89f4005fd0 tx=0x7f89f4005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.563+0000 7f8a0da00700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608] conn(0x7f89f00bdc10 0x7f89f00c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.564+0000 7f8a0da00700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608] conn(0x7f89f00bdc10 0x7f89f00c0090 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.567+0000 7f8a05600700 1 -- 172.21.15.82:0/1394249645 <== osd.1 v2:172.21.15.116:6800/1867277608 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f89fc01ae70 con 0x7f89f00bdc10 2024-05-03T22:15:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.585+0000 7f8a0fa00700 1 -- 172.21.15.82:0/1394249645 --> [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a08063fb0 con 0x7f89f00bdc10 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.586+0000 7f8a05600700 1 -- 172.21.15.82:0/1394249645 <== osd.1 v2:172.21.15.116:6800/1867277608 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8a08063fb0 con 0x7f89f00bdc10 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.586+0000 7f8a0fa00700 1 -- 172.21.15.82:0/1394249645 >> [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608] conn(0x7f89f00bdc10 msgr2=0x7f89f00c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.586+0000 7f8a0fa00700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608] conn(0x7f89f00bdc10 0x7f89f00c0090 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.586+0000 7f8a0fa00700 1 -- 172.21.15.82:0/1394249645 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f89f00b2910 msgr2=0x7f89f00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.586+0000 7f8a0fa00700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f89f00b2910 0x7f89f00b4dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f89f4005fd0 tx=0x7f89f4005ee0 comp rx=0 tx=0).stop 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.586+0000 7f8a0fa00700 1 -- 172.21.15.82:0/1394249645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a081056c0 msgr2=0x7f8a0819bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.586+0000 7f8a0fa00700 1 --2- 172.21.15.82:0/1394249645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a081056c0 0x7f8a0819bd70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00d980 tx=0x7f89fc00dd40 comp rx=0 tx=0).stop 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.587+0000 7f8a0da00700 1 -- 172.21.15.82:0/1394249645 reap_dead start 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.587+0000 7f8a0fa00700 1 -- 172.21.15.82:0/1394249645 shutdown_connections 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.587+0000 7f8a0fa00700 1 -- 172.21.15.82:0/1394249645 >> 172.21.15.82:0/1394249645 conn(0x7f8a081011b0 msgr2=0x7f8a081018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.587+0000 7f8a0fa00700 1 -- 172.21.15.82:0/1394249645 shutdown_connections 2024-05-03T22:15:31.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:26.587+0000 7f8a0fa00700 1 -- 172.21.15.82:0/1394249645 wait complete. 2024-05-03T22:15:31.636 INFO:teuthology.orchestra.run.smithi082.stdout:163208757345 2024-05-03T22:15:31.636 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-03T22:15:31.887 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:31 smithi082 ceph-mon[28404]: pgmap v469: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:15:32.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:31 smithi116 ceph-mon[31828]: pgmap v469: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:15:32.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:31 smithi130 ceph-mon[32417]: pgmap v469: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:15:32.601 INFO:teuthology.orchestra.run.smithi082.stdout:55834574973 2024-05-03T22:15:32.601 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-03T22:15:32.846 INFO:teuthology.orchestra.run.smithi082.stdout:137438953576 2024-05-03T22:15:32.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-03T22:15:32.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.871+0000 7f8b43e00700 1 -- 172.21.15.82:0/772929109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c10fea0 msgr2=0x7f8b3c112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:32.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.871+0000 7f8b43e00700 1 --2- 172.21.15.82:0/772929109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c10fea0 0x7f8b3c112290 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400b0a0 tx=0x7f8b3400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:15:32.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.871+0000 7f8b43e00700 1 -- 172.21.15.82:0/772929109 shutdown_connections 2024-05-03T22:15:32.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.871+0000 7f8b43e00700 1 --2- 172.21.15.82:0/772929109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c10fea0 0x7f8b3c112290 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:32.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.871+0000 7f8b43e00700 1 --2- 172.21.15.82:0/772929109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b3c0756d0 0x7f8b3c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:32.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.871+0000 7f8b43e00700 1 --2- 172.21.15.82:0/772929109 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b3c075ff0 0x7f8b3c10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:32.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.871+0000 7f8b43e00700 1 -- 172.21.15.82:0/772929109 >> 172.21.15.82:0/772929109 conn(0x7f8b3c07a650 msgr2=0x7f8b3c07aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:32.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.872+0000 7f8b43e00700 1 -- 172.21.15.82:0/772929109 shutdown_connections 2024-05-03T22:15:32.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.872+0000 7f8b43e00700 1 -- 172.21.15.82:0/772929109 wait complete. 2024-05-03T22:15:32.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.874+0000 7f8b43e00700 1 Processor -- start 2024-05-03T22:15:32.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.874+0000 7f8b43e00700 1 -- start start 2024-05-03T22:15:32.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.874+0000 7f8b43e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0756d0 0x7f8b3c1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:32.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.874+0000 7f8b43e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b3c075ff0 0x7f8b3c1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:32.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.875+0000 7f8b43e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b3c10fea0 0x7f8b3c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:32.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.875+0000 7f8b43e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c1157a0 con 0x7f8b3c0756d0 2024-05-03T22:15:32.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.875+0000 7f8b43e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c115620 con 0x7f8b3c075ff0 2024-05-03T22:15:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.875+0000 7f8b43e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c115920 con 0x7f8b3c10fea0 2024-05-03T22:15:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.875+0000 7f8b41400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0756d0 0x7f8b3c1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.875+0000 7f8b41400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0756d0 0x7f8b3c1a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32972/0 (socket says 172.21.15.82:32972) 2024-05-03T22:15:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.875+0000 7f8b41400700 1 -- 172.21.15.82:0/4093604261 learned_addr learned my addr 172.21.15.82:0/4093604261 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.875+0000 7f8b40a00700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b3c075ff0 0x7f8b3c1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.875+0000 7f8b41e00700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b3c10fea0 0x7f8b3c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.875+0000 7f8b41400700 1 -- 172.21.15.82:0/4093604261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b3c10fea0 msgr2=0x7f8b3c19bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.875+0000 7f8b41400700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b3c10fea0 0x7f8b3c19bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.876+0000 7f8b41400700 1 -- 172.21.15.82:0/4093604261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b3c075ff0 msgr2=0x7f8b3c1a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:32.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.876+0000 7f8b41400700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8b3c075ff0 0x7f8b3c1a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:32.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.876+0000 7f8b41400700 1 -- 172.21.15.82:0/4093604261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3c19c260 con 0x7f8b3c0756d0 2024-05-03T22:15:32.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.876+0000 7f8b41400700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0756d0 0x7f8b3c1a1940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000d980 tx=0x7f8b3000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:32.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.876+0000 7f8b3a000700 1 -- 172.21.15.82:0/4093604261 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30017070 con 0x7f8b3c0756d0 2024-05-03T22:15:32.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.876+0000 7f8b3a000700 1 -- 172.21.15.82:0/4093604261 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b30005020 con 0x7f8b3c0756d0 2024-05-03T22:15:32.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.876+0000 7f8b3a000700 1 -- 172.21.15.82:0/4093604261 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30009ab0 con 0x7f8b3c0756d0 2024-05-03T22:15:32.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.876+0000 7f8b43e00700 1 -- 172.21.15.82:0/4093604261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3c19c550 con 0x7f8b3c0756d0 2024-05-03T22:15:32.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.876+0000 7f8b43e00700 1 -- 172.21.15.82:0/4093604261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b3c1a8810 con 0x7f8b3c0756d0 2024-05-03T22:15:32.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.877+0000 7f8b43e00700 1 -- 172.21.15.82:0/4093604261 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b3c063bf0 con 0x7f8b3c0756d0 2024-05-03T22:15:32.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.880+0000 7f8b3a000700 1 -- 172.21.15.82:0/4093604261 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8b300051d0 con 0x7f8b3c0756d0 2024-05-03T22:15:32.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.882+0000 7f8b3a000700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8b240b2990 0x7f8b240b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:32.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.882+0000 7f8b3a000700 1 -- 172.21.15.82:0/4093604261 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f8b300e2c00 con 0x7f8b3c0756d0 2024-05-03T22:15:32.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.882+0000 7f8b3a000700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329] conn(0x7f8b240bdc90 0x7f8b240c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:32.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.882+0000 7f8b3a000700 1 -- 172.21.15.82:0/4093604261 --> [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b3001ae70 con 0x7f8b240bdc90 2024-05-03T22:15:32.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.882+0000 7f8b3a000700 1 -- 172.21.15.82:0/4093604261 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f8b300e2fb0 con 0x7f8b3c0756d0 2024-05-03T22:15:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.882+0000 7f8b40a00700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8b240b2990 0x7f8b240b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.883+0000 7f8b41e00700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329] conn(0x7f8b240bdc90 0x7f8b240c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.883+0000 7f8b40a00700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8b240b2990 0x7f8b240b4e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c1030a0 tx=0x7f8b2800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.884+0000 7f8b41e00700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329] conn(0x7f8b240bdc90 0x7f8b240c0110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.886+0000 7f8b3a000700 1 -- 172.21.15.82:0/4093604261 <== osd.10 v2:172.21.15.116:6824/2019218329 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b3001ae70 con 0x7f8b240bdc90 2024-05-03T22:15:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.907+0000 7f8b43e00700 1 -- 172.21.15.82:0/4093604261 --> [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b3c064070 con 0x7f8b240bdc90 2024-05-03T22:15:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.908+0000 7f8b3a000700 1 -- 172.21.15.82:0/4093604261 <== osd.10 v2:172.21.15.116:6824/2019218329 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8b3c064070 con 0x7f8b240bdc90 2024-05-03T22:15:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.908+0000 7f8b43e00700 1 -- 172.21.15.82:0/4093604261 >> [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329] conn(0x7f8b240bdc90 msgr2=0x7f8b240c0110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:32.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.908+0000 7f8b43e00700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329] conn(0x7f8b240bdc90 0x7f8b240c0110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:32.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.909+0000 7f8b43e00700 1 -- 172.21.15.82:0/4093604261 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8b240b2990 msgr2=0x7f8b240b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:32.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.909+0000 7f8b43e00700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8b240b2990 0x7f8b240b4e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c1030a0 tx=0x7f8b2800b410 comp rx=0 tx=0).stop 2024-05-03T22:15:32.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.909+0000 7f8b43e00700 1 -- 172.21.15.82:0/4093604261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0756d0 msgr2=0x7f8b3c1a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:32.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.909+0000 7f8b43e00700 1 --2- 172.21.15.82:0/4093604261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b3c0756d0 0x7f8b3c1a1940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000d980 tx=0x7f8b3000dc90 comp rx=0 tx=0).stop 2024-05-03T22:15:32.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.909+0000 7f8b41e00700 1 -- 172.21.15.82:0/4093604261 reap_dead start 2024-05-03T22:15:32.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.909+0000 7f8b43e00700 1 -- 172.21.15.82:0/4093604261 shutdown_connections 2024-05-03T22:15:32.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.909+0000 7f8b43e00700 1 -- 172.21.15.82:0/4093604261 >> 172.21.15.82:0/4093604261 conn(0x7f8b3c07a650 msgr2=0x7f8b3c100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:32.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.909+0000 7f8b43e00700 1 -- 172.21.15.82:0/4093604261 shutdown_connections 2024-05-03T22:15:32.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:32.909+0000 7f8b43e00700 1 -- 172.21.15.82:0/4093604261 wait complete. 2024-05-03T22:15:33.971 INFO:teuthology.orchestra.run.smithi082.stdout:287762808895 2024-05-03T22:15:33.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-03T22:15:34.083 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:33 smithi082 ceph-mon[28404]: pgmap v470: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:15:34.187 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:33 smithi116 ceph-mon[31828]: pgmap v470: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:15:34.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:33 smithi130 ceph-mon[32417]: pgmap v470: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:15:34.630 INFO:teuthology.orchestra.run.smithi082.stdout:313532612661 2024-05-03T22:15:34.630 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-03T22:15:35.916 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:35 smithi082 ceph-mon[28404]: pgmap v471: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-03T22:15:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.129+0000 7f851d200700 1 -- 172.21.15.82:0/157499619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85180782f0 msgr2=0x7f8518113e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.129+0000 7f851d200700 1 --2- 172.21.15.82:0/157499619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85180782f0 0x7f8518113e40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8504009990 tx=0x7f8504009ca0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.129+0000 7f851d200700 1 -- 172.21.15.82:0/157499619 shutdown_connections 2024-05-03T22:15:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.129+0000 7f851d200700 1 --2- 172.21.15.82:0/157499619 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8518114380 0x7f8518116770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.129+0000 7f851d200700 1 --2- 172.21.15.82:0/157499619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85180779d0 0x7f8518077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.130+0000 7f851d200700 1 --2- 172.21.15.82:0/157499619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85180782f0 0x7f8518113e40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.130+0000 7f851d200700 1 -- 172.21.15.82:0/157499619 >> 172.21.15.82:0/157499619 conn(0x7f85181011d0 msgr2=0x7f85181035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.130+0000 7f851d200700 1 -- 172.21.15.82:0/157499619 shutdown_connections 2024-05-03T22:15:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.130+0000 7f851d200700 1 -- 172.21.15.82:0/157499619 wait complete. 2024-05-03T22:15:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.131+0000 7f851d200700 1 Processor -- start 2024-05-03T22:15:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.131+0000 7f851d200700 1 -- start start 2024-05-03T22:15:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.131+0000 7f851d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85180779d0 0x7f85181a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.131+0000 7f851d200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85180782f0 0x7f85181a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.131+0000 7f851d200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8518114380 0x7f85181a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.131+0000 7f851d200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8518119bf0 con 0x7f85180779d0 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.131+0000 7f851d200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8518119a70 con 0x7f8518114380 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.131+0000 7f851d200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8518119d70 con 0x7f85180782f0 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.131+0000 7f8515e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85180779d0 0x7f85181a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.131+0000 7f8515e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85180779d0 0x7f85181a0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40630/0 (socket says 172.21.15.82:40630) 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.131+0000 7f8515e00700 1 -- 172.21.15.82:0/1774805147 learned_addr learned my addr 172.21.15.82:0/1774805147 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.132+0000 7f8515400700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85180782f0 0x7f85181a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.132+0000 7f8516800700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8518114380 0x7f85181a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.132+0000 7f8515e00700 1 -- 172.21.15.82:0/1774805147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85180782f0 msgr2=0x7f85181a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.132+0000 7f8515e00700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85180782f0 0x7f85181a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.132+0000 7f8515e00700 1 -- 172.21.15.82:0/1774805147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8518114380 msgr2=0x7f85181a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.132+0000 7f8515e00700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8518114380 0x7f85181a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.132+0000 7f8515e00700 1 -- 172.21.15.82:0/1774805147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85181a51d0 con 0x7f85180779d0 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.132+0000 7f8516800700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8518114380 0x7f85181a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:15:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.132+0000 7f8515e00700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85180779d0 0x7f85181a0210 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f850800d950 tx=0x7f850800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.132+0000 7f850ea00700 1 -- 172.21.15.82:0/1774805147 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508016070 con 0x7f85180779d0 2024-05-03T22:15:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.133+0000 7f850ea00700 1 -- 172.21.15.82:0/1774805147 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8508010460 con 0x7f85180779d0 2024-05-03T22:15:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.133+0000 7f850ea00700 1 -- 172.21.15.82:0/1774805147 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850800f620 con 0x7f85180779d0 2024-05-03T22:15:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.133+0000 7f851d200700 1 -- 172.21.15.82:0/1774805147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85181a54c0 con 0x7f85180779d0 2024-05-03T22:15:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.133+0000 7f851d200700 1 -- 172.21.15.82:0/1774805147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85181acd40 con 0x7f85180779d0 2024-05-03T22:15:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.134+0000 7f851d200700 1 -- 172.21.15.82:0/1774805147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8518063bb0 con 0x7f85180779d0 2024-05-03T22:15:36.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.136+0000 7f850ea00700 1 -- 172.21.15.82:0/1774805147 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8508019070 con 0x7f85180779d0 2024-05-03T22:15:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.137+0000 7f850ea00700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f84fc0b2990 0x7f84fc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.138+0000 7f850ea00700 1 -- 172.21.15.82:0/1774805147 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f85080e2880 con 0x7f85180779d0 2024-05-03T22:15:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.138+0000 7f8515400700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f84fc0b2990 0x7f84fc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.138+0000 7f850ea00700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809] conn(0x7f84fc0bdc90 0x7f84fc0c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:36.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.138+0000 7f850ea00700 1 -- 172.21.15.82:0/1774805147 --> [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84fc0c07e0 con 0x7f84fc0bdc90 2024-05-03T22:15:36.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.138+0000 7f850ea00700 1 -- 172.21.15.82:0/1774805147 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f85080e2c30 con 0x7f85180779d0 2024-05-03T22:15:36.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.138+0000 7f8516800700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809] conn(0x7f84fc0bdc90 0x7f84fc0c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:36.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.138+0000 7f8515400700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f84fc0b2990 0x7f84fc0b4e50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f850400b5c0 tx=0x7f850401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:36.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.139+0000 7f8516800700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809] conn(0x7f84fc0bdc90 0x7f84fc0c0110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.140+0000 7f850ea00700 1 -- 172.21.15.82:0/1774805147 <== osd.3 v2:172.21.15.82:6810/3661604809 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f84fc0c07e0 con 0x7f84fc0bdc90 2024-05-03T22:15:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.157+0000 7f851d200700 1 -- 172.21.15.82:0/1774805147 --> [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8518064080 con 0x7f84fc0bdc90 2024-05-03T22:15:36.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.158+0000 7f850ea00700 1 -- 172.21.15.82:0/1774805147 <== osd.3 v2:172.21.15.82:6810/3661604809 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8518064080 con 0x7f84fc0bdc90 2024-05-03T22:15:36.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.158+0000 7f851d200700 1 -- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809] conn(0x7f84fc0bdc90 msgr2=0x7f84fc0c0110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.158+0000 7f851d200700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809] conn(0x7f84fc0bdc90 0x7f84fc0c0110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.158+0000 7f851d200700 1 -- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f84fc0b2990 msgr2=0x7f84fc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.158+0000 7f851d200700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f84fc0b2990 0x7f84fc0b4e50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f850400b5c0 tx=0x7f850401a040 comp rx=0 tx=0).stop 2024-05-03T22:15:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.158+0000 7f851d200700 1 -- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85180779d0 msgr2=0x7f85181a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.158+0000 7f851d200700 1 --2- 172.21.15.82:0/1774805147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85180779d0 0x7f85181a0210 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f850800d950 tx=0x7f850800dd10 comp rx=0 tx=0).stop 2024-05-03T22:15:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.158+0000 7f8516800700 1 -- 172.21.15.82:0/1774805147 reap_dead start 2024-05-03T22:15:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.159+0000 7f851d200700 1 -- 172.21.15.82:0/1774805147 shutdown_connections 2024-05-03T22:15:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.159+0000 7f851d200700 1 -- 172.21.15.82:0/1774805147 >> 172.21.15.82:0/1774805147 conn(0x7f85181011d0 msgr2=0x7f85181035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.159+0000 7f851d200700 1 -- 172.21.15.82:0/1774805147 shutdown_connections 2024-05-03T22:15:36.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.159+0000 7f851d200700 1 -- 172.21.15.82:0/1774805147 wait complete. 2024-05-03T22:15:36.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:35 smithi116 ceph-mon[31828]: pgmap v471: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-03T22:15:36.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:35 smithi130 ceph-mon[32417]: pgmap v471: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-03T22:15:36.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.759+0000 7f6921000700 1 -- 172.21.15.82:0/2042358680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c10a490 msgr2=0x7f691c1169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.759+0000 7f6921000700 1 --2- 172.21.15.82:0/2042358680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c10a490 0x7f691c1169a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f691400b0a0 tx=0x7f691400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.759+0000 7f6921000700 1 -- 172.21.15.82:0/2042358680 shutdown_connections 2024-05-03T22:15:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.759+0000 7f6921000700 1 --2- 172.21.15.82:0/2042358680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c10a490 0x7f691c1169a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.759+0000 7f6921000700 1 --2- 172.21.15.82:0/2042358680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f691c10fb60 0x7f691c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.759+0000 7f6921000700 1 --2- 172.21.15.82:0/2042358680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f691c109ad0 0x7f691c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.759+0000 7f6921000700 1 -- 172.21.15.82:0/2042358680 >> 172.21.15.82:0/2042358680 conn(0x7f691c076c70 msgr2=0x7f691c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.759+0000 7f6921000700 1 -- 172.21.15.82:0/2042358680 shutdown_connections 2024-05-03T22:15:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.760+0000 7f6921000700 1 -- 172.21.15.82:0/2042358680 wait complete. 2024-05-03T22:15:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.760+0000 7f6921000700 1 Processor -- start 2024-05-03T22:15:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.761+0000 7f6921000700 1 -- start start 2024-05-03T22:15:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.761+0000 7f6921000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f691c109ad0 0x7f691c19ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.761+0000 7f6921000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c10a490 0x7f691c1a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.761+0000 7f6921000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f691c10fb60 0x7f691c1a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.761+0000 7f6921000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f691c119bd0 con 0x7f691c10a490 2024-05-03T22:15:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.761+0000 7f6921000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f691c119a50 con 0x7f691c109ad0 2024-05-03T22:15:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.761+0000 7f6921000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f691c119d50 con 0x7f691c10fb60 2024-05-03T22:15:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.761+0000 7f6919400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c10a490 0x7f691c1a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.761+0000 7f6919400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c10a490 0x7f691c1a0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40650/0 (socket says 172.21.15.82:40650) 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.761+0000 7f6919400700 1 -- 172.21.15.82:0/2421425728 learned_addr learned my addr 172.21.15.82:0/2421425728 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.762+0000 7f6919e00700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f691c109ad0 0x7f691c19ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.762+0000 7f691a800700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f691c10fb60 0x7f691c1a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.762+0000 7f6919400700 1 -- 172.21.15.82:0/2421425728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f691c10fb60 msgr2=0x7f691c1a4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.762+0000 7f6919400700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f691c10fb60 0x7f691c1a4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.762+0000 7f6919400700 1 -- 172.21.15.82:0/2421425728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f691c109ad0 msgr2=0x7f691c19ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.762+0000 7f6919400700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f691c109ad0 0x7f691c19ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.762+0000 7f6919400700 1 -- 172.21.15.82:0/2421425728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c1a4fd0 con 0x7f691c10a490 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.762+0000 7f691a800700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f691c10fb60 0x7f691c1a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.762+0000 7f6919400700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c10a490 0x7f691c1a0500 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f690800c9b0 tx=0x7f690800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.763+0000 7f6912a00700 1 -- 172.21.15.82:0/2421425728 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908007b00 con 0x7f691c10a490 2024-05-03T22:15:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.763+0000 7f6912a00700 1 -- 172.21.15.82:0/2421425728 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6908007ca0 con 0x7f691c10a490 2024-05-03T22:15:36.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.763+0000 7f6912a00700 1 -- 172.21.15.82:0/2421425728 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908018660 con 0x7f691c10a490 2024-05-03T22:15:36.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.763+0000 7f6921000700 1 -- 172.21.15.82:0/2421425728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691c1a5260 con 0x7f691c10a490 2024-05-03T22:15:36.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.763+0000 7f6921000700 1 -- 172.21.15.82:0/2421425728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691c1acb40 con 0x7f691c10a490 2024-05-03T22:15:36.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.764+0000 7f6921000700 1 -- 172.21.15.82:0/2421425728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f691c063c30 con 0x7f691c10a490 2024-05-03T22:15:36.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.767+0000 7f6912a00700 1 -- 172.21.15.82:0/2421425728 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f690800f450 con 0x7f691c10a490 2024-05-03T22:15:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.768+0000 7f6912a00700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f69000b2910 0x7f69000b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.768+0000 7f6912a00700 1 -- 172.21.15.82:0/2421425728 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f69080e2cc0 con 0x7f691c10a490 2024-05-03T22:15:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.768+0000 7f6919e00700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f69000b2910 0x7f69000b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.769+0000 7f6912a00700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315] conn(0x7f69000bdc10 0x7f69000c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.769+0000 7f6912a00700 1 -- 172.21.15.82:0/2421425728 --> [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6908007e50 con 0x7f69000bdc10 2024-05-03T22:15:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.769+0000 7f6912a00700 1 -- 172.21.15.82:0/2421425728 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f69080e3070 con 0x7f691c10a490 2024-05-03T22:15:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.769+0000 7f691a800700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315] conn(0x7f69000bdc10 0x7f69000c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.769+0000 7f6919e00700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f69000b2910 0x7f69000b4dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f690c005fd0 tx=0x7f690c005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:36.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.769+0000 7f691a800700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315] conn(0x7f69000bdc10 0x7f69000c0090 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:36.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.770+0000 7f6912a00700 1 -- 172.21.15.82:0/2421425728 <== osd.6 v2:172.21.15.82:6818/426224315 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6908007e50 con 0x7f69000bdc10 2024-05-03T22:15:36.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.788+0000 7f6921000700 1 -- 172.21.15.82:0/2421425728 --> [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f691c0640b0 con 0x7f69000bdc10 2024-05-03T22:15:36.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.789+0000 7f6912a00700 1 -- 172.21.15.82:0/2421425728 <== osd.6 v2:172.21.15.82:6818/426224315 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f691c0640b0 con 0x7f69000bdc10 2024-05-03T22:15:36.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.789+0000 7f6921000700 1 -- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315] conn(0x7f69000bdc10 msgr2=0x7f69000c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.789+0000 7f6921000700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315] conn(0x7f69000bdc10 0x7f69000c0090 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.790+0000 7f6921000700 1 -- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f69000b2910 msgr2=0x7f69000b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.790+0000 7f6921000700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f69000b2910 0x7f69000b4dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f690c005fd0 tx=0x7f690c005db0 comp rx=0 tx=0).stop 2024-05-03T22:15:36.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.790+0000 7f6921000700 1 -- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c10a490 msgr2=0x7f691c1a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:36.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.790+0000 7f6921000700 1 --2- 172.21.15.82:0/2421425728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f691c10a490 0x7f691c1a0500 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f690800c9b0 tx=0x7f690800cd70 comp rx=0 tx=0).stop 2024-05-03T22:15:36.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.790+0000 7f691a800700 1 -- 172.21.15.82:0/2421425728 reap_dead start 2024-05-03T22:15:36.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.790+0000 7f6921000700 1 -- 172.21.15.82:0/2421425728 shutdown_connections 2024-05-03T22:15:36.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.790+0000 7f6921000700 1 -- 172.21.15.82:0/2421425728 >> 172.21.15.82:0/2421425728 conn(0x7f691c076c70 msgr2=0x7f691c0771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:36.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.790+0000 7f6921000700 1 -- 172.21.15.82:0/2421425728 shutdown_connections 2024-05-03T22:15:36.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:36.790+0000 7f6921000700 1 -- 172.21.15.82:0/2421425728 wait complete. 2024-05-03T22:15:37.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.356+0000 7f48ddc00700 1 -- 172.21.15.82:0/3807197666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d8103750 msgr2=0x7f48d8103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:37.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.356+0000 7f48ddc00700 1 --2- 172.21.15.82:0/3807197666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d8103750 0x7f48d8103b30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f48c80099c0 tx=0x7f48c8009cd0 comp rx=0 tx=0).stop 2024-05-03T22:15:37.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.356+0000 7f48ddc00700 1 -- 172.21.15.82:0/3807197666 shutdown_connections 2024-05-03T22:15:37.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.356+0000 7f48ddc00700 1 --2- 172.21.15.82:0/3807197666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d8103750 0x7f48d8103b30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:37.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.356+0000 7f48ddc00700 1 --2- 172.21.15.82:0/3807197666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48d8108850 0x7f48d81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.356+0000 7f48ddc00700 1 --2- 172.21.15.82:0/3807197666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48d8104100 0x7f48d8108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.356+0000 7f48ddc00700 1 -- 172.21.15.82:0/3807197666 >> 172.21.15.82:0/3807197666 conn(0x7f48d807a600 msgr2=0x7f48d807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.356+0000 7f48ddc00700 1 -- 172.21.15.82:0/3807197666 shutdown_connections 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.356+0000 7f48ddc00700 1 -- 172.21.15.82:0/3807197666 wait complete. 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.357+0000 7f48ddc00700 1 Processor -- start 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.357+0000 7f48ddc00700 1 -- start start 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.358+0000 7f48ddc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d8103750 0x7f48d81a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.358+0000 7f48ddc00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48d8104100 0x7f48d81a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.358+0000 7f48ddc00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48d8108850 0x7f48d819bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.358+0000 7f48ddc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f48d81135b0 con 0x7f48d8103750 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.358+0000 7f48ddc00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f48d8113430 con 0x7f48d8104100 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.358+0000 7f48ddc00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f48d8113730 con 0x7f48d8108850 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.358+0000 7f48d6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d8103750 0x7f48d81a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:37.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.358+0000 7f48d6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d8103750 0x7f48d81a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40682/0 (socket says 172.21.15.82:40682) 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.358+0000 7f48d6a00700 1 -- 172.21.15.82:0/3889721101 learned_addr learned my addr 172.21.15.82:0/3889721101 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48d6000700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48d8104100 0x7f48d81a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48d7400700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48d8108850 0x7f48d819bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48d6a00700 1 -- 172.21.15.82:0/3889721101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48d8108850 msgr2=0x7f48d819bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48d6a00700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48d8108850 0x7f48d819bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48d6a00700 1 -- 172.21.15.82:0/3889721101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48d8104100 msgr2=0x7f48d81a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48d6a00700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48d8104100 0x7f48d81a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48d6a00700 1 -- 172.21.15.82:0/3889721101 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d819c3f0 con 0x7f48d8103750 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48d6000700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48d8104100 0x7f48d81a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48d7400700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48d8108850 0x7f48d819bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48d6a00700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d8103750 0x7f48d81a1a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f48c80036f0 tx=0x7f48c800f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48cf400700 1 -- 172.21.15.82:0/3889721101 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8026070 con 0x7f48d8103750 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48cf400700 1 -- 172.21.15.82:0/3889721101 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48c8021410 con 0x7f48d8103750 2024-05-03T22:15:37.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48cf400700 1 -- 172.21.15.82:0/3889721101 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8017650 con 0x7f48d8103750 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.359+0000 7f48ddc00700 1 -- 172.21.15.82:0/3889721101 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d819c680 con 0x7f48d8103750 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.360+0000 7f48ddc00700 1 -- 172.21.15.82:0/3889721101 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d81a87f0 con 0x7f48d8103750 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.361+0000 7f48ddc00700 1 -- 172.21.15.82:0/3889721101 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f48d8102010 con 0x7f48d8103750 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.363+0000 7f48cf400700 1 -- 172.21.15.82:0/3889721101 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f48c80215c0 con 0x7f48d8103750 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.365+0000 7f48cf400700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f48bc0b2910 0x7f48bc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.365+0000 7f48cf400700 1 -- 172.21.15.82:0/3889721101 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f48c80e3b30 con 0x7f48d8103750 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.365+0000 7f48d6000700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f48bc0b2910 0x7f48bc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.365+0000 7f48cf400700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581] conn(0x7f48bc0bdc10 0x7f48bc0c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.365+0000 7f48cf400700 1 -- 172.21.15.82:0/3889721101 --> [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48c8020ec0 con 0x7f48bc0bdc10 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.365+0000 7f48cf400700 1 -- 172.21.15.82:0/3889721101 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f48c80e3f80 con 0x7f48d8103750 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.366+0000 7f48d6000700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f48bc0b2910 0x7f48bc0b4dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f48d819d260 tx=0x7f48c4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:37.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.386+0000 7f48d7400700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581] conn(0x7f48bc0bdc10 0x7f48bc0c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.387+0000 7f48d7400700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581] conn(0x7f48bc0bdc10 0x7f48bc0c0090 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.390+0000 7f48cf400700 1 -- 172.21.15.82:0/3889721101 <== osd.8 v2:172.21.15.130:6816/135638581 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48c8020ec0 con 0x7f48bc0bdc10 2024-05-03T22:15:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.407+0000 7f48ddc00700 1 -- 172.21.15.82:0/3889721101 --> [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f48d8104be0 con 0x7f48bc0bdc10 2024-05-03T22:15:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.408+0000 7f48cf400700 1 -- 172.21.15.82:0/3889721101 <== osd.8 v2:172.21.15.130:6816/135638581 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f48d8104be0 con 0x7f48bc0bdc10 2024-05-03T22:15:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.409+0000 7f48ddc00700 1 -- 172.21.15.82:0/3889721101 >> [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581] conn(0x7f48bc0bdc10 msgr2=0x7f48bc0c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.409+0000 7f48ddc00700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581] conn(0x7f48bc0bdc10 0x7f48bc0c0090 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.409+0000 7f48ddc00700 1 -- 172.21.15.82:0/3889721101 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f48bc0b2910 msgr2=0x7f48bc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:37.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.409+0000 7f48ddc00700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f48bc0b2910 0x7f48bc0b4dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f48d819d260 tx=0x7f48c4008040 comp rx=0 tx=0).stop 2024-05-03T22:15:37.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.409+0000 7f48ddc00700 1 -- 172.21.15.82:0/3889721101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d8103750 msgr2=0x7f48d81a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:37.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.409+0000 7f48ddc00700 1 --2- 172.21.15.82:0/3889721101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d8103750 0x7f48d81a1a40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f48c80036f0 tx=0x7f48c800f510 comp rx=0 tx=0).stop 2024-05-03T22:15:37.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.409+0000 7f48d7400700 1 -- 172.21.15.82:0/3889721101 reap_dead start 2024-05-03T22:15:37.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.410+0000 7f48ddc00700 1 -- 172.21.15.82:0/3889721101 shutdown_connections 2024-05-03T22:15:37.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.410+0000 7f48ddc00700 1 -- 172.21.15.82:0/3889721101 >> 172.21.15.82:0/3889721101 conn(0x7f48d807a600 msgr2=0x7f48d81015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:37.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.410+0000 7f48ddc00700 1 -- 172.21.15.82:0/3889721101 shutdown_connections 2024-05-03T22:15:37.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.410+0000 7f48ddc00700 1 -- 172.21.15.82:0/3889721101 wait complete. 2024-05-03T22:15:37.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:37 smithi082 ceph-mon[28404]: pgmap v472: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:15:38.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:37 smithi116 ceph-mon[31828]: pgmap v472: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:15:38.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:37 smithi130 ceph-mon[32417]: pgmap v472: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:15:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.103+0000 7fdc94600700 1 -- 172.21.15.82:0/4270120686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8c1056c0 msgr2=0x7fdc8c105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.103+0000 7fdc94600700 1 --2- 172.21.15.82:0/4270120686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c105b40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009990 tx=0x7fdc78009ca0 comp rx=0 tx=0).stop 2024-05-03T22:15:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.103+0000 7fdc94600700 1 -- 172.21.15.82:0/4270120686 shutdown_connections 2024-05-03T22:15:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.103+0000 7fdc94600700 1 --2- 172.21.15.82:0/4270120686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc8c106080 0x7fdc8c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.103+0000 7fdc94600700 1 --2- 172.21.15.82:0/4270120686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc8c10b6c0 0x7fdc8c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.103+0000 7fdc94600700 1 --2- 172.21.15.82:0/4270120686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c105b40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.103+0000 7fdc94600700 1 -- 172.21.15.82:0/4270120686 >> 172.21.15.82:0/4270120686 conn(0x7fdc8c1011b0 msgr2=0x7fdc8c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.103+0000 7fdc94600700 1 -- 172.21.15.82:0/4270120686 shutdown_connections 2024-05-03T22:15:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.103+0000 7fdc94600700 1 -- 172.21.15.82:0/4270120686 wait complete. 2024-05-03T22:15:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.103+0000 7fdc94600700 1 Processor -- start 2024-05-03T22:15:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.103+0000 7fdc94600700 1 -- start start 2024-05-03T22:15:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc94600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c1a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc94600700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc8c106080 0x7fdc8c1a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc94600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc8c10b6c0 0x7fdc8c19bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc94600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c115800 con 0x7fdc8c1056c0 2024-05-03T22:15:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc94600700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c115680 con 0x7fdc8c106080 2024-05-03T22:15:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc94600700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c115980 con 0x7fdc8c10b6c0 2024-05-03T22:15:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc91c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c1a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc91c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c1a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40664/0 (socket says 172.21.15.82:40664) 2024-05-03T22:15:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc91c00700 1 -- 172.21.15.82:0/3676199378 learned_addr learned my addr 172.21.15.82:0/3676199378 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc91200700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc8c106080 0x7fdc8c1a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc92600700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc8c10b6c0 0x7fdc8c19bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc91c00700 1 -- 172.21.15.82:0/3676199378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc8c10b6c0 msgr2=0x7fdc8c19bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc91c00700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc8c10b6c0 0x7fdc8c19bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc91c00700 1 -- 172.21.15.82:0/3676199378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc8c106080 msgr2=0x7fdc8c1a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc91c00700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc8c106080 0x7fdc8c1a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc91c00700 1 -- 172.21.15.82:0/3676199378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c19c240 con 0x7fdc8c1056c0 2024-05-03T22:15:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc91c00700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c1a1920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000d950 tx=0x7fdc8000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc8a000700 1 -- 172.21.15.82:0/3676199378 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc80016070 con 0x7fdc8c1056c0 2024-05-03T22:15:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc94600700 1 -- 172.21.15.82:0/3676199378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8c19c530 con 0x7fdc8c1056c0 2024-05-03T22:15:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc8a000700 1 -- 172.21.15.82:0/3676199378 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc80010460 con 0x7fdc8c1056c0 2024-05-03T22:15:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc8a000700 1 -- 172.21.15.82:0/3676199378 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8000f620 con 0x7fdc8c1056c0 2024-05-03T22:15:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc94600700 1 -- 172.21.15.82:0/3676199378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8c1a87f0 con 0x7fdc8c1056c0 2024-05-03T22:15:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.108+0000 7fdc94600700 1 -- 172.21.15.82:0/3676199378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc8c063c30 con 0x7fdc8c1056c0 2024-05-03T22:15:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.114+0000 7fdc8a000700 1 -- 172.21.15.82:0/3676199378 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fdc80019070 con 0x7fdc8c1056c0 2024-05-03T22:15:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.115+0000 7fdc8a000700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fdc740b2910 0x7fdc740b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.115+0000 7fdc8a000700 1 -- 172.21.15.82:0/3676199378 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fdc800e2870 con 0x7fdc8c1056c0 2024-05-03T22:15:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.115+0000 7fdc91200700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fdc740b2910 0x7fdc740b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.115+0000 7fdc8a000700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056] conn(0x7fdc740bdc10 0x7fdc740c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.115+0000 7fdc8a000700 1 -- 172.21.15.82:0/3676199378 --> [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc740c0760 con 0x7fdc740bdc10 2024-05-03T22:15:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.115+0000 7fdc8a000700 1 -- 172.21.15.82:0/3676199378 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fdc800e2c20 con 0x7fdc8c1056c0 2024-05-03T22:15:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.115+0000 7fdc91200700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fdc740b2910 0x7fdc740b4dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c103890 tx=0x7fdc7801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.115+0000 7fdc92600700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056] conn(0x7fdc740bdc10 0x7fdc740c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.115+0000 7fdc92600700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056] conn(0x7fdc740bdc10 0x7fdc740c0090 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.115+0000 7fdc8a000700 1 -- 172.21.15.82:0/3676199378 <== osd.7 v2:172.21.15.116:6816/918923056 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc740c0760 con 0x7fdc740bdc10 2024-05-03T22:15:38.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.142+0000 7fdc94600700 1 -- 172.21.15.82:0/3676199378 --> [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc8c064030 con 0x7fdc740bdc10 2024-05-03T22:15:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.143+0000 7fdc8a000700 1 -- 172.21.15.82:0/3676199378 <== osd.7 v2:172.21.15.116:6816/918923056 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdc8c064030 con 0x7fdc740bdc10 2024-05-03T22:15:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.144+0000 7fdc94600700 1 -- 172.21.15.82:0/3676199378 >> [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056] conn(0x7fdc740bdc10 msgr2=0x7fdc740c0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.144+0000 7fdc94600700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056] conn(0x7fdc740bdc10 0x7fdc740c0090 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.144+0000 7fdc94600700 1 -- 172.21.15.82:0/3676199378 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fdc740b2910 msgr2=0x7fdc740b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.144+0000 7fdc94600700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fdc740b2910 0x7fdc740b4dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c103890 tx=0x7fdc7801a040 comp rx=0 tx=0).stop 2024-05-03T22:15:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.144+0000 7fdc94600700 1 -- 172.21.15.82:0/3676199378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8c1056c0 msgr2=0x7fdc8c1a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.144+0000 7fdc94600700 1 --2- 172.21.15.82:0/3676199378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc8c1056c0 0x7fdc8c1a1920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000d950 tx=0x7fdc8000dd10 comp rx=0 tx=0).stop 2024-05-03T22:15:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.144+0000 7fdc92600700 1 -- 172.21.15.82:0/3676199378 reap_dead start 2024-05-03T22:15:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.144+0000 7fdc94600700 1 -- 172.21.15.82:0/3676199378 shutdown_connections 2024-05-03T22:15:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.144+0000 7fdc94600700 1 -- 172.21.15.82:0/3676199378 >> 172.21.15.82:0/3676199378 conn(0x7fdc8c1011b0 msgr2=0x7fdc8c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.144+0000 7fdc94600700 1 -- 172.21.15.82:0/3676199378 shutdown_connections 2024-05-03T22:15:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:37.144+0000 7fdc94600700 1 -- 172.21.15.82:0/3676199378 wait complete. 2024-05-03T22:15:39.693 INFO:teuthology.orchestra.run.smithi082.stdout:236223201358 2024-05-03T22:15:39.693 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-03T22:15:39.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:39 smithi082 ceph-mon[28404]: pgmap v473: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:15:40.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:39 smithi116 ceph-mon[31828]: pgmap v473: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:15:40.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:39 smithi130 ceph-mon[32417]: pgmap v473: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:15:40.363 INFO:teuthology.orchestra.run.smithi082.stdout:111669149809 2024-05-03T22:15:40.363 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-03T22:15:40.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.793+0000 7fc7cf800700 1 -- 172.21.15.82:0/13624041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c810fea0 msgr2=0x7fc7c8112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:40.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.793+0000 7fc7cf800700 1 --2- 172.21.15.82:0/13624041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c810fea0 0x7fc7c8112290 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000b0a0 tx=0x7fc7c000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:15:40.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.794+0000 7fc7cf800700 1 -- 172.21.15.82:0/13624041 shutdown_connections 2024-05-03T22:15:40.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.794+0000 7fc7cf800700 1 --2- 172.21.15.82:0/13624041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c810fea0 0x7fc7c8112290 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:40.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.794+0000 7fc7cf800700 1 --2- 172.21.15.82:0/13624041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7c80756d0 0x7fc7c8075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:40.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.794+0000 7fc7cf800700 1 --2- 172.21.15.82:0/13624041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c8075ff0 0x7fc7c810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.794+0000 7fc7cf800700 1 -- 172.21.15.82:0/13624041 >> 172.21.15.82:0/13624041 conn(0x7fc7c807a600 msgr2=0x7fc7c807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.794+0000 7fc7cf800700 1 -- 172.21.15.82:0/13624041 shutdown_connections 2024-05-03T22:15:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.794+0000 7fc7cf800700 1 -- 172.21.15.82:0/13624041 wait complete. 2024-05-03T22:15:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.795+0000 7fc7cf800700 1 Processor -- start 2024-05-03T22:15:40.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.796+0000 7fc7cf800700 1 -- start start 2024-05-03T22:15:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.796+0000 7fc7cf800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7c80756d0 0x7fc7c81a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.796+0000 7fc7cf800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8075ff0 0x7fc7c81a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.796+0000 7fc7cf800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c810fea0 0x7fc7c819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.796+0000 7fc7cf800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8115730 con 0x7fc7c8075ff0 2024-05-03T22:15:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.796+0000 7fc7cf800700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81155b0 con 0x7fc7c810fea0 2024-05-03T22:15:40.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.796+0000 7fc7cf800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c81158b0 con 0x7fc7c80756d0 2024-05-03T22:15:40.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.797+0000 7fc7c7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8075ff0 0x7fc7c81a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.797+0000 7fc7c7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8075ff0 0x7fc7c81a1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40706/0 (socket says 172.21.15.82:40706) 2024-05-03T22:15:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.797+0000 7fc7c7e00700 1 -- 172.21.15.82:0/2338514016 learned_addr learned my addr 172.21.15.82:0/2338514016 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.797+0000 7fc7cce00700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7c80756d0 0x7fc7c81a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.797+0000 7fc7cd800700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c810fea0 0x7fc7c819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.797+0000 7fc7c7e00700 1 -- 172.21.15.82:0/2338514016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7c80756d0 msgr2=0x7fc7c81a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.797+0000 7fc7c7e00700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7c80756d0 0x7fc7c81a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.797+0000 7fc7c7e00700 1 -- 172.21.15.82:0/2338514016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c810fea0 msgr2=0x7fc7c819ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.797+0000 7fc7c7e00700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c810fea0 0x7fc7c819ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:40.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.797+0000 7fc7c7e00700 1 -- 172.21.15.82:0/2338514016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c819c190 con 0x7fc7c8075ff0 2024-05-03T22:15:40.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.797+0000 7fc7cd800700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c810fea0 0x7fc7c819ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:15:40.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.798+0000 7fc7c7e00700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8075ff0 0x7fc7c81a1db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400d980 tx=0x7fc7b400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:40.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.798+0000 7fc7c5600700 1 -- 172.21.15.82:0/2338514016 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4016070 con 0x7fc7c8075ff0 2024-05-03T22:15:40.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.798+0000 7fc7c5600700 1 -- 172.21.15.82:0/2338514016 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7b4004020 con 0x7fc7c8075ff0 2024-05-03T22:15:40.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.798+0000 7fc7cf800700 1 -- 172.21.15.82:0/2338514016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c819c480 con 0x7fc7c8075ff0 2024-05-03T22:15:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.798+0000 7fc7c5600700 1 -- 172.21.15.82:0/2338514016 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4004bb0 con 0x7fc7c8075ff0 2024-05-03T22:15:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.798+0000 7fc7cf800700 1 -- 172.21.15.82:0/2338514016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c81a8740 con 0x7fc7c8075ff0 2024-05-03T22:15:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.799+0000 7fc7cf800700 1 -- 172.21.15.82:0/2338514016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7c8063c30 con 0x7fc7c8075ff0 2024-05-03T22:15:40.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.804+0000 7fc7c5600700 1 -- 172.21.15.82:0/2338514016 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc7b400bb60 con 0x7fc7c8075ff0 2024-05-03T22:15:40.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.805+0000 7fc7c5600700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc7b00b2990 0x7fc7b00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:40.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.805+0000 7fc7c5600700 1 -- 172.21.15.82:0/2338514016 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fc7b40e2540 con 0x7fc7c8075ff0 2024-05-03T22:15:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.806+0000 7fc7cce00700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc7b00b2990 0x7fc7b00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.806+0000 7fc7c5600700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669] conn(0x7fc7b00bdc90 0x7fc7b00c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.806+0000 7fc7c5600700 1 -- 172.21.15.82:0/2338514016 --> [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7b400be50 con 0x7fc7b00bdc90 2024-05-03T22:15:40.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.806+0000 7fc7c5600700 1 -- 172.21.15.82:0/2338514016 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fc7b40e9050 con 0x7fc7c8075ff0 2024-05-03T22:15:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.806+0000 7fc7cd800700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669] conn(0x7fc7b00bdc90 0x7fc7b00c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.807+0000 7fc7cce00700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc7b00b2990 0x7fc7b00b4e50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc005950 tx=0x7fc7bc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.807+0000 7fc7cd800700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669] conn(0x7fc7b00bdc90 0x7fc7b00c0110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:40.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.808+0000 7fc7c5600700 1 -- 172.21.15.82:0/2338514016 <== osd.9 v2:172.21.15.82:6826/3321139669 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc7b400be50 con 0x7fc7b00bdc90 2024-05-03T22:15:40.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.827+0000 7fc7cf800700 1 -- 172.21.15.82:0/2338514016 --> [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc7c8064030 con 0x7fc7b00bdc90 2024-05-03T22:15:40.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.827+0000 7fc7c5600700 1 -- 172.21.15.82:0/2338514016 <== osd.9 v2:172.21.15.82:6826/3321139669 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc7c8064030 con 0x7fc7b00bdc90 2024-05-03T22:15:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.828+0000 7fc7cf800700 1 -- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669] conn(0x7fc7b00bdc90 msgr2=0x7fc7b00c0110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.828+0000 7fc7cf800700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669] conn(0x7fc7b00bdc90 0x7fc7b00c0110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.828+0000 7fc7cf800700 1 -- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc7b00b2990 msgr2=0x7fc7b00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.828+0000 7fc7cf800700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc7b00b2990 0x7fc7b00b4e50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc005950 tx=0x7fc7bc0058e0 comp rx=0 tx=0).stop 2024-05-03T22:15:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.828+0000 7fc7cf800700 1 -- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8075ff0 msgr2=0x7fc7c81a1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.828+0000 7fc7cf800700 1 --2- 172.21.15.82:0/2338514016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7c8075ff0 0x7fc7c81a1db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400d980 tx=0x7fc7b400dd40 comp rx=0 tx=0).stop 2024-05-03T22:15:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.828+0000 7fc7cd800700 1 -- 172.21.15.82:0/2338514016 reap_dead start 2024-05-03T22:15:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.828+0000 7fc7cf800700 1 -- 172.21.15.82:0/2338514016 shutdown_connections 2024-05-03T22:15:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.828+0000 7fc7cf800700 1 -- 172.21.15.82:0/2338514016 >> 172.21.15.82:0/2338514016 conn(0x7fc7c807a600 msgr2=0x7fc7c8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.828+0000 7fc7cf800700 1 -- 172.21.15.82:0/2338514016 shutdown_connections 2024-05-03T22:15:40.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:40.828+0000 7fc7cf800700 1 -- 172.21.15.82:0/2338514016 wait complete. 2024-05-03T22:15:41.214 INFO:teuthology.orchestra.run.smithi082.stdout:188978561116 2024-05-03T22:15:41.214 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-03T22:15:41.698 INFO:teuthology.orchestra.run.smithi082.stdout:210453397589 2024-05-03T22:15:41.698 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-03T22:15:41.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:41 smithi082 ceph-mon[28404]: pgmap v474: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:42.187 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:41 smithi116 ceph-mon[31828]: pgmap v474: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:42.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:41 smithi130 ceph-mon[32417]: pgmap v474: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:42.605 INFO:teuthology.orchestra.run.smithi082.stdout:261993005126 2024-05-03T22:15:42.606 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-03T22:15:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:42.675 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:43.314 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:43.315 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:44.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:43 smithi116 ceph-mon[31828]: pgmap v475: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:44.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:43 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:15:44.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:43 smithi082 ceph-mon[28404]: pgmap v475: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:44.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:43 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:15:44.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:43 smithi130 ceph-mon[32417]: pgmap v475: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:44.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:43 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:15:45.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:44 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:15:45.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:44 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:15:45.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:44 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:15:45.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:44 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:15:45.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:44 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:15:45.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:44 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:15:45.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:44 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:15:45.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:44 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:15:45.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:44 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:15:46.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:45 smithi082 ceph-mon[28404]: pgmap v476: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-03T22:15:46.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:45 smithi116 ceph-mon[31828]: pgmap v476: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-03T22:15:46.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:45 smithi130 ceph-mon[32417]: pgmap v476: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-03T22:15:47.860 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:47.865 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:47.868 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:48.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:47 smithi082 ceph-mon[28404]: pgmap v477: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:48.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:47 smithi116 ceph-mon[31828]: pgmap v477: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:48.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:47 smithi130 ceph-mon[32417]: pgmap v477: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:50.128 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:49 smithi082 ceph-mon[28404]: pgmap v478: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T22:15:50.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:49 smithi116 ceph-mon[31828]: pgmap v478: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T22:15:50.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:49 smithi130 ceph-mon[32417]: pgmap v478: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T22:15:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.399+0000 7f3b75400700 1 -- 172.21.15.82:0/3657731476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b70075ff0 msgr2=0x7f3b70114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.399+0000 7f3b75400700 1 --2- 172.21.15.82:0/3657731476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b70075ff0 0x7f3b70114130 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009990 tx=0x7f3b58009ca0 comp rx=0 tx=0).stop 2024-05-03T22:15:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.399+0000 7f3b75400700 1 -- 172.21.15.82:0/3657731476 shutdown_connections 2024-05-03T22:15:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.399+0000 7f3b75400700 1 --2- 172.21.15.82:0/3657731476 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b70114670 0x7f3b70116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.399+0000 7f3b75400700 1 --2- 172.21.15.82:0/3657731476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b700756d0 0x7f3b70075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.399+0000 7f3b75400700 1 --2- 172.21.15.82:0/3657731476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b70075ff0 0x7f3b70114130 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.399+0000 7f3b75400700 1 -- 172.21.15.82:0/3657731476 >> 172.21.15.82:0/3657731476 conn(0x7f3b7007a600 msgr2=0x7f3b7007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.399+0000 7f3b75400700 1 -- 172.21.15.82:0/3657731476 shutdown_connections 2024-05-03T22:15:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.399+0000 7f3b75400700 1 -- 172.21.15.82:0/3657731476 wait complete. 2024-05-03T22:15:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.401+0000 7f3b75400700 1 Processor -- start 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.401+0000 7f3b75400700 1 -- start start 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.401+0000 7f3b75400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b700756d0 0x7f3b701a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b75400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b70075ff0 0x7f3b701a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b75400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b70114670 0x7f3b701a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b75400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70119b30 con 0x7f3b700756d0 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b75400700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701199b0 con 0x7f3b70075ff0 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b75400700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70119cb0 con 0x7f3b70114670 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b6e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b700756d0 0x7f3b701a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b6e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b700756d0 0x7f3b701a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36400/0 (socket says 172.21.15.82:36400) 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b6e800700 1 -- 172.21.15.82:0/1725753375 learned_addr learned my addr 172.21.15.82:0/1725753375 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b6f200700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b70114670 0x7f3b701a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b65e00700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b70075ff0 0x7f3b701a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:51.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b6e800700 1 -- 172.21.15.82:0/1725753375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b70114670 msgr2=0x7f3b701a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b6e800700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b70114670 0x7f3b701a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b6e800700 1 -- 172.21.15.82:0/1725753375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b70075ff0 msgr2=0x7f3b701a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b6e800700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b70075ff0 0x7f3b701a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.402+0000 7f3b6e800700 1 -- 172.21.15.82:0/1725753375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b701a5030 con 0x7f3b700756d0 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.403+0000 7f3b6e800700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b700756d0 0x7f3b701a0020 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000c9b0 tx=0x7f3b6000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.403+0000 7f3b67e00700 1 -- 172.21.15.82:0/1725753375 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60007b00 con 0x7f3b700756d0 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.403+0000 7f3b67e00700 1 -- 172.21.15.82:0/1725753375 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b60007ca0 con 0x7f3b700756d0 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.403+0000 7f3b75400700 1 -- 172.21.15.82:0/1725753375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b701a5320 con 0x7f3b700756d0 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.403+0000 7f3b67e00700 1 -- 172.21.15.82:0/1725753375 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60018660 con 0x7f3b700756d0 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.403+0000 7f3b75400700 1 -- 172.21.15.82:0/1725753375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b701acba0 con 0x7f3b700756d0 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.404+0000 7f3b75400700 1 -- 172.21.15.82:0/1725753375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b7006a190 con 0x7f3b700756d0 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.407+0000 7f3b67e00700 1 -- 172.21.15.82:0/1725753375 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3b6000f450 con 0x7f3b700756d0 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.408+0000 7f3b67e00700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3b540b2910 0x7f3b540b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.408+0000 7f3b67e00700 1 -- 172.21.15.82:0/1725753375 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f3b600e2b50 con 0x7f3b700756d0 2024-05-03T22:15:51.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.408+0000 7f3b65e00700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3b540b2910 0x7f3b540b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:51.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.409+0000 7f3b65e00700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3b540b2910 0x7f3b540b4dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3b58005850 tx=0x7f3b5801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:51.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.413+0000 7f3b67e00700 1 -- 172.21.15.82:0/1725753375 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3b60014030 con 0x7f3b700756d0 2024-05-03T22:15:51.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.654+0000 7f3b75400700 1 -- 172.21.15.82:0/1725753375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f3b701a1380 con 0x7f3b700756d0 2024-05-03T22:15:51.017 INFO:teuthology.orchestra.run.smithi082.stdout:287762808898 2024-05-03T22:15:51.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.655+0000 7f3b67e00700 1 -- 172.21.15.82:0/1725753375 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3b600aa380 con 0x7f3b700756d0 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.658+0000 7f3b75400700 1 -- 172.21.15.82:0/1725753375 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3b540b2910 msgr2=0x7f3b540b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.658+0000 7f3b75400700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3b540b2910 0x7f3b540b4dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3b58005850 tx=0x7f3b5801a040 comp rx=0 tx=0).stop 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.658+0000 7f3b75400700 1 -- 172.21.15.82:0/1725753375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b700756d0 msgr2=0x7f3b701a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.658+0000 7f3b75400700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b700756d0 0x7f3b701a0020 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000c9b0 tx=0x7f3b6000cd70 comp rx=0 tx=0).stop 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.658+0000 7f3b75400700 1 -- 172.21.15.82:0/1725753375 shutdown_connections 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.658+0000 7f3b75400700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3b540b2910 0x7f3b540b4dd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.658+0000 7f3b75400700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b700756d0 0x7f3b701a0020 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.658+0000 7f3b75400700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b70114670 0x7f3b701a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.658+0000 7f3b75400700 1 --2- 172.21.15.82:0/1725753375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b70075ff0 0x7f3b701a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.658+0000 7f3b75400700 1 -- 172.21.15.82:0/1725753375 >> 172.21.15.82:0/1725753375 conn(0x7f3b7007a600 msgr2=0x7f3b70110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.659+0000 7f3b75400700 1 -- 172.21.15.82:0/1725753375 shutdown_connections 2024-05-03T22:15:51.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:50.659+0000 7f3b75400700 1 -- 172.21.15.82:0/1725753375 wait complete. 2024-05-03T22:15:51.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:50 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1725753375' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-03T22:15:51.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:50 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1725753375' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-03T22:15:51.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:50 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1725753375' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-03T22:15:51.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:51 smithi082 ceph-mon[28404]: pgmap v479: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:52.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:51 smithi130 ceph-mon[32417]: pgmap v479: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:52.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:51 smithi116 ceph-mon[31828]: pgmap v479: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:15:53.300 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:53.307 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:15:54.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:53 smithi082 ceph-mon[28404]: pgmap v480: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:15:54.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:53 smithi130 ceph-mon[32417]: pgmap v480: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:15:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.306+0000 7f3067e00700 1 -- 172.21.15.82:0/596396751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306806c3d0 msgr2=0x7f30681102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.306+0000 7f3067e00700 1 --2- 172.21.15.82:0/596396751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306806c3d0 0x7f30681102a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f306000b0a0 tx=0x7f306000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:15:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.306+0000 7f3067e00700 1 -- 172.21.15.82:0/596396751 shutdown_connections 2024-05-03T22:15:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.306+0000 7f3067e00700 1 --2- 172.21.15.82:0/596396751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306806c3d0 0x7f30681102a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.306+0000 7f3067e00700 1 --2- 172.21.15.82:0/596396751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3068109510 0x7f30681098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.306+0000 7f3067e00700 1 --2- 172.21.15.82:0/596396751 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f306806ba10 0x7f306806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.306+0000 7f3067e00700 1 -- 172.21.15.82:0/596396751 >> 172.21.15.82:0/596396751 conn(0x7f30680791e0 msgr2=0x7f30680795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.306+0000 7f3067e00700 1 -- 172.21.15.82:0/596396751 shutdown_connections 2024-05-03T22:15:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.306+0000 7f3067e00700 1 -- 172.21.15.82:0/596396751 wait complete. 2024-05-03T22:15:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.308+0000 7f3067e00700 1 Processor -- start 2024-05-03T22:15:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.308+0000 7f3067e00700 1 -- start start 2024-05-03T22:15:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.308+0000 7f3067e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f306806ba10 0x7f30681a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.308+0000 7f3067e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306806c3d0 0x7f30681a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.308+0000 7f3067e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3068109510 0x7f306819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.308+0000 7f3067e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f30681134b0 con 0x7f306806c3d0 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.308+0000 7f3067e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3068113330 con 0x7f306806ba10 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.308+0000 7f3067e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3068113630 con 0x7f3068109510 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.309+0000 7f3066000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306806c3d0 0x7f30681a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.309+0000 7f3066000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306806c3d0 0x7f30681a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51252/0 (socket says 172.21.15.82:51252) 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.309+0000 7f3066000700 1 -- 172.21.15.82:0/2995692677 learned_addr learned my addr 172.21.15.82:0/2995692677 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.309+0000 7f3066000700 1 -- 172.21.15.82:0/2995692677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3068109510 msgr2=0x7f306819ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.309+0000 7f3066000700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3068109510 0x7f306819ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.309+0000 7f3066a00700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f306806ba10 0x7f30681a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.309+0000 7f3066000700 1 -- 172.21.15.82:0/2995692677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f306806ba10 msgr2=0x7f30681a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.309+0000 7f3066000700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f306806ba10 0x7f30681a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.309+0000 7f3066000700 1 -- 172.21.15.82:0/2995692677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306819c1d0 con 0x7f306806c3d0 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.309+0000 7f3066000700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306806c3d0 0x7f30681a1da0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f305400b550 tx=0x7f305400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.310+0000 7f305f400700 1 -- 172.21.15.82:0/2995692677 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3054015020 con 0x7f306806c3d0 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.310+0000 7f305f400700 1 -- 172.21.15.82:0/2995692677 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3054011cc0 con 0x7f306806c3d0 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.310+0000 7f3067e00700 1 -- 172.21.15.82:0/2995692677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306819c4c0 con 0x7f306806c3d0 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.310+0000 7f305f400700 1 -- 172.21.15.82:0/2995692677 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3054010ca0 con 0x7f306806c3d0 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.310+0000 7f3067e00700 1 -- 172.21.15.82:0/2995692677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30681a8730 con 0x7f306806c3d0 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.311+0000 7f3067e00700 1 -- 172.21.15.82:0/2995692677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306806a190 con 0x7f306806c3d0 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.314+0000 7f305f400700 1 -- 172.21.15.82:0/2995692677 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3054018020 con 0x7f306806c3d0 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.316+0000 7f305f400700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f304c0b2910 0x7f304c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.316+0000 7f305f400700 1 -- 172.21.15.82:0/2995692677 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f30540e1eb0 con 0x7f306806c3d0 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.316+0000 7f3066a00700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f304c0b2910 0x7f304c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.317+0000 7f3066a00700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f304c0b2910 0x7f304c0b4dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3058005950 tx=0x7f30580058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:54.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.321+0000 7f305f400700 1 -- 172.21.15.82:0/2995692677 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f305401f020 con 0x7f306806c3d0 2024-05-03T22:15:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:53 smithi116 ceph-mon[31828]: pgmap v480: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:15:54.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.557+0000 7f3067e00700 1 -- 172.21.15.82:0/2995692677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f306819cf50 con 0x7f306806c3d0 2024-05-03T22:15:54.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.558+0000 7f305f400700 1 -- 172.21.15.82:0/2995692677 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f30540a9760 con 0x7f306806c3d0 2024-05-03T22:15:54.560 INFO:teuthology.orchestra.run.smithi082.stdout:137438953582 2024-05-03T22:15:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.561+0000 7f3067e00700 1 -- 172.21.15.82:0/2995692677 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f304c0b2910 msgr2=0x7f304c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.561+0000 7f3067e00700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f304c0b2910 0x7f304c0b4dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3058005950 tx=0x7f30580058e0 comp rx=0 tx=0).stop 2024-05-03T22:15:54.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.561+0000 7f3067e00700 1 -- 172.21.15.82:0/2995692677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306806c3d0 msgr2=0x7f30681a1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:54.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.561+0000 7f3067e00700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306806c3d0 0x7f30681a1da0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f305400b550 tx=0x7f305400b910 comp rx=0 tx=0).stop 2024-05-03T22:15:54.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.561+0000 7f3067e00700 1 -- 172.21.15.82:0/2995692677 shutdown_connections 2024-05-03T22:15:54.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.561+0000 7f3067e00700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f304c0b2910 0x7f304c0b4dd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:54.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.561+0000 7f3067e00700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3068109510 0x7f306819ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:54.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.561+0000 7f3067e00700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f306806ba10 0x7f30681a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:54.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.561+0000 7f3067e00700 1 --2- 172.21.15.82:0/2995692677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306806c3d0 0x7f30681a1da0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:54.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.562+0000 7f3067e00700 1 -- 172.21.15.82:0/2995692677 >> 172.21.15.82:0/2995692677 conn(0x7f30680791e0 msgr2=0x7f306810e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:54.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.562+0000 7f3067e00700 1 -- 172.21.15.82:0/2995692677 shutdown_connections 2024-05-03T22:15:54.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:54.562+0000 7f3067e00700 1 -- 172.21.15.82:0/2995692677 wait complete. 2024-05-03T22:15:55.118 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:54 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2995692677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-03T22:15:55.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:54 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2995692677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-03T22:15:55.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:54 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2995692677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-03T22:15:56.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:55 smithi082 ceph-mon[28404]: pgmap v481: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:15:56.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:55 smithi130 ceph-mon[32417]: pgmap v481: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:15:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:55 smithi116 ceph-mon[31828]: pgmap v481: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:15:57.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:56 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/76486920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-03T22:15:57.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:56 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/76486920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-03T22:15:57.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:56 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/76486920' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-03T22:15:57.708 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808895 got 287762808898 for osd.10 2024-05-03T22:15:57.708 DEBUG:teuthology.parallel:result is None 2024-05-03T22:15:58.148 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:57 smithi082 ceph-mon[28404]: pgmap v482: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:15:58.214 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953576 got 137438953582 for osd.4 2024-05-03T22:15:58.214 DEBUG:teuthology.parallel:result is None 2024-05-03T22:15:58.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:57 smithi130 ceph-mon[32417]: pgmap v482: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:15:58.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:57 smithi116 ceph-mon[31828]: pgmap v482: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:15:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.798+0000 7f1c52e00700 1 -- 172.21.15.82:0/2997372678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c4c103750 msgr2=0x7f1c4c103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.798+0000 7f1c52e00700 1 --2- 172.21.15.82:0/2997372678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c4c103750 0x7f1c4c103b30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0099c0 tx=0x7f1c3c009cd0 comp rx=0 tx=0).stop 2024-05-03T22:15:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.799+0000 7f1c52e00700 1 -- 172.21.15.82:0/2997372678 shutdown_connections 2024-05-03T22:15:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.799+0000 7f1c52e00700 1 --2- 172.21.15.82:0/2997372678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c4c103750 0x7f1c4c103b30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.799+0000 7f1c52e00700 1 --2- 172.21.15.82:0/2997372678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c4c108850 0x7f1c4c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.799+0000 7f1c52e00700 1 --2- 172.21.15.82:0/2997372678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c4c104100 0x7f1c4c108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:58.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.799+0000 7f1c52e00700 1 -- 172.21.15.82:0/2997372678 >> 172.21.15.82:0/2997372678 conn(0x7f1c4c07a600 msgr2=0x7f1c4c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.799+0000 7f1c52e00700 1 -- 172.21.15.82:0/2997372678 shutdown_connections 2024-05-03T22:15:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.799+0000 7f1c52e00700 1 -- 172.21.15.82:0/2997372678 wait complete. 2024-05-03T22:15:58.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.800+0000 7f1c52e00700 1 Processor -- start 2024-05-03T22:15:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.800+0000 7f1c52e00700 1 -- start start 2024-05-03T22:15:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.801+0000 7f1c52e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c4c103750 0x7f1c4c1a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.801+0000 7f1c52e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c4c104100 0x7f1c4c1a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.801+0000 7f1c52e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c4c108850 0x7f1c4c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.801+0000 7f1c52e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c076110 con 0x7f1c4c108850 2024-05-03T22:15:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.801+0000 7f1c52e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c075f90 con 0x7f1c4c103750 2024-05-03T22:15:58.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.801+0000 7f1c52e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c076290 con 0x7f1c4c104100 2024-05-03T22:15:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.801+0000 7f1c50e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c4c108850 0x7f1c4c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.801+0000 7f1c50e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c4c108850 0x7f1c4c19bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51274/0 (socket says 172.21.15.82:51274) 2024-05-03T22:15:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.801+0000 7f1c50e00700 1 -- 172.21.15.82:0/3409278341 learned_addr learned my addr 172.21.15.82:0/3409278341 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:58.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.801+0000 7f1c4b400700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c4c104100 0x7f1c4c1a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.801+0000 7f1c4be00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c4c103750 0x7f1c4c1a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.802+0000 7f1c50e00700 1 -- 172.21.15.82:0/3409278341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c4c104100 msgr2=0x7f1c4c1a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.802+0000 7f1c50e00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c4c104100 0x7f1c4c1a0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.802+0000 7f1c50e00700 1 -- 172.21.15.82:0/3409278341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c4c103750 msgr2=0x7f1c4c1a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.802+0000 7f1c50e00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c4c103750 0x7f1c4c1a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.802+0000 7f1c50e00700 1 -- 172.21.15.82:0/3409278341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c19c380 con 0x7f1c4c108850 2024-05-03T22:15:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.802+0000 7f1c50e00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c4c108850 0x7f1c4c19bc00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400ada0 tx=0x7f1c4400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:58.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.803+0000 7f1c48c00700 1 -- 172.21.15.82:0/3409278341 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44017020 con 0x7f1c4c108850 2024-05-03T22:15:58.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.803+0000 7f1c48c00700 1 -- 172.21.15.82:0/3409278341 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c4400cd60 con 0x7f1c4c108850 2024-05-03T22:15:58.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.803+0000 7f1c48c00700 1 -- 172.21.15.82:0/3409278341 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44005280 con 0x7f1c4c108850 2024-05-03T22:15:58.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.803+0000 7f1c52e00700 1 -- 172.21.15.82:0/3409278341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4c19c670 con 0x7f1c4c108850 2024-05-03T22:15:58.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.803+0000 7f1c52e00700 1 -- 172.21.15.82:0/3409278341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4c1a8700 con 0x7f1c4c108850 2024-05-03T22:15:58.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.804+0000 7f1c52e00700 1 -- 172.21.15.82:0/3409278341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4c06a190 con 0x7f1c4c108850 2024-05-03T22:15:58.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.807+0000 7f1c48c00700 1 -- 172.21.15.82:0/3409278341 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1c4400c8d0 con 0x7f1c4c108850 2024-05-03T22:15:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.808+0000 7f1c48c00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1c300b2910 0x7f1c300b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.808+0000 7f1c48c00700 1 -- 172.21.15.82:0/3409278341 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f1c440e1f00 con 0x7f1c4c108850 2024-05-03T22:15:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.808+0000 7f1c4be00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1c300b2910 0x7f1c300b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.809+0000 7f1c4be00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1c300b2910 0x7f1c300b4dd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c19d220 tx=0x7f1c3c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:58.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:58.814+0000 7f1c48c00700 1 -- 172.21.15.82:0/3409278341 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1c44021020 con 0x7f1c4c108850 2024-05-03T22:15:59.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.058+0000 7f1c52e00700 1 -- 172.21.15.82:0/3409278341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f1c4c1a88d0 con 0x7f1c4c108850 2024-05-03T22:15:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.059+0000 7f1c48c00700 1 -- 172.21.15.82:0/3409278341 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f1c440a9790 con 0x7f1c4c108850 2024-05-03T22:15:59.061 INFO:teuthology.orchestra.run.smithi082.stdout:313532612667 2024-05-03T22:15:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.062+0000 7f1c52e00700 1 -- 172.21.15.82:0/3409278341 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1c300b2910 msgr2=0x7f1c300b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.062+0000 7f1c52e00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1c300b2910 0x7f1c300b4dd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c19d220 tx=0x7f1c3c01a040 comp rx=0 tx=0).stop 2024-05-03T22:15:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.062+0000 7f1c52e00700 1 -- 172.21.15.82:0/3409278341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c4c108850 msgr2=0x7f1c4c19bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.062+0000 7f1c52e00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c4c108850 0x7f1c4c19bc00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400ada0 tx=0x7f1c4400c330 comp rx=0 tx=0).stop 2024-05-03T22:15:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.063+0000 7f1c52e00700 1 -- 172.21.15.82:0/3409278341 shutdown_connections 2024-05-03T22:15:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.063+0000 7f1c52e00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1c300b2910 0x7f1c300b4dd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.063+0000 7f1c52e00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c4c108850 0x7f1c4c19bc00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.063+0000 7f1c52e00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c4c103750 0x7f1c4c1a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.063+0000 7f1c52e00700 1 --2- 172.21.15.82:0/3409278341 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c4c104100 0x7f1c4c1a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.063+0000 7f1c52e00700 1 -- 172.21.15.82:0/3409278341 >> 172.21.15.82:0/3409278341 conn(0x7f1c4c07a600 msgr2=0x7f1c4c077020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:59.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.063+0000 7f1c52e00700 1 -- 172.21.15.82:0/3409278341 shutdown_connections 2024-05-03T22:15:59.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.063+0000 7f1c52e00700 1 -- 172.21.15.82:0/3409278341 wait complete. 2024-05-03T22:15:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.109+0000 7faa2be00700 1 -- 172.21.15.82:0/1213813363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa241034f0 msgr2=0x7faa24103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.109+0000 7faa2be00700 1 --2- 172.21.15.82:0/1213813363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa241034f0 0x7faa24103970 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faa10009990 tx=0x7faa10009ca0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.109+0000 7faa2be00700 1 -- 172.21.15.82:0/1213813363 shutdown_connections 2024-05-03T22:15:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.109+0000 7faa2be00700 1 --2- 172.21.15.82:0/1213813363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa24103eb0 0x7faa24110390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.109+0000 7faa2be00700 1 --2- 172.21.15.82:0/1213813363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa24109600 0x7faa241099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.109+0000 7faa2be00700 1 --2- 172.21.15.82:0/1213813363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa241034f0 0x7faa24103970 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.109+0000 7faa2be00700 1 -- 172.21.15.82:0/1213813363 >> 172.21.15.82:0/1213813363 conn(0x7faa2407a650 msgr2=0x7faa2407aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.109+0000 7faa2be00700 1 -- 172.21.15.82:0/1213813363 shutdown_connections 2024-05-03T22:15:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.109+0000 7faa2be00700 1 -- 172.21.15.82:0/1213813363 wait complete. 2024-05-03T22:15:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.110+0000 7faa2be00700 1 Processor -- start 2024-05-03T22:15:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.110+0000 7faa2be00700 1 -- start start 2024-05-03T22:15:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.111+0000 7faa2be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa241034f0 0x7faa241a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.111+0000 7faa2be00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa24103eb0 0x7faa241a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.111+0000 7faa2be00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa24109600 0x7faa2419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.111+0000 7faa2be00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faa24113550 con 0x7faa241034f0 2024-05-03T22:15:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.111+0000 7faa2be00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faa241133d0 con 0x7faa24103eb0 2024-05-03T22:15:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.111+0000 7faa2be00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faa241136d0 con 0x7faa24109600 2024-05-03T22:15:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.111+0000 7faa29400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa241034f0 0x7faa241a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.111+0000 7faa29400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa241034f0 0x7faa241a1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51286/0 (socket says 172.21.15.82:51286) 2024-05-03T22:15:59.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.111+0000 7faa29400700 1 -- 172.21.15.82:0/2746728077 learned_addr learned my addr 172.21.15.82:0/2746728077 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:15:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.112+0000 7faa29e00700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa24109600 0x7faa2419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.112+0000 7faa28a00700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa24103eb0 0x7faa241a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:59.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.112+0000 7faa29400700 1 -- 172.21.15.82:0/2746728077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa24109600 msgr2=0x7faa2419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.112+0000 7faa29400700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa24109600 0x7faa2419ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.112+0000 7faa29400700 1 -- 172.21.15.82:0/2746728077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa24103eb0 msgr2=0x7faa241a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.112+0000 7faa29400700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa24103eb0 0x7faa241a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.112+0000 7faa29400700 1 -- 172.21.15.82:0/2746728077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2419c160 con 0x7faa241034f0 2024-05-03T22:15:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.112+0000 7faa29400700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa241034f0 0x7faa241a1840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c9b0 tx=0x7faa1800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.112+0000 7faa22000700 1 -- 172.21.15.82:0/2746728077 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18007b00 con 0x7faa241034f0 2024-05-03T22:15:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.113+0000 7faa22000700 1 -- 172.21.15.82:0/2746728077 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa18007ca0 con 0x7faa241034f0 2024-05-03T22:15:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.113+0000 7faa2be00700 1 -- 172.21.15.82:0/2746728077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2419c450 con 0x7faa241034f0 2024-05-03T22:15:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.113+0000 7faa22000700 1 -- 172.21.15.82:0/2746728077 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18018660 con 0x7faa241034f0 2024-05-03T22:15:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.113+0000 7faa2be00700 1 -- 172.21.15.82:0/2746728077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa241a8710 con 0x7faa241034f0 2024-05-03T22:15:59.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.114+0000 7faa2be00700 1 -- 172.21.15.82:0/2746728077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa2406a190 con 0x7faa241034f0 2024-05-03T22:15:59.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.116+0000 7faa22000700 1 -- 172.21.15.82:0/2746728077 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7faa1800f450 con 0x7faa241034f0 2024-05-03T22:15:59.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.118+0000 7faa22000700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faa0c0b2910 0x7faa0c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:15:59.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.118+0000 7faa22000700 1 -- 172.21.15.82:0/2746728077 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7faa180e2870 con 0x7faa241034f0 2024-05-03T22:15:59.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.119+0000 7faa28a00700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faa0c0b2910 0x7faa0c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:15:59.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.119+0000 7faa28a00700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faa0c0b2910 0x7faa0c0b4dd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faa10005f50 tx=0x7faa10005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:15:59.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.123+0000 7faa22000700 1 -- 172.21.15.82:0/2746728077 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7faa18014030 con 0x7faa241034f0 2024-05-03T22:15:59.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.357+0000 7faa2be00700 1 -- 172.21.15.82:0/2746728077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faa241a89a0 con 0x7faa241034f0 2024-05-03T22:15:59.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.358+0000 7faa22000700 1 -- 172.21.15.82:0/2746728077 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa180aa010 con 0x7faa241034f0 2024-05-03T22:15:59.360 INFO:teuthology.orchestra.run.smithi082.stdout:34359738506 2024-05-03T22:15:59.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.362+0000 7faa2be00700 1 -- 172.21.15.82:0/2746728077 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faa0c0b2910 msgr2=0x7faa0c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:59.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.362+0000 7faa2be00700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faa0c0b2910 0x7faa0c0b4dd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faa10005f50 tx=0x7faa10005ea0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.362+0000 7faa2be00700 1 -- 172.21.15.82:0/2746728077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa241034f0 msgr2=0x7faa241a1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:15:59.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.362+0000 7faa2be00700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa241034f0 0x7faa241a1840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c9b0 tx=0x7faa1800cd70 comp rx=0 tx=0).stop 2024-05-03T22:15:59.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.362+0000 7faa2be00700 1 -- 172.21.15.82:0/2746728077 shutdown_connections 2024-05-03T22:15:59.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.362+0000 7faa2be00700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7faa0c0b2910 0x7faa0c0b4dd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.362+0000 7faa2be00700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa241034f0 0x7faa241a1840 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.362+0000 7faa2be00700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa24109600 0x7faa2419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.362+0000 7faa2be00700 1 --2- 172.21.15.82:0/2746728077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa24103eb0 0x7faa241a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:15:59.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.362+0000 7faa2be00700 1 -- 172.21.15.82:0/2746728077 >> 172.21.15.82:0/2746728077 conn(0x7faa2407a650 msgr2=0x7faa2410e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:15:59.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.363+0000 7faa2be00700 1 -- 172.21.15.82:0/2746728077 shutdown_connections 2024-05-03T22:15:59.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:59.363+0000 7faa2be00700 1 -- 172.21.15.82:0/2746728077 wait complete. 2024-05-03T22:16:00.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:59 smithi082 ceph-mon[28404]: pgmap v483: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:00.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:59 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3409278341' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-03T22:16:00.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:15:59 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2746728077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-03T22:16:00.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:59 smithi130 ceph-mon[32417]: pgmap v483: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:00.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:59 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3409278341' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-03T22:16:00.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:15:59 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2746728077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-03T22:16:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:59 smithi116 ceph-mon[31828]: pgmap v483: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:59 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3409278341' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-03T22:16:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:15:59 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2746728077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-03T22:16:00.730 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612661 got 313532612667 for osd.11 2024-05-03T22:16:00.731 DEBUG:teuthology.parallel:result is None 2024-05-03T22:16:00.912 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738499 got 34359738506 for osd.0 2024-05-03T22:16:00.912 DEBUG:teuthology.parallel:result is None 2024-05-03T22:16:01.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.424+0000 7f791fa00700 1 -- 172.21.15.82:0/3632943997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7918103ee0 msgr2=0x7f7918110370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:01.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.424+0000 7f791fa00700 1 --2- 172.21.15.82:0/3632943997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7918103ee0 0x7f7918110370 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f791000b0a0 tx=0x7f791000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:16:01.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.424+0000 7f791fa00700 1 -- 172.21.15.82:0/3632943997 shutdown_connections 2024-05-03T22:16:01.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.424+0000 7f791fa00700 1 --2- 172.21.15.82:0/3632943997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7918103ee0 0x7f7918110370 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:01.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.424+0000 7f791fa00700 1 --2- 172.21.15.82:0/3632943997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7918109530 0x7f7918109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.424+0000 7f791fa00700 1 --2- 172.21.15.82:0/3632943997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7918103520 0x7f79181039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.424+0000 7f791fa00700 1 -- 172.21.15.82:0/3632943997 >> 172.21.15.82:0/3632943997 conn(0x7f791807a650 msgr2=0x7f791807aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.424+0000 7f791fa00700 1 -- 172.21.15.82:0/3632943997 shutdown_connections 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.424+0000 7f791fa00700 1 -- 172.21.15.82:0/3632943997 wait complete. 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.425+0000 7f791fa00700 1 Processor -- start 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.425+0000 7f791fa00700 1 -- start start 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.425+0000 7f791fa00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7918103520 0x7f791819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.425+0000 7f791fa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7918103ee0 0x7f791819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.425+0000 7f791fa00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7918109530 0x7f7918199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f791fa00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7918113580 con 0x7f7918103ee0 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f791fa00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7918113400 con 0x7f7918109530 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f791fa00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7918113700 con 0x7f7918103520 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f7917e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7918103ee0 0x7f791819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f7917e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7918103ee0 0x7f791819fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51268/0 (socket says 172.21.15.82:51268) 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f7917e00700 1 -- 172.21.15.82:0/76486920 learned_addr learned my addr 172.21.15.82:0/76486920 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f791d000700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7918103520 0x7f791819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f791da00700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7918109530 0x7f7918199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f7917e00700 1 -- 172.21.15.82:0/76486920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7918103520 msgr2=0x7f791819f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f7917e00700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7918103520 0x7f791819f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f7917e00700 1 -- 172.21.15.82:0/76486920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7918109530 msgr2=0x7f7918199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f7917e00700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7918109530 0x7f7918199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f7917e00700 1 -- 172.21.15.82:0/76486920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7918199fc0 con 0x7f7918103ee0 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.426+0000 7f791da00700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7918109530 0x7f7918199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.427+0000 7f7917e00700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7918103ee0 0x7f791819fbe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f790400d980 tx=0x7f790400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.427+0000 7f7915600700 1 -- 172.21.15.82:0/76486920 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904016070 con 0x7f7918103ee0 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.427+0000 7f791fa00700 1 -- 172.21.15.82:0/76486920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791819a250 con 0x7f7918103ee0 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.427+0000 7f7915600700 1 -- 172.21.15.82:0/76486920 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7904004020 con 0x7f7918103ee0 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.427+0000 7f7915600700 1 -- 172.21.15.82:0/76486920 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904004b90 con 0x7f7918103ee0 2024-05-03T22:16:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.427+0000 7f791fa00700 1 -- 172.21.15.82:0/76486920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79181a6570 con 0x7f7918103ee0 2024-05-03T22:16:01.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.428+0000 7f791fa00700 1 -- 172.21.15.82:0/76486920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f791806a190 con 0x7f7918103ee0 2024-05-03T22:16:01.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.432+0000 7f7915600700 1 -- 172.21.15.82:0/76486920 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f790400bb60 con 0x7f7918103ee0 2024-05-03T22:16:01.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.433+0000 7f7915600700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f79000b2910 0x7f79000b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:01.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.434+0000 7f7915600700 1 -- 172.21.15.82:0/76486920 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f79040e2bf0 con 0x7f7918103ee0 2024-05-03T22:16:01.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.434+0000 7f791d000700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f79000b2910 0x7f79000b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:01.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.434+0000 7f791d000700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f79000b2910 0x7f79000b4dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f791819a9a0 tx=0x7f790c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:55834574979 2024-05-03T22:16:01.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.436+0000 7f7915600700 1 -- 172.21.15.82:0/76486920 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f790401f020 con 0x7f7918103ee0 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.689+0000 7f791fa00700 1 -- 172.21.15.82:0/76486920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f791802e510 con 0x7f7918103ee0 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.690+0000 7f7915600700 1 -- 172.21.15.82:0/76486920 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7904055e20 con 0x7f7918103ee0 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 -- 172.21.15.82:0/76486920 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f79000b2910 msgr2=0x7f79000b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f79000b2910 0x7f79000b4dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f791819a9a0 tx=0x7f790c009260 comp rx=0 tx=0).stop 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 -- 172.21.15.82:0/76486920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7918103ee0 msgr2=0x7f791819fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7918103ee0 0x7f791819fbe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f790400d980 tx=0x7f790400dd40 comp rx=0 tx=0).stop 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 -- 172.21.15.82:0/76486920 shutdown_connections 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f79000b2910 0x7f79000b4dd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7918109530 0x7f7918199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7918103520 0x7f791819f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 --2- 172.21.15.82:0/76486920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7918103ee0 0x7f791819fbe0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 -- 172.21.15.82:0/76486920 >> 172.21.15.82:0/76486920 conn(0x7f791807a650 msgr2=0x7f7918102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 -- 172.21.15.82:0/76486920 shutdown_connections 2024-05-03T22:16:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:15:56.693+0000 7f791fa00700 1 -- 172.21.15.82:0/76486920 wait complete. 2024-05-03T22:16:02.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:01 smithi082 ceph-mon[28404]: pgmap v484: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:02.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:01 smithi130 ceph-mon[32417]: pgmap v484: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:02.327 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574973 got 55834574979 for osd.1 2024-05-03T22:16:02.328 DEBUG:teuthology.parallel:result is None 2024-05-03T22:16:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:01 smithi116 ceph-mon[31828]: pgmap v484: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:03.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.200+0000 7f20b7e00700 1 -- 172.21.15.82:0/135623139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b810fc90 msgr2=0x7f20b8112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:03.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.200+0000 7f20b7e00700 1 --2- 172.21.15.82:0/135623139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b810fc90 0x7f20b8112080 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f20b000b0a0 tx=0x7f20b000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:16:03.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.200+0000 7f20b7e00700 1 -- 172.21.15.82:0/135623139 shutdown_connections 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.200+0000 7f20b7e00700 1 --2- 172.21.15.82:0/135623139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b810fc90 0x7f20b8112080 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.200+0000 7f20b7e00700 1 --2- 172.21.15.82:0/135623139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20b80757c0 0x7f20b8075ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.200+0000 7f20b7e00700 1 --2- 172.21.15.82:0/135623139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20b80760e0 0x7f20b810f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.200+0000 7f20b7e00700 1 -- 172.21.15.82:0/135623139 >> 172.21.15.82:0/135623139 conn(0x7f20b80fef20 msgr2=0x7f20b8101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.200+0000 7f20b7e00700 1 -- 172.21.15.82:0/135623139 shutdown_connections 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.200+0000 7f20b7e00700 1 -- 172.21.15.82:0/135623139 wait complete. 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.201+0000 7f20b7e00700 1 Processor -- start 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.202+0000 7f20b7e00700 1 -- start start 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.202+0000 7f20b7e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20b80757c0 0x7f20b81a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.202+0000 7f20b7e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20b80760e0 0x7f20b81a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.202+0000 7f20b7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b810fc90 0x7f20b819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.202+0000 7f20b7e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f20b8115690 con 0x7f20b810fc90 2024-05-03T22:16:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.202+0000 7f20b7e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f20b8115510 con 0x7f20b80760e0 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.202+0000 7f20b7e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20b8115810 con 0x7f20b80757c0 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.202+0000 7f20b7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b810fc90 0x7f20b819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.202+0000 7f20b7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b810fc90 0x7f20b819b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51330/0 (socket says 172.21.15.82:51330) 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.202+0000 7f20b7400700 1 -- 172.21.15.82:0/2508738812 learned_addr learned my addr 172.21.15.82:0/2508738812 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.203+0000 7f20b6a00700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20b80757c0 0x7f20b81a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.203+0000 7f20b6000700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20b80760e0 0x7f20b81a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.203+0000 7f20b7400700 1 -- 172.21.15.82:0/2508738812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20b80757c0 msgr2=0x7f20b81a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.203+0000 7f20b7400700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20b80757c0 0x7f20b81a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.203+0000 7f20b7400700 1 -- 172.21.15.82:0/2508738812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20b80760e0 msgr2=0x7f20b81a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.203+0000 7f20b7400700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20b80760e0 0x7f20b81a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.203+0000 7f20b7400700 1 -- 172.21.15.82:0/2508738812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b819c150 con 0x7f20b810fc90 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.203+0000 7f20b7400700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b810fc90 0x7f20b819b9f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f20b000b070 tx=0x7f20b0004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:03.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.204+0000 7f20af400700 1 -- 172.21.15.82:0/2508738812 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0021070 con 0x7f20b810fc90 2024-05-03T22:16:03.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.204+0000 7f20af400700 1 -- 172.21.15.82:0/2508738812 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20b0007c00 con 0x7f20b810fc90 2024-05-03T22:16:03.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.204+0000 7f20b7e00700 1 -- 172.21.15.82:0/2508738812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b819c3e0 con 0x7f20b810fc90 2024-05-03T22:16:03.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.204+0000 7f20af400700 1 -- 172.21.15.82:0/2508738812 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0004860 con 0x7f20b810fc90 2024-05-03T22:16:03.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.204+0000 7f20b7e00700 1 -- 172.21.15.82:0/2508738812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b81a86b0 con 0x7f20b810fc90 2024-05-03T22:16:03.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.205+0000 7f20b7e00700 1 -- 172.21.15.82:0/2508738812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b806a190 con 0x7f20b810fc90 2024-05-03T22:16:03.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.209+0000 7f20af400700 1 -- 172.21.15.82:0/2508738812 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f20b0004000 con 0x7f20b810fc90 2024-05-03T22:16:03.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.212+0000 7f20af400700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f209c0b2910 0x7f209c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:03.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.212+0000 7f20af400700 1 -- 172.21.15.82:0/2508738812 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f20b000f020 con 0x7f20b810fc90 2024-05-03T22:16:03.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.212+0000 7f20b6a00700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f209c0b2910 0x7f209c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:03.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.213+0000 7f20b6a00700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f209c0b2910 0x7f209c0b4dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f20a8005950 tx=0x7f20a80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:03.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.213+0000 7f20af400700 1 -- 172.21.15.82:0/2508738812 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f20b002a020 con 0x7f20b810fc90 2024-05-03T22:16:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.465+0000 7f20b7e00700 1 -- 172.21.15.82:0/2508738812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f20b802e510 con 0x7f20b810fc90 2024-05-03T22:16:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.466+0000 7f20af400700 1 -- 172.21.15.82:0/2508738812 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f20b00aba50 con 0x7f20b810fc90 2024-05-03T22:16:03.468 INFO:teuthology.orchestra.run.smithi082.stdout:163208757352 2024-05-03T22:16:03.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.470+0000 7f20b7e00700 1 -- 172.21.15.82:0/2508738812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f209c0b2910 msgr2=0x7f209c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:03.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.470+0000 7f20b7e00700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f209c0b2910 0x7f209c0b4dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f20a8005950 tx=0x7f20a80058e0 comp rx=0 tx=0).stop 2024-05-03T22:16:03.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.470+0000 7f20b7e00700 1 -- 172.21.15.82:0/2508738812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b810fc90 msgr2=0x7f20b819b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:03.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.470+0000 7f20b7e00700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b810fc90 0x7f20b819b9f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f20b000b070 tx=0x7f20b0004e00 comp rx=0 tx=0).stop 2024-05-03T22:16:03.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.471+0000 7f20b7e00700 1 -- 172.21.15.82:0/2508738812 shutdown_connections 2024-05-03T22:16:03.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.471+0000 7f20b7e00700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f209c0b2910 0x7f209c0b4dd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:03.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.471+0000 7f20b7e00700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20b810fc90 0x7f20b819b9f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:03.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.471+0000 7f20b7e00700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20b80757c0 0x7f20b81a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:03.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.471+0000 7f20b7e00700 1 --2- 172.21.15.82:0/2508738812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20b80760e0 0x7f20b81a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:03.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.471+0000 7f20b7e00700 1 -- 172.21.15.82:0/2508738812 >> 172.21.15.82:0/2508738812 conn(0x7f20b80fef20 msgr2=0x7f20b80ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:03.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.471+0000 7f20b7e00700 1 -- 172.21.15.82:0/2508738812 shutdown_connections 2024-05-03T22:16:03.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.471+0000 7f20b7e00700 1 -- 172.21.15.82:0/2508738812 wait complete. 2024-05-03T22:16:04.092 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:03 smithi082 ceph-mon[28404]: pgmap v485: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:04.092 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:03 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/520826446' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-03T22:16:04.092 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:03 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2508738812' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-03T22:16:04.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:03 smithi130 ceph-mon[32417]: pgmap v485: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:04.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:03 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/520826446' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-03T22:16:04.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:03 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2508738812' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-03T22:16:04.430 INFO:teuthology.orchestra.run.smithi082.stdout:236223201363 2024-05-03T22:16:04.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.032+0000 7f2dd7a00700 1 -- 172.21.15.82:0/712918225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd0106080 msgr2=0x7f2dd0112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:04.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.032+0000 7f2dd7a00700 1 --2- 172.21.15.82:0/712918225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd0106080 0x7f2dd0112590 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800b0a0 tx=0x7f2dc800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:16:04.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.032+0000 7f2dd7a00700 1 -- 172.21.15.82:0/712918225 shutdown_connections 2024-05-03T22:16:04.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.032+0000 7f2dd7a00700 1 --2- 172.21.15.82:0/712918225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd0106080 0x7f2dd0112590 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:04.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.032+0000 7f2dd7a00700 1 --2- 172.21.15.82:0/712918225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2dd010b6c0 0x7f2dd010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:04.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.032+0000 7f2dd7a00700 1 --2- 172.21.15.82:0/712918225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd01056c0 0x7f2dd0105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:04.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.032+0000 7f2dd7a00700 1 -- 172.21.15.82:0/712918225 >> 172.21.15.82:0/712918225 conn(0x7f2dd01011b0 msgr2=0x7f2dd01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:04.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.032+0000 7f2dd7a00700 1 -- 172.21.15.82:0/712918225 shutdown_connections 2024-05-03T22:16:04.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.032+0000 7f2dd7a00700 1 -- 172.21.15.82:0/712918225 wait complete. 2024-05-03T22:16:04.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.033+0000 7f2dd7a00700 1 Processor -- start 2024-05-03T22:16:04.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.034+0000 7f2dd7a00700 1 -- start start 2024-05-03T22:16:04.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.034+0000 7f2dd7a00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2dd01056c0 0x7f2dd01a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:04.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.034+0000 7f2dd7a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd0106080 0x7f2dd01a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:04.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.034+0000 7f2dd7a00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd010b6c0 0x7f2dd019b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:04.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.034+0000 7f2dd7a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd0115750 con 0x7f2dd0106080 2024-05-03T22:16:04.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.034+0000 7f2dd7a00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd01155d0 con 0x7f2dd010b6c0 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.034+0000 7f2dd7a00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd01158d0 con 0x7f2dd01056c0 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.034+0000 7f2dcfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd0106080 0x7f2dd01a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.034+0000 7f2dcfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd0106080 0x7f2dd01a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51312/0 (socket says 172.21.15.82:51312) 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.034+0000 7f2dcfe00700 1 -- 172.21.15.82:0/520826446 learned_addr learned my addr 172.21.15.82:0/520826446 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dd5000700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2dd01056c0 0x7f2dd01a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dd5a00700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd010b6c0 0x7f2dd019b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dcfe00700 1 -- 172.21.15.82:0/520826446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2dd01056c0 msgr2=0x7f2dd01a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dcfe00700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2dd01056c0 0x7f2dd01a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dcfe00700 1 -- 172.21.15.82:0/520826446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd010b6c0 msgr2=0x7f2dd019b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dcfe00700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd010b6c0 0x7f2dd019b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dcfe00700 1 -- 172.21.15.82:0/520826446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd019c0b0 con 0x7f2dd0106080 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dcfe00700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd0106080 0x7f2dd01a1cd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00c9b0 tx=0x7f2dbc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dcd600700 1 -- 172.21.15.82:0/520826446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc007b00 con 0x7f2dd0106080 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dcd600700 1 -- 172.21.15.82:0/520826446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2dbc007ca0 con 0x7f2dd0106080 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dcd600700 1 -- 172.21.15.82:0/520826446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc018660 con 0x7f2dd0106080 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.035+0000 7f2dd7a00700 1 -- 172.21.15.82:0/520826446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd019c3a0 con 0x7f2dd0106080 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.036+0000 7f2dd7a00700 1 -- 172.21.15.82:0/520826446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd01a8660 con 0x7f2dd0106080 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.037+0000 7f2dd7a00700 1 -- 172.21.15.82:0/520826446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd006a190 con 0x7f2dd0106080 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.039+0000 7f2dcd600700 1 -- 172.21.15.82:0/520826446 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f2dbc00f450 con 0x7f2dd0106080 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.040+0000 7f2dcd600700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2db80b2990 0x7f2db80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.041+0000 7f2dcd600700 1 -- 172.21.15.82:0/520826446 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f2dbc0e2800 con 0x7f2dd0106080 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.041+0000 7f2dd5000700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2db80b2990 0x7f2db80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.042+0000 7f2dd5000700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2db80b2990 0x7f2db80b4e50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4005fd0 tx=0x7f2dc400af00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.045+0000 7f2dcd600700 1 -- 172.21.15.82:0/520826446 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2dbc014030 con 0x7f2dd0106080 2024-05-03T22:16:04.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.289+0000 7f2dd7a00700 1 -- 172.21.15.82:0/520826446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f2dd019ce80 con 0x7f2dd0106080 2024-05-03T22:16:04.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.291+0000 7f2dcd600700 1 -- 172.21.15.82:0/520826446 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2dbc0a9fa0 con 0x7f2dd0106080 2024-05-03T22:16:04.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 -- 172.21.15.82:0/520826446 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2db80b2990 msgr2=0x7f2db80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:04.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2db80b2990 0x7f2db80b4e50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4005fd0 tx=0x7f2dc400af00 comp rx=0 tx=0).stop 2024-05-03T22:16:04.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 -- 172.21.15.82:0/520826446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd0106080 msgr2=0x7f2dd01a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:04.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd0106080 0x7f2dd01a1cd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00c9b0 tx=0x7f2dbc00cd70 comp rx=0 tx=0).stop 2024-05-03T22:16:04.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 -- 172.21.15.82:0/520826446 shutdown_connections 2024-05-03T22:16:04.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f2db80b2990 0x7f2db80b4e50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:04.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dd010b6c0 0x7f2dd019b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:04.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2dd01056c0 0x7f2dd01a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:04.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 --2- 172.21.15.82:0/520826446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2dd0106080 0x7f2dd01a1cd0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:04.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 -- 172.21.15.82:0/520826446 >> 172.21.15.82:0/520826446 conn(0x7f2dd01011b0 msgr2=0x7f2dd0101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:04.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 -- 172.21.15.82:0/520826446 shutdown_connections 2024-05-03T22:16:04.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.294+0000 7f2dd7a00700 1 -- 172.21.15.82:0/520826446 wait complete. 2024-05-03T22:16:04.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:03 smithi116 ceph-mon[31828]: pgmap v485: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:04.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:03 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/520826446' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-03T22:16:04.437 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:03 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2508738812' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-03T22:16:05.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:05 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3771732996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-03T22:16:05.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:05 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3771732996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-03T22:16:05.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:05 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3771732996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-03T22:16:06.047 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:16:06.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:06 smithi130 ceph-mon[32417]: pgmap v486: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:06.384 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:06 smithi082 ceph-mon[28404]: pgmap v486: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:06 smithi116 ceph-mon[31828]: pgmap v486: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:06.717 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201358 got 236223201363 for osd.8 2024-05-03T22:16:06.717 DEBUG:teuthology.parallel:result is None 2024-05-03T22:16:06.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.974+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3741934195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103d90 msgr2=0x7f3f201102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:06.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.974+0000 7f3f1fe00700 1 --2- 172.21.15.82:0/3741934195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103d90 0x7f3f201102a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800b0a0 tx=0x7f3f1800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:16:06.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.974+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3741934195 shutdown_connections 2024-05-03T22:16:06.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.974+0000 7f3f1fe00700 1 --2- 172.21.15.82:0/3741934195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103d90 0x7f3f201102a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:06.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.974+0000 7f3f1fe00700 1 --2- 172.21.15.82:0/3741934195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f20109460 0x7f3f20109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:06.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.974+0000 7f3f1fe00700 1 --2- 172.21.15.82:0/3741934195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f201033d0 0x7f3f20103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:06.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.974+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3741934195 >> 172.21.15.82:0/3741934195 conn(0x7f3f200fef20 msgr2=0x7f3f20101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:06.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.974+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3741934195 shutdown_connections 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.975+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3741934195 wait complete. 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.975+0000 7f3f1fe00700 1 Processor -- start 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.976+0000 7f3f1fe00700 1 -- start start 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.976+0000 7f3f1fe00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f201033d0 0x7f3f201a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.976+0000 7f3f1fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103d90 0x7f3f201a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.976+0000 7f3f1fe00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f20109460 0x7f3f2019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.976+0000 7f3f1fe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20113440 con 0x7f3f20103d90 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.976+0000 7f3f1fe00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3f201132c0 con 0x7f3f201033d0 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.976+0000 7f3f1fe00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f201135c0 con 0x7f3f20109460 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.976+0000 7f3f1e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103d90 0x7f3f201a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.976+0000 7f3f1e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103d90 0x7f3f201a1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51360/0 (socket says 172.21.15.82:51360) 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.976+0000 7f3f1e000700 1 -- 172.21.15.82:0/3771732996 learned_addr learned my addr 172.21.15.82:0/3771732996 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f1f400700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f20109460 0x7f3f2019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f1ea00700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f201033d0 0x7f3f201a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f1e000700 1 -- 172.21.15.82:0/3771732996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f20109460 msgr2=0x7f3f2019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f1e000700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f20109460 0x7f3f2019b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f1e000700 1 -- 172.21.15.82:0/3771732996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f201033d0 msgr2=0x7f3f201a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f1e000700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f201033d0 0x7f3f201a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f1e000700 1 -- 172.21.15.82:0/3771732996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2019c0e0 con 0x7f3f20103d90 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f1ea00700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f201033d0 0x7f3f201a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f1e000700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103d90 0x7f3f201a1d00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00d980 tx=0x7f3f0c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f17400700 1 -- 172.21.15.82:0/3771732996 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c016070 con 0x7f3f20103d90 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f17400700 1 -- 172.21.15.82:0/3771732996 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f0c004020 con 0x7f3f20103d90 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f17400700 1 -- 172.21.15.82:0/3771732996 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c004bb0 con 0x7f3f20103d90 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.977+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3771732996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2019c370 con 0x7f3f20103d90 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.978+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3771732996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f201a8690 con 0x7f3f20103d90 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.979+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3771732996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f2006a190 con 0x7f3f20103d90 2024-05-03T22:16:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.982+0000 7f3f17400700 1 -- 172.21.15.82:0/3771732996 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3f0c00bb60 con 0x7f3f20103d90 2024-05-03T22:16:06.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.983+0000 7f3f17400700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3f040b2910 0x7f3f040b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:06.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.984+0000 7f3f17400700 1 -- 172.21.15.82:0/3771732996 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f3f0c0e2b60 con 0x7f3f20103d90 2024-05-03T22:16:06.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.984+0000 7f3f1ea00700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3f040b2910 0x7f3f040b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:06.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.985+0000 7f3f1ea00700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3f040b2910 0x7f3f040b4dd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f10005e10 tx=0x7f3f10005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:06.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:03.987+0000 7f3f17400700 1 -- 172.21.15.82:0/3771732996 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3f0c01f020 con 0x7f3f20103d90 2024-05-03T22:16:06.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.229+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3771732996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3f2019ceb0 con 0x7f3f20103d90 2024-05-03T22:16:06.818 INFO:teuthology.orchestra.run.smithi082.stdout:77309411454 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.230+0000 7f3f17400700 1 -- 172.21.15.82:0/3771732996 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3f0c055e20 con 0x7f3f20103d90 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3771732996 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3f040b2910 msgr2=0x7f3f040b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3f040b2910 0x7f3f040b4dd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f10005e10 tx=0x7f3f10005d20 comp rx=0 tx=0).stop 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3771732996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103d90 msgr2=0x7f3f201a1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103d90 0x7f3f201a1d00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00d980 tx=0x7f3f0c00dd40 comp rx=0 tx=0).stop 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3771732996 shutdown_connections 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f3f040b2910 0x7f3f040b4dd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f20109460 0x7f3f2019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f201033d0 0x7f3f201a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 --2- 172.21.15.82:0/3771732996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103d90 0x7f3f201a1d00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3771732996 >> 172.21.15.82:0/3771732996 conn(0x7f3f200fef20 msgr2=0x7f3f20108720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3771732996 shutdown_connections 2024-05-03T22:16:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:04.233+0000 7f3f1fe00700 1 -- 172.21.15.82:0/3771732996 wait complete. 2024-05-03T22:16:08.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:08 smithi082 ceph-mon[28404]: pgmap v487: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:08.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:08 smithi130 ceph-mon[32417]: pgmap v487: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:08.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.879+0000 7f4a0da00700 1 -- 172.21.15.82:0/2023647469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a08102b50 msgr2=0x7f4a0810f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:08.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.879+0000 7f4a0da00700 1 --2- 172.21.15.82:0/2023647469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a08102b50 0x7f4a0810f810 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009990 tx=0x7f49f4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:16:08.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.879+0000 7f4a0da00700 1 -- 172.21.15.82:0/2023647469 shutdown_connections 2024-05-03T22:16:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.879+0000 7f4a0da00700 1 --2- 172.21.15.82:0/2023647469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a0810fd50 0x7f4a08112140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.879+0000 7f4a0da00700 1 --2- 172.21.15.82:0/2023647469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a081021a0 0x7f4a08102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.879+0000 7f4a0da00700 1 --2- 172.21.15.82:0/2023647469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a08102b50 0x7f4a0810f810 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.879+0000 7f4a0da00700 1 -- 172.21.15.82:0/2023647469 >> 172.21.15.82:0/2023647469 conn(0x7f4a080fddc0 msgr2=0x7f4a081001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.879+0000 7f4a0da00700 1 -- 172.21.15.82:0/2023647469 shutdown_connections 2024-05-03T22:16:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.879+0000 7f4a0da00700 1 -- 172.21.15.82:0/2023647469 wait complete. 2024-05-03T22:16:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.881+0000 7f4a0da00700 1 Processor -- start 2024-05-03T22:16:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.881+0000 7f4a0da00700 1 -- start start 2024-05-03T22:16:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.881+0000 7f4a0da00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a081021a0 0x7f4a0819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.881+0000 7f4a0da00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a08102b50 0x7f4a0819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.881+0000 7f4a0da00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a0810fd50 0x7f4a081a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.881+0000 7f4a0da00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4a081157c0 con 0x7f4a0810fd50 2024-05-03T22:16:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.881+0000 7f4a0da00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4a08115640 con 0x7f4a081021a0 2024-05-03T22:16:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.881+0000 7f4a0da00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a08115940 con 0x7f4a08102b50 2024-05-03T22:16:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.882+0000 7f4a0d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a0810fd50 0x7f4a081a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.882+0000 7f4a0d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a0810fd50 0x7f4a081a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51380/0 (socket says 172.21.15.82:51380) 2024-05-03T22:16:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.882+0000 7f4a0d000700 1 -- 172.21.15.82:0/3197235262 learned_addr learned my addr 172.21.15.82:0/3197235262 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.882+0000 7f4a07400700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a08102b50 0x7f4a0819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.882+0000 7f4a0d000700 1 -- 172.21.15.82:0/3197235262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a08102b50 msgr2=0x7f4a0819c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.882+0000 7f4a0d000700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a08102b50 0x7f4a0819c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.882+0000 7f4a0d000700 1 -- 172.21.15.82:0/3197235262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a081021a0 msgr2=0x7f4a0819be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.882+0000 7f4a0d000700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a081021a0 0x7f4a0819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.882+0000 7f4a0d000700 1 -- 172.21.15.82:0/3197235262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a081a0e10 con 0x7f4a0810fd50 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.883+0000 7f4a0d000700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a0810fd50 0x7f4a081a06d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000b9e0 tx=0x7f4a0000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.883+0000 7f4a04c00700 1 -- 172.21.15.82:0/3197235262 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00019070 con 0x7f4a0810fd50 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.883+0000 7f4a04c00700 1 -- 172.21.15.82:0/3197235262 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a0000ce40 con 0x7f4a0810fd50 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.883+0000 7f4a0da00700 1 -- 172.21.15.82:0/3197235262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a081a1100 con 0x7f4a0810fd50 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.883+0000 7f4a04c00700 1 -- 172.21.15.82:0/3197235262 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00012340 con 0x7f4a0810fd50 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.883+0000 7f4a0da00700 1 -- 172.21.15.82:0/3197235262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a081a8980 con 0x7f4a0810fd50 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.885+0000 7f4a0da00700 1 -- 172.21.15.82:0/3197235262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0806a190 con 0x7f4a0810fd50 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.887+0000 7f4a04c00700 1 -- 172.21.15.82:0/3197235262 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f4a0001c070 con 0x7f4a0810fd50 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.888+0000 7f4a04c00700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f49ec0b2990 0x7f49ec0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.889+0000 7f4a04c00700 1 -- 172.21.15.82:0/3197235262 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f4a000e1bb0 con 0x7f4a0810fd50 2024-05-03T22:16:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.889+0000 7f4a07e00700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f49ec0b2990 0x7f49ec0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.889+0000 7f4a07e00700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f49ec0b2990 0x7f49ec0b4e50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f49f80097b0 tx=0x7f49f8006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:07.893+0000 7f4a04c00700 1 -- 172.21.15.82:0/3197235262 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4a00051d70 con 0x7f4a0810fd50 2024-05-03T22:16:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.129+0000 7f4a0da00700 1 -- 172.21.15.82:0/3197235262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4a0802e510 con 0x7f4a0810fd50 2024-05-03T22:16:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.130+0000 7f4a04c00700 1 -- 172.21.15.82:0/3197235262 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4a000a9460 con 0x7f4a0810fd50 2024-05-03T22:16:08.358 INFO:teuthology.orchestra.run.smithi082.stdout:188978561122 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 -- 172.21.15.82:0/3197235262 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f49ec0b2990 msgr2=0x7f49ec0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f49ec0b2990 0x7f49ec0b4e50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f49f80097b0 tx=0x7f49f8006d20 comp rx=0 tx=0).stop 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 -- 172.21.15.82:0/3197235262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a0810fd50 msgr2=0x7f4a081a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a0810fd50 0x7f4a081a06d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000b9e0 tx=0x7f4a0000bda0 comp rx=0 tx=0).stop 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 -- 172.21.15.82:0/3197235262 shutdown_connections 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f49ec0b2990 0x7f49ec0b4e50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a0810fd50 0x7f4a081a06d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4a081021a0 0x7f4a0819be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 --2- 172.21.15.82:0/3197235262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a08102b50 0x7f4a0819c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 -- 172.21.15.82:0/3197235262 >> 172.21.15.82:0/3197235262 conn(0x7f4a080fddc0 msgr2=0x7f4a081001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 -- 172.21.15.82:0/3197235262 shutdown_connections 2024-05-03T22:16:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:08.133+0000 7f4a0da00700 1 -- 172.21.15.82:0/3197235262 wait complete. 2024-05-03T22:16:08.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:08 smithi116 ceph-mon[31828]: pgmap v487: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:09.417 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:09 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3197235262' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-03T22:16:09.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:09 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3197235262' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-03T22:16:09.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:09 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3197235262' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-03T22:16:10.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:10 smithi082 ceph-mon[28404]: pgmap v488: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:10 smithi116 ceph-mon[31828]: pgmap v488: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:10.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:10 smithi130 ceph-mon[32417]: pgmap v488: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.838+0000 7f24ed400700 1 -- 172.21.15.82:0/3566824862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e806c530 msgr2=0x7f24e8110350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:10.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.838+0000 7f24ed400700 1 --2- 172.21.15.82:0/3566824862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e806c530 0x7f24e8110350 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f24e000b0a0 tx=0x7f24e000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:16:10.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.838+0000 7f24ed400700 1 -- 172.21.15.82:0/3566824862 shutdown_connections 2024-05-03T22:16:10.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.838+0000 7f24ed400700 1 --2- 172.21.15.82:0/3566824862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e806c530 0x7f24e8110350 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:10.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.838+0000 7f24ed400700 1 --2- 172.21.15.82:0/3566824862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e8109530 0x7f24e8109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:10.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.838+0000 7f24ed400700 1 --2- 172.21.15.82:0/3566824862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e806bb70 0x7f24e806bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:10.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.838+0000 7f24ed400700 1 -- 172.21.15.82:0/3566824862 >> 172.21.15.82:0/3566824862 conn(0x7f24e8079350 msgr2=0x7f24e8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:10.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.838+0000 7f24ed400700 1 -- 172.21.15.82:0/3566824862 shutdown_connections 2024-05-03T22:16:10.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.838+0000 7f24ed400700 1 -- 172.21.15.82:0/3566824862 wait complete. 2024-05-03T22:16:10.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.839+0000 7f24ed400700 1 Processor -- start 2024-05-03T22:16:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.839+0000 7f24ed400700 1 -- start start 2024-05-03T22:16:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.840+0000 7f24ed400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e806bb70 0x7f24e8102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.840+0000 7f24ed400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e806c530 0x7f24e8102d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.840+0000 7f24ed400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e8109530 0x7f24e81032d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.840+0000 7f24ed400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f24e8113560 con 0x7f24e806c530 2024-05-03T22:16:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.840+0000 7f24ed400700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f24e81133e0 con 0x7f24e8109530 2024-05-03T22:16:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.840+0000 7f24ed400700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24e81136e0 con 0x7f24e806bb70 2024-05-03T22:16:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.840+0000 7f24e5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e806c530 0x7f24e8102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.840+0000 7f24e5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e806c530 0x7f24e8102d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51396/0 (socket says 172.21.15.82:51396) 2024-05-03T22:16:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.840+0000 7f24e5e00700 1 -- 172.21.15.82:0/1569134301 learned_addr learned my addr 172.21.15.82:0/1569134301 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24e6800700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e806bb70 0x7f24e8102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24e7200700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e8109530 0x7f24e81032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24e5e00700 1 -- 172.21.15.82:0/1569134301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e806bb70 msgr2=0x7f24e8102850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24e5e00700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e806bb70 0x7f24e8102850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24e5e00700 1 -- 172.21.15.82:0/1569134301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e8109530 msgr2=0x7f24e81032d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24e5e00700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e8109530 0x7f24e81032d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24e5e00700 1 -- 172.21.15.82:0/1569134301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e81a7fc0 con 0x7f24e806c530 2024-05-03T22:16:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24e7200700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e8109530 0x7f24e81032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24e5e00700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e806c530 0x7f24e8102d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f24d400d980 tx=0x7f24d400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24df400700 1 -- 172.21.15.82:0/1569134301 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4017070 con 0x7f24e806c530 2024-05-03T22:16:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24df400700 1 -- 172.21.15.82:0/1569134301 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24d4004830 con 0x7f24e806c530 2024-05-03T22:16:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24df400700 1 -- 172.21.15.82:0/1569134301 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d40053a0 con 0x7f24e806c530 2024-05-03T22:16:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.841+0000 7f24ed400700 1 -- 172.21.15.82:0/1569134301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e81a8250 con 0x7f24e806c530 2024-05-03T22:16:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.842+0000 7f24ed400700 1 -- 172.21.15.82:0/1569134301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e81a8740 con 0x7f24e806c530 2024-05-03T22:16:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.843+0000 7f24ed400700 1 -- 172.21.15.82:0/1569134301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e8104bf0 con 0x7f24e806c530 2024-05-03T22:16:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.846+0000 7f24df400700 1 -- 172.21.15.82:0/1569134301 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f24d40049e0 con 0x7f24e806c530 2024-05-03T22:16:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.847+0000 7f24df400700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f24cc0b2910 0x7f24cc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.847+0000 7f24df400700 1 -- 172.21.15.82:0/1569134301 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f24d40e2b50 con 0x7f24e806c530 2024-05-03T22:16:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.848+0000 7f24e6800700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f24cc0b2910 0x7f24cc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.848+0000 7f24e6800700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f24cc0b2910 0x7f24cc0b4dd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f24d8005950 tx=0x7f24d80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:10.849+0000 7f24df400700 1 -- 172.21.15.82:0/1569134301 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f24d4020020 con 0x7f24e806c530 2024-05-03T22:16:11.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.087+0000 7f24ed400700 1 -- 172.21.15.82:0/1569134301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f24e802e510 con 0x7f24e806c530 2024-05-03T22:16:11.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.088+0000 7f24df400700 1 -- 172.21.15.82:0/1569134301 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f24d40aa2f0 con 0x7f24e806c530 2024-05-03T22:16:11.090 INFO:teuthology.orchestra.run.smithi082.stdout:111669149816 2024-05-03T22:16:11.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.091+0000 7f24ed400700 1 -- 172.21.15.82:0/1569134301 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f24cc0b2910 msgr2=0x7f24cc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:11.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.091+0000 7f24ed400700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f24cc0b2910 0x7f24cc0b4dd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f24d8005950 tx=0x7f24d80058e0 comp rx=0 tx=0).stop 2024-05-03T22:16:11.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.091+0000 7f24ed400700 1 -- 172.21.15.82:0/1569134301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e806c530 msgr2=0x7f24e8102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:11.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.091+0000 7f24ed400700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e806c530 0x7f24e8102d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f24d400d980 tx=0x7f24d400dd40 comp rx=0 tx=0).stop 2024-05-03T22:16:11.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.091+0000 7f24ed400700 1 -- 172.21.15.82:0/1569134301 shutdown_connections 2024-05-03T22:16:11.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.091+0000 7f24ed400700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f24cc0b2910 0x7f24cc0b4dd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:11.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.091+0000 7f24ed400700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e8109530 0x7f24e81032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:11.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.091+0000 7f24ed400700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24e806bb70 0x7f24e8102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:11.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.092+0000 7f24ed400700 1 --2- 172.21.15.82:0/1569134301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e806c530 0x7f24e8102d90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:11.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.092+0000 7f24ed400700 1 -- 172.21.15.82:0/1569134301 >> 172.21.15.82:0/1569134301 conn(0x7f24e8079350 msgr2=0x7f24e8101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:11.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.092+0000 7f24ed400700 1 -- 172.21.15.82:0/1569134301 shutdown_connections 2024-05-03T22:16:11.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:11.092+0000 7f24ed400700 1 -- 172.21.15.82:0/1569134301 wait complete. 2024-05-03T22:16:12.176 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411446 got 77309411454 for osd.2 2024-05-03T22:16:12.177 DEBUG:teuthology.parallel:result is None 2024-05-03T22:16:12.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:12 smithi116 ceph-mon[31828]: pgmap v489: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:12.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:12 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1569134301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-03T22:16:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:12 smithi082 ceph-mon[28404]: pgmap v489: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:12 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1569134301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-03T22:16:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:12 smithi130 ceph-mon[32417]: pgmap v489: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:12 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1569134301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-03T22:16:12.597 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757345 got 163208757352 for osd.5 2024-05-03T22:16:12.597 DEBUG:teuthology.parallel:result is None 2024-05-03T22:16:13.210 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561116 got 188978561122 for osd.6 2024-05-03T22:16:13.210 DEBUG:teuthology.parallel:result is None 2024-05-03T22:16:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.448+0000 7f5316000700 1 -- 172.21.15.82:0/766428435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5310106080 msgr2=0x7f5310112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.448+0000 7f5316000700 1 --2- 172.21.15.82:0/766428435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5310106080 0x7f5310112590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f530800b0a0 tx=0x7f530800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:16:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.448+0000 7f5316000700 1 -- 172.21.15.82:0/766428435 shutdown_connections 2024-05-03T22:16:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.448+0000 7f5316000700 1 --2- 172.21.15.82:0/766428435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5310106080 0x7f5310112590 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.448+0000 7f5316000700 1 --2- 172.21.15.82:0/766428435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f531010b6c0 0x7f531010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.448+0000 7f5316000700 1 --2- 172.21.15.82:0/766428435 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53101056c0 0x7f5310105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.448+0000 7f5316000700 1 -- 172.21.15.82:0/766428435 >> 172.21.15.82:0/766428435 conn(0x7f53101011b0 msgr2=0x7f53101035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.448+0000 7f5316000700 1 -- 172.21.15.82:0/766428435 shutdown_connections 2024-05-03T22:16:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.448+0000 7f5316000700 1 -- 172.21.15.82:0/766428435 wait complete. 2024-05-03T22:16:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.449+0000 7f5316000700 1 Processor -- start 2024-05-03T22:16:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.449+0000 7f5316000700 1 -- start start 2024-05-03T22:16:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f5316000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53101056c0 0x7f53101a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f5316000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5310106080 0x7f53101a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f5316000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f531010b6c0 0x7f531019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f5316000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5310115810 con 0x7f53101056c0 2024-05-03T22:16:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f5316000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5310115690 con 0x7f5310106080 2024-05-03T22:16:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f5316000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5310115990 con 0x7f531010b6c0 2024-05-03T22:16:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f530f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53101056c0 0x7f53101a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f530f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53101056c0 0x7f53101a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51404/0 (socket says 172.21.15.82:51404) 2024-05-03T22:16:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f530f400700 1 -- 172.21.15.82:0/1743766955 learned_addr learned my addr 172.21.15.82:0/1743766955 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f530ea00700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5310106080 0x7f53101a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f530fe00700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f531010b6c0 0x7f531019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f530f400700 1 -- 172.21.15.82:0/1743766955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f531010b6c0 msgr2=0x7f531019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f530f400700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f531010b6c0 0x7f531019ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f530f400700 1 -- 172.21.15.82:0/1743766955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5310106080 msgr2=0x7f53101a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f530f400700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5310106080 0x7f53101a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.450+0000 7f530f400700 1 -- 172.21.15.82:0/1743766955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531019c1b0 con 0x7f53101056c0 2024-05-03T22:16:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.451+0000 7f530f400700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53101056c0 0x7f53101a1890 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f530000d980 tx=0x7f530000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.451+0000 7f5307e00700 1 -- 172.21.15.82:0/1743766955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300017070 con 0x7f53101056c0 2024-05-03T22:16:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.451+0000 7f5307e00700 1 -- 172.21.15.82:0/1743766955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5300004830 con 0x7f53101056c0 2024-05-03T22:16:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.451+0000 7f5316000700 1 -- 172.21.15.82:0/1743766955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531019c440 con 0x7f53101056c0 2024-05-03T22:16:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.451+0000 7f5307e00700 1 -- 172.21.15.82:0/1743766955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53000053a0 con 0x7f53101056c0 2024-05-03T22:16:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.451+0000 7f5316000700 1 -- 172.21.15.82:0/1743766955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53101a8760 con 0x7f53101056c0 2024-05-03T22:16:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.452+0000 7f5316000700 1 -- 172.21.15.82:0/1743766955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531006a190 con 0x7f53101056c0 2024-05-03T22:16:13.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.455+0000 7f5307e00700 1 -- 172.21.15.82:0/1743766955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f53000049e0 con 0x7f53101056c0 2024-05-03T22:16:13.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.456+0000 7f5307e00700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52f40b2940 0x7f52f40b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:13.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.456+0000 7f5307e00700 1 -- 172.21.15.82:0/1743766955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f53000e2700 con 0x7f53101056c0 2024-05-03T22:16:13.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.456+0000 7f530ea00700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52f40b2940 0x7f52f40b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:13.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.457+0000 7f530ea00700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52f40b2940 0x7f52f40b4e00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f52fc005950 tx=0x7f52fc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:13.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.460+0000 7f5307e00700 1 -- 172.21.15.82:0/1743766955 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5300020020 con 0x7f53101056c0 2024-05-03T22:16:13.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.701+0000 7f5316000700 1 -- 172.21.15.82:0/1743766955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f531002e510 con 0x7f53101056c0 2024-05-03T22:16:13.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.702+0000 7f5307e00700 1 -- 172.21.15.82:0/1743766955 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f53000a9ea0 con 0x7f53101056c0 2024-05-03T22:16:13.704 INFO:teuthology.orchestra.run.smithi082.stdout:210453397596 2024-05-03T22:16:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.705+0000 7f5316000700 1 -- 172.21.15.82:0/1743766955 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52f40b2940 msgr2=0x7f52f40b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.705+0000 7f5316000700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52f40b2940 0x7f52f40b4e00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f52fc005950 tx=0x7f52fc0058e0 comp rx=0 tx=0).stop 2024-05-03T22:16:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.705+0000 7f5316000700 1 -- 172.21.15.82:0/1743766955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53101056c0 msgr2=0x7f53101a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.705+0000 7f5316000700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53101056c0 0x7f53101a1890 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f530000d980 tx=0x7f530000dd40 comp rx=0 tx=0).stop 2024-05-03T22:16:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.706+0000 7f5316000700 1 -- 172.21.15.82:0/1743766955 shutdown_connections 2024-05-03T22:16:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.706+0000 7f5316000700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f52f40b2940 0x7f52f40b4e00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.706+0000 7f5316000700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53101056c0 0x7f53101a1890 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.706+0000 7f5316000700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f531010b6c0 0x7f531019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.706+0000 7f5316000700 1 --2- 172.21.15.82:0/1743766955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5310106080 0x7f53101a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.706+0000 7f5316000700 1 -- 172.21.15.82:0/1743766955 >> 172.21.15.82:0/1743766955 conn(0x7f53101011b0 msgr2=0x7f53101016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:13.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.706+0000 7f5316000700 1 -- 172.21.15.82:0/1743766955 shutdown_connections 2024-05-03T22:16:13.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:13.706+0000 7f5316000700 1 -- 172.21.15.82:0/1743766955 wait complete. 2024-05-03T22:16:14.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.284+0000 7fc8a3200700 1 -- 172.21.15.82:0/1317274256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a41055d0 msgr2=0x7fc8a4105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:14.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.284+0000 7fc8a3200700 1 --2- 172.21.15.82:0/1317274256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a41055d0 0x7fc8a4105a50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc8900099c0 tx=0x7fc890009cd0 comp rx=0 tx=0).stop 2024-05-03T22:16:14.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.284+0000 7fc8a3200700 1 -- 172.21.15.82:0/1317274256 shutdown_connections 2024-05-03T22:16:14.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.284+0000 7fc8a3200700 1 --2- 172.21.15.82:0/1317274256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a4105f90 0x7fc8a4112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:14.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.284+0000 7fc8a3200700 1 --2- 172.21.15.82:0/1317274256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8a410b680 0x7fc8a410ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:14.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.284+0000 7fc8a3200700 1 --2- 172.21.15.82:0/1317274256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a41055d0 0x7fc8a4105a50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:14.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.284+0000 7fc8a3200700 1 -- 172.21.15.82:0/1317274256 >> 172.21.15.82:0/1317274256 conn(0x7fc8a41010e0 msgr2=0x7fc8a4103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:14.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.284+0000 7fc8a3200700 1 -- 172.21.15.82:0/1317274256 shutdown_connections 2024-05-03T22:16:14.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.285+0000 7fc8a3200700 1 -- 172.21.15.82:0/1317274256 wait complete. 2024-05-03T22:16:14.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.286+0000 7fc8a3200700 1 Processor -- start 2024-05-03T22:16:14.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.286+0000 7fc8a3200700 1 -- start start 2024-05-03T22:16:14.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.286+0000 7fc8a3200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a41055d0 0x7fc8a41a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:14.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.286+0000 7fc8a3200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a4105f90 0x7fc8a41a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:14.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.286+0000 7fc8a3200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8a410b680 0x7fc8a419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:14.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.286+0000 7fc8a3200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a41156e0 con 0x7fc8a4105f90 2024-05-03T22:16:14.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.286+0000 7fc8a3200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a4115560 con 0x7fc8a41055d0 2024-05-03T22:16:14.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.286+0000 7fc8a3200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a4115860 con 0x7fc8a410b680 2024-05-03T22:16:14.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.287+0000 7fc8a1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a4105f90 0x7fc8a41a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:14.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.287+0000 7fc8a1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a4105f90 0x7fc8a41a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40264/0 (socket says 172.21.15.82:40264) 2024-05-03T22:16:14.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.287+0000 7fc8a1400700 1 -- 172.21.15.82:0/4199658114 learned_addr learned my addr 172.21.15.82:0/4199658114 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:14.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.287+0000 7fc8a1e00700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a41055d0 0x7fc8a41a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:14.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.287+0000 7fc8a2800700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8a410b680 0x7fc8a419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:14.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.287+0000 7fc8a1400700 1 -- 172.21.15.82:0/4199658114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8a410b680 msgr2=0x7fc8a419ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:14.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.287+0000 7fc8a1400700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8a410b680 0x7fc8a419ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:14.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.287+0000 7fc8a1400700 1 -- 172.21.15.82:0/4199658114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a41055d0 msgr2=0x7fc8a41a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:14.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.287+0000 7fc8a1400700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a41055d0 0x7fc8a41a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:14.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.287+0000 7fc8a1400700 1 -- 172.21.15.82:0/4199658114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a419c1d0 con 0x7fc8a4105f90 2024-05-03T22:16:14.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.287+0000 7fc8a1400700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a4105f90 0x7fc8a41a1df0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc890005910 tx=0x7fc8900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:14.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.288+0000 7fc89aa00700 1 -- 172.21.15.82:0/4199658114 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc890026070 con 0x7fc8a4105f90 2024-05-03T22:16:14.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.288+0000 7fc89aa00700 1 -- 172.21.15.82:0/4199658114 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc89000f460 con 0x7fc8a4105f90 2024-05-03T22:16:14.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.288+0000 7fc8a3200700 1 -- 172.21.15.82:0/4199658114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a419c460 con 0x7fc8a4105f90 2024-05-03T22:16:14.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.288+0000 7fc89aa00700 1 -- 172.21.15.82:0/4199658114 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc890009e60 con 0x7fc8a4105f90 2024-05-03T22:16:14.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.288+0000 7fc8a3200700 1 -- 172.21.15.82:0/4199658114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a41a8780 con 0x7fc8a4105f90 2024-05-03T22:16:14.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.289+0000 7fc8a3200700 1 -- 172.21.15.82:0/4199658114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a410db10 con 0x7fc8a4105f90 2024-05-03T22:16:14.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.293+0000 7fc89aa00700 1 -- 172.21.15.82:0/4199658114 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc890029070 con 0x7fc8a4105f90 2024-05-03T22:16:14.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.294+0000 7fc89aa00700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8880b2910 0x7fc8880b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:14.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.295+0000 7fc89aa00700 1 -- 172.21.15.82:0/4199658114 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fc8900e3280 con 0x7fc8a4105f90 2024-05-03T22:16:14.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.295+0000 7fc8a1e00700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8880b2910 0x7fc8880b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:14.297 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:14 smithi082 ceph-mon[28404]: pgmap v490: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:14.297 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:14 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1743766955' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-03T22:16:14.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.296+0000 7fc8a1e00700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8880b2910 0x7fc8880b4dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc8a419cbb0 tx=0x7fc894009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:14.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.298+0000 7fc89aa00700 1 -- 172.21.15.82:0/4199658114 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc890030080 con 0x7fc8a4105f90 2024-05-03T22:16:14.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:14 smithi116 ceph-mon[31828]: pgmap v490: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:14.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:14 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1743766955' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-03T22:16:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:14 smithi130 ceph-mon[32417]: pgmap v490: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:14 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1743766955' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-03T22:16:14.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.532+0000 7fc8a3200700 1 -- 172.21.15.82:0/4199658114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc8a419cfa0 con 0x7fc8a4105f90 2024-05-03T22:16:14.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.533+0000 7fc89aa00700 1 -- 172.21.15.82:0/4199658114 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc890013070 con 0x7fc8a4105f90 2024-05-03T22:16:14.534 INFO:teuthology.orchestra.run.smithi082.stdout:261993005132 2024-05-03T22:16:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 -- 172.21.15.82:0/4199658114 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8880b2910 msgr2=0x7fc8880b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8880b2910 0x7fc8880b4dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc8a419cbb0 tx=0x7fc894009260 comp rx=0 tx=0).stop 2024-05-03T22:16:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 -- 172.21.15.82:0/4199658114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a4105f90 msgr2=0x7fc8a41a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a4105f90 0x7fc8a41a1df0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc890005910 tx=0x7fc8900045e0 comp rx=0 tx=0).stop 2024-05-03T22:16:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 -- 172.21.15.82:0/4199658114 shutdown_connections 2024-05-03T22:16:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8880b2910 0x7fc8880b4dd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc8a410b680 0x7fc8a419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a41055d0 0x7fc8a41a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 --2- 172.21.15.82:0/4199658114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a4105f90 0x7fc8a41a1df0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 -- 172.21.15.82:0/4199658114 >> 172.21.15.82:0/4199658114 conn(0x7fc8a41010e0 msgr2=0x7fc8a41029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:14.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 -- 172.21.15.82:0/4199658114 shutdown_connections 2024-05-03T22:16:14.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:14.536+0000 7fc8a3200700 1 -- 172.21.15.82:0/4199658114 wait complete. 2024-05-03T22:16:15.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:15 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/4199658114' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-03T22:16:15.283 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149809 got 111669149816 for osd.3 2024-05-03T22:16:15.283 DEBUG:teuthology.parallel:result is None 2024-05-03T22:16:15.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:15 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/4199658114' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-03T22:16:15.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:15 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/4199658114' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-03T22:16:16.153 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005126 got 261993005132 for osd.9 2024-05-03T22:16:16.153 DEBUG:teuthology.parallel:result is None 2024-05-03T22:16:16.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:16 smithi116 ceph-mon[31828]: pgmap v491: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:16 smithi082 ceph-mon[28404]: pgmap v491: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:16 smithi130 ceph-mon[32417]: pgmap v491: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:16.571 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397589 got 210453397596 for osd.7 2024-05-03T22:16:16.571 DEBUG:teuthology.parallel:result is None 2024-05-03T22:16:16.572 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-03T22:16:16.572 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T22:16:17.031 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:16:18.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:18 smithi116 ceph-mon[31828]: pgmap v492: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:18.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:18 smithi082 ceph-mon[28404]: pgmap v492: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:18.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:18 smithi130 ceph-mon[32417]: pgmap v492: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.527+0000 7f8e01c00700 1 -- 172.21.15.82:0/3983868444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc0756d0 msgr2=0x7f8dfc075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.527+0000 7f8e01c00700 1 --2- 172.21.15.82:0/3983868444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc0756d0 0x7f8dfc075ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8dec009990 tx=0x7f8dec009ca0 comp rx=0 tx=0).stop 2024-05-03T22:16:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.527+0000 7f8e01c00700 1 -- 172.21.15.82:0/3983868444 shutdown_connections 2024-05-03T22:16:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.527+0000 7f8e01c00700 1 --2- 172.21.15.82:0/3983868444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc0756d0 0x7f8dfc075ab0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.527+0000 7f8e01c00700 1 --2- 172.21.15.82:0/3983868444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dfc10fea0 0x7f8dfc112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.527+0000 7f8e01c00700 1 --2- 172.21.15.82:0/3983868444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dfc075ff0 0x7f8dfc10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.527+0000 7f8e01c00700 1 -- 172.21.15.82:0/3983868444 >> 172.21.15.82:0/3983868444 conn(0x7f8dfc07a600 msgr2=0x7f8dfc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.527+0000 7f8e01c00700 1 -- 172.21.15.82:0/3983868444 shutdown_connections 2024-05-03T22:16:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.527+0000 7f8e01c00700 1 -- 172.21.15.82:0/3983868444 wait complete. 2024-05-03T22:16:19.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.528+0000 7f8e01c00700 1 Processor -- start 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.529+0000 7f8e01c00700 1 -- start start 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.529+0000 7f8e01c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dfc0756d0 0x7f8dfc1a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.529+0000 7f8e01c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dfc075ff0 0x7f8dfc1a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.529+0000 7f8e01c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc10fea0 0x7f8dfc19baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.529+0000 7f8e01c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc115730 con 0x7f8dfc10fea0 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.529+0000 7f8e01c00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc1155b0 con 0x7f8dfc075ff0 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.529+0000 7f8e01c00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc1158b0 con 0x7f8dfc0756d0 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.530+0000 7f8dfb400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc10fea0 0x7f8dfc19baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.530+0000 7f8dfb400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc10fea0 0x7f8dfc19baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40284/0 (socket says 172.21.15.82:40284) 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.530+0000 7f8dfb400700 1 -- 172.21.15.82:0/4127481689 learned_addr learned my addr 172.21.15.82:0/4127481689 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.530+0000 7f8dfa000700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dfc075ff0 0x7f8dfc1a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:19.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.530+0000 7f8dfaa00700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dfc0756d0 0x7f8dfc1a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:19.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.530+0000 7f8dfb400700 1 -- 172.21.15.82:0/4127481689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dfc0756d0 msgr2=0x7f8dfc1a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:19.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.530+0000 7f8dfb400700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dfc0756d0 0x7f8dfc1a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:19.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.530+0000 7f8dfb400700 1 -- 172.21.15.82:0/4127481689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dfc075ff0 msgr2=0x7f8dfc1a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:19.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.530+0000 7f8dfb400700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dfc075ff0 0x7f8dfc1a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:19.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.530+0000 7f8dfb400700 1 -- 172.21.15.82:0/4127481689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc19c250 con 0x7f8dfc10fea0 2024-05-03T22:16:19.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.531+0000 7f8dfb400700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc10fea0 0x7f8dfc19baf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8df400ada0 tx=0x7f8df400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:19.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.531+0000 7f8df3400700 1 -- 172.21.15.82:0/4127481689 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4017020 con 0x7f8dfc10fea0 2024-05-03T22:16:19.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.531+0000 7f8df3400700 1 -- 172.21.15.82:0/4127481689 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8df4007e30 con 0x7f8dfc10fea0 2024-05-03T22:16:19.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.531+0000 7f8e01c00700 1 -- 172.21.15.82:0/4127481689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dfc19c540 con 0x7f8dfc10fea0 2024-05-03T22:16:19.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.531+0000 7f8df3400700 1 -- 172.21.15.82:0/4127481689 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4005390 con 0x7f8dfc10fea0 2024-05-03T22:16:19.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.531+0000 7f8e01c00700 1 -- 172.21.15.82:0/4127481689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dfc1a87b0 con 0x7f8dfc10fea0 2024-05-03T22:16:19.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.533+0000 7f8e01c00700 1 -- 172.21.15.82:0/4127481689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dfc06a190 con 0x7f8dfc10fea0 2024-05-03T22:16:19.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.535+0000 7f8df3400700 1 -- 172.21.15.82:0/4127481689 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8df4004ad0 con 0x7f8dfc10fea0 2024-05-03T22:16:19.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.536+0000 7f8df3400700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8de00b2910 0x7f8de00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:19.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.536+0000 7f8df3400700 1 -- 172.21.15.82:0/4127481689 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f8df40e1fd0 con 0x7f8dfc10fea0 2024-05-03T22:16:19.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.537+0000 7f8dfaa00700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8de00b2910 0x7f8de00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:19.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.537+0000 7f8dfaa00700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8de00b2910 0x7f8de00b4dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8dec006010 tx=0x7f8dec01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:19.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.541+0000 7f8df3400700 1 -- 172.21.15.82:0/4127481689 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8df4021020 con 0x7f8dfc10fea0 2024-05-03T22:16:19.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.773+0000 7f8e01c00700 1 -- 172.21.15.82:0/4127481689 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8dfc0638e0 con 0x7f8de00b2910 2024-05-03T22:16:19.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.794+0000 7f8df3400700 1 -- 172.21.15.82:0/4127481689 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340415 (secure 0 0 0) 0x7f8dec07b1d0 con 0x7f8de00b2910 2024-05-03T22:16:19.802 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:16:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.800+0000 7f8e01c00700 1 -- 172.21.15.82:0/4127481689 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8de00b2910 msgr2=0x7f8de00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.800+0000 7f8e01c00700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8de00b2910 0x7f8de00b4dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8dec006010 tx=0x7f8dec01a040 comp rx=0 tx=0).stop 2024-05-03T22:16:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.800+0000 7f8e01c00700 1 -- 172.21.15.82:0/4127481689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc10fea0 msgr2=0x7f8dfc19baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.800+0000 7f8e01c00700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc10fea0 0x7f8dfc19baf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8df400ada0 tx=0x7f8df400c330 comp rx=0 tx=0).stop 2024-05-03T22:16:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.801+0000 7f8e01c00700 1 -- 172.21.15.82:0/4127481689 shutdown_connections 2024-05-03T22:16:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.801+0000 7f8e01c00700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8de00b2910 0x7f8de00b4dd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.801+0000 7f8e01c00700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dfc10fea0 0x7f8dfc19baf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.801+0000 7f8e01c00700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dfc0756d0 0x7f8dfc1a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.801+0000 7f8e01c00700 1 --2- 172.21.15.82:0/4127481689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dfc075ff0 0x7f8dfc1a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.801+0000 7f8e01c00700 1 -- 172.21.15.82:0/4127481689 >> 172.21.15.82:0/4127481689 conn(0x7f8dfc07a600 msgr2=0x7f8dfc100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.801+0000 7f8e01c00700 1 -- 172.21.15.82:0/4127481689 shutdown_connections 2024-05-03T22:16:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:19.801+0000 7f8e01c00700 1 -- 172.21.15.82:0/4127481689 wait complete. 2024-05-03T22:16:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-03T22:16:20.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:20 smithi116 ceph-mon[31828]: pgmap v493: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:20.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:20 smithi082 ceph-mon[28404]: pgmap v493: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:20 smithi130 ceph-mon[32417]: pgmap v493: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:20.883 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":493,"stamp":"2024-05-03T22:16:18.697816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655757,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1407,"num_read_kb":795,"num_write":374,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2952624,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359664,"kb_used_data":14600,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124582160,"statfs":{"total":1151940427776,"available":1151572131840,"internally_reserved":0,"allocated":14950400,"data_stored":8294597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005582"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288498+0000","last_change":"2024-05-03T22:12:36.021433+0000","last_active":"2024-05-03T22:14:38.288498+0000","last_peered":"2024-05-03T22:14:38.288498+0000","last_clean":"2024-05-03T22:14:38.288498+0000","last_became_active":"2024-05-03T22:12:36.019902+0000","last_became_peered":"2024-05-03T22:12:36.019902+0000","last_unstale":"2024-05-03T22:14:38.288498+0000","last_undegraded":"2024-05-03T22:14:38.288498+0000","last_fullsized":"2024-05-03T22:14:38.288498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:08:27.361044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298298+0000","last_change":"2024-05-03T22:12:36.012811+0000","last_active":"2024-05-03T22:14:38.298298+0000","last_peered":"2024-05-03T22:14:38.298298+0000","last_clean":"2024-05-03T22:14:38.298298+0000","last_became_active":"2024-05-03T22:12:36.012491+0000","last_became_peered":"2024-05-03T22:12:36.012491+0000","last_unstale":"2024-05-03T22:14:38.298298+0000","last_undegraded":"2024-05-03T22:14:38.298298+0000","last_fullsized":"2024-05-03T22:14:38.298298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:19:01.773304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297615+0000","last_change":"2024-05-03T22:12:36.009783+0000","last_active":"2024-05-03T22:14:38.297615+0000","last_peered":"2024-05-03T22:14:38.297615+0000","last_clean":"2024-05-03T22:14:38.297615+0000","last_became_active":"2024-05-03T22:12:36.009461+0000","last_became_peered":"2024-05-03T22:12:36.009461+0000","last_unstale":"2024-05-03T22:14:38.297615+0000","last_undegraded":"2024-05-03T22:14:38.297615+0000","last_fullsized":"2024-05-03T22:14:38.297615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:04:17.127323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283737+0000","last_change":"2024-05-03T22:12:36.005887+0000","last_active":"2024-05-03T22:14:38.283737+0000","last_peered":"2024-05-03T22:14:38.283737+0000","last_clean":"2024-05-03T22:14:38.283737+0000","last_became_active":"2024-05-03T22:12:36.005519+0000","last_became_peered":"2024-05-03T22:12:36.005519+0000","last_unstale":"2024-05-03T22:14:38.283737+0000","last_undegraded":"2024-05-03T22:14:38.283737+0000","last_fullsized":"2024-05-03T22:14:38.283737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:15:23.962047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285269+0000","last_change":"2024-05-03T22:12:35.988566+0000","last_active":"2024-05-03T22:14:38.285269+0000","last_peered":"2024-05-03T22:14:38.285269+0000","last_clean":"2024-05-03T22:14:38.285269+0000","last_became_active":"2024-05-03T22:12:35.986766+0000","last_became_peered":"2024-05-03T22:12:35.986766+0000","last_unstale":"2024-05-03T22:14:38.285269+0000","last_undegraded":"2024-05-03T22:14:38.285269+0000","last_fullsized":"2024-05-03T22:14:38.285269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:38:52.877608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036290+0000","last_change":"2024-05-03T22:12:36.013994+0000","last_active":"2024-05-03T22:14:39.036290+0000","last_peered":"2024-05-03T22:14:39.036290+0000","last_clean":"2024-05-03T22:14:39.036290+0000","last_became_active":"2024-05-03T22:12:36.013134+0000","last_became_peered":"2024-05-03T22:12:36.013134+0000","last_unstale":"2024-05-03T22:14:39.036290+0000","last_undegraded":"2024-05-03T22:14:39.036290+0000","last_fullsized":"2024-05-03T22:14:39.036290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:21:47.881727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288908+0000","last_change":"2024-05-03T22:12:36.016165+0000","last_active":"2024-05-03T22:14:38.288908+0000","last_peered":"2024-05-03T22:14:38.288908+0000","last_clean":"2024-05-03T22:14:38.288908+0000","last_became_active":"2024-05-03T22:12:36.009230+0000","last_became_peered":"2024-05-03T22:12:36.009230+0000","last_unstale":"2024-05-03T22:14:38.288908+0000","last_undegraded":"2024-05-03T22:14:38.288908+0000","last_fullsized":"2024-05-03T22:14:38.288908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:27:38.042296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290453+0000","last_change":"2024-05-03T22:12:36.006859+0000","last_active":"2024-05-03T22:14:38.290453+0000","last_peered":"2024-05-03T22:14:38.290453+0000","last_clean":"2024-05-03T22:14:38.290453+0000","last_became_active":"2024-05-03T22:12:36.006396+0000","last_became_peered":"2024-05-03T22:12:36.006396+0000","last_unstale":"2024-05-03T22:14:38.290453+0000","last_undegraded":"2024-05-03T22:14:38.290453+0000","last_fullsized":"2024-05-03T22:14:38.290453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:45:00.863115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728852+0000","last_change":"2024-05-03T22:12:36.020513+0000","last_active":"2024-05-03T22:14:38.728852+0000","last_peered":"2024-05-03T22:14:38.728852+0000","last_clean":"2024-05-03T22:14:38.728852+0000","last_became_active":"2024-05-03T22:12:36.017852+0000","last_became_peered":"2024-05-03T22:12:36.017852+0000","last_unstale":"2024-05-03T22:14:38.728852+0000","last_undegraded":"2024-05-03T22:14:38.728852+0000","last_fullsized":"2024-05-03T22:14:38.728852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:20:33.567258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036842+0000","last_change":"2024-05-03T22:12:36.009729+0000","last_active":"2024-05-03T22:14:39.036842+0000","last_peered":"2024-05-03T22:14:39.036842+0000","last_clean":"2024-05-03T22:14:39.036842+0000","last_became_active":"2024-05-03T22:12:36.007356+0000","last_became_peered":"2024-05-03T22:12:36.007356+0000","last_unstale":"2024-05-03T22:14:39.036842+0000","last_undegraded":"2024-05-03T22:14:39.036842+0000","last_fullsized":"2024-05-03T22:14:39.036842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:49:56.964694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289209+0000","last_change":"2024-05-03T22:12:36.019438+0000","last_active":"2024-05-03T22:14:38.289209+0000","last_peered":"2024-05-03T22:14:38.289209+0000","last_clean":"2024-05-03T22:14:38.289209+0000","last_became_active":"2024-05-03T22:12:36.019049+0000","last_became_peered":"2024-05-03T22:12:36.019049+0000","last_unstale":"2024-05-03T22:14:38.289209+0000","last_undegraded":"2024-05-03T22:14:38.289209+0000","last_fullsized":"2024-05-03T22:14:38.289209+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:06:01.344591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283667+0000","last_change":"2024-05-03T22:12:36.015763+0000","last_active":"2024-05-03T22:14:38.283667+0000","last_peered":"2024-05-03T22:14:38.283667+0000","last_clean":"2024-05-03T22:14:38.283667+0000","last_became_active":"2024-05-03T22:12:36.010804+0000","last_became_peered":"2024-05-03T22:12:36.010804+0000","last_unstale":"2024-05-03T22:14:38.283667+0000","last_undegraded":"2024-05-03T22:14:38.283667+0000","last_fullsized":"2024-05-03T22:14:38.283667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:06:14.150027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289012+0000","last_change":"2024-05-03T22:12:36.018442+0000","last_active":"2024-05-03T22:14:38.289012+0000","last_peered":"2024-05-03T22:14:38.289012+0000","last_clean":"2024-05-03T22:14:38.289012+0000","last_became_active":"2024-05-03T22:12:36.017288+0000","last_became_peered":"2024-05-03T22:12:36.017288+0000","last_unstale":"2024-05-03T22:14:38.289012+0000","last_undegraded":"2024-05-03T22:14:38.289012+0000","last_fullsized":"2024-05-03T22:14:38.289012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:06.097579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.296827+0000","last_change":"2024-05-03T22:12:36.015322+0000","last_active":"2024-05-03T22:14:38.296827+0000","last_peered":"2024-05-03T22:14:38.296827+0000","last_clean":"2024-05-03T22:14:38.296827+0000","last_became_active":"2024-05-03T22:12:36.014933+0000","last_became_peered":"2024-05-03T22:12:36.014933+0000","last_unstale":"2024-05-03T22:14:38.296827+0000","last_undegraded":"2024-05-03T22:14:38.296827+0000","last_fullsized":"2024-05-03T22:14:38.296827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:35:07.654487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.296705+0000","last_change":"2024-05-03T22:12:36.016161+0000","last_active":"2024-05-03T22:14:38.296705+0000","last_peered":"2024-05-03T22:14:38.296705+0000","last_clean":"2024-05-03T22:14:38.296705+0000","last_became_active":"2024-05-03T22:12:36.015827+0000","last_became_peered":"2024-05-03T22:12:36.015827+0000","last_unstale":"2024-05-03T22:14:38.296705+0000","last_undegraded":"2024-05-03T22:14:38.296705+0000","last_fullsized":"2024-05-03T22:14:38.296705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:27.585544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.727778+0000","last_change":"2024-05-03T22:12:36.010741+0000","last_active":"2024-05-03T22:14:38.727778+0000","last_peered":"2024-05-03T22:14:38.727778+0000","last_clean":"2024-05-03T22:14:38.727778+0000","last_became_active":"2024-05-03T22:12:36.010391+0000","last_became_peered":"2024-05-03T22:12:36.010391+0000","last_unstale":"2024-05-03T22:14:38.727778+0000","last_undegraded":"2024-05-03T22:14:38.727778+0000","last_fullsized":"2024-05-03T22:14:38.727778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:58:18.400114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287618+0000","last_change":"2024-05-03T22:12:36.024248+0000","last_active":"2024-05-03T22:14:38.287618+0000","last_peered":"2024-05-03T22:14:38.287618+0000","last_clean":"2024-05-03T22:14:38.287618+0000","last_became_active":"2024-05-03T22:12:36.023864+0000","last_became_peered":"2024-05-03T22:12:36.023864+0000","last_unstale":"2024-05-03T22:14:38.287618+0000","last_undegraded":"2024-05-03T22:14:38.287618+0000","last_fullsized":"2024-05-03T22:14:38.287618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:29:22.455105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285872+0000","last_change":"2024-05-03T22:12:36.006077+0000","last_active":"2024-05-03T22:14:38.285872+0000","last_peered":"2024-05-03T22:14:38.285872+0000","last_clean":"2024-05-03T22:14:38.285872+0000","last_became_active":"2024-05-03T22:12:36.005745+0000","last_became_peered":"2024-05-03T22:12:36.005745+0000","last_unstale":"2024-05-03T22:14:38.285872+0000","last_undegraded":"2024-05-03T22:14:38.285872+0000","last_fullsized":"2024-05-03T22:14:38.285872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:46:47.245132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.292534+0000","last_change":"2024-05-03T22:12:36.001122+0000","last_active":"2024-05-03T22:14:38.292534+0000","last_peered":"2024-05-03T22:14:38.292534+0000","last_clean":"2024-05-03T22:14:38.292534+0000","last_became_active":"2024-05-03T22:12:36.000396+0000","last_became_peered":"2024-05-03T22:12:36.000396+0000","last_unstale":"2024-05-03T22:14:38.292534+0000","last_undegraded":"2024-05-03T22:14:38.292534+0000","last_fullsized":"2024-05-03T22:14:38.292534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:13:50.457303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291483+0000","last_change":"2024-05-03T22:12:52.138524+0000","last_active":"2024-05-03T22:14:38.291483+0000","last_peered":"2024-05-03T22:14:38.291483+0000","last_clean":"2024-05-03T22:14:38.291483+0000","last_became_active":"2024-05-03T22:12:52.136455+0000","last_became_peered":"2024-05-03T22:12:52.136455+0000","last_unstale":"2024-05-03T22:14:38.291483+0000","last_undegraded":"2024-05-03T22:14:38.291483+0000","last_fullsized":"2024-05-03T22:14:38.291483+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:46:24.807062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":207,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:13.004192+0000","last_change":"2024-05-03T22:14:38.745729+0000","last_active":"2024-05-03T22:16:13.004192+0000","last_peered":"2024-05-03T22:16:13.004192+0000","last_clean":"2024-05-03T22:16:13.004192+0000","last_became_active":"2024-05-03T22:14:38.730211+0000","last_became_peered":"2024-05-03T22:14:38.730211+0000","last_unstale":"2024-05-03T22:16:13.004192+0000","last_undegraded":"2024-05-03T22:16:13.004192+0000","last_fullsized":"2024-05-03T22:16:13.004192+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:23:32.539747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290952+0000","last_change":"2024-05-03T22:12:36.008931+0000","last_active":"2024-05-03T22:14:38.290952+0000","last_peered":"2024-05-03T22:14:38.290952+0000","last_clean":"2024-05-03T22:14:38.290952+0000","last_became_active":"2024-05-03T22:12:36.008550+0000","last_became_peered":"2024-05-03T22:12:36.008550+0000","last_unstale":"2024-05-03T22:14:38.290952+0000","last_undegraded":"2024-05-03T22:14:38.290952+0000","last_fullsized":"2024-05-03T22:14:38.290952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:14.542598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283233+0000","last_change":"2024-05-03T22:13:37.973509+0000","last_active":"2024-05-03T22:14:38.283233+0000","last_peered":"2024-05-03T22:14:38.283233+0000","last_clean":"2024-05-03T22:14:38.283233+0000","last_became_active":"2024-05-03T22:13:37.972160+0000","last_became_peered":"2024-05-03T22:13:37.972160+0000","last_unstale":"2024-05-03T22:14:38.283233+0000","last_undegraded":"2024-05-03T22:14:38.283233+0000","last_fullsized":"2024-05-03T22:14:38.283233+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:04.292667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291284+0000","last_change":"2024-05-03T22:12:32.023501+0000","last_active":"2024-05-03T22:14:38.291284+0000","last_peered":"2024-05-03T22:14:38.291284+0000","last_clean":"2024-05-03T22:14:38.291284+0000","last_became_active":"2024-05-03T22:12:32.022961+0000","last_became_peered":"2024-05-03T22:12:32.022961+0000","last_unstale":"2024-05-03T22:14:38.291284+0000","last_undegraded":"2024-05-03T22:14:38.291284+0000","last_fullsized":"2024-05-03T22:14:38.291284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:03:42.477600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298613+0000","last_change":"2024-05-03T22:12:36.003449+0000","last_active":"2024-05-03T22:14:38.298613+0000","last_peered":"2024-05-03T22:14:38.298613+0000","last_clean":"2024-05-03T22:14:38.298613+0000","last_became_active":"2024-05-03T22:12:36.002257+0000","last_became_peered":"2024-05-03T22:12:36.002257+0000","last_unstale":"2024-05-03T22:14:38.298613+0000","last_undegraded":"2024-05-03T22:14:38.298613+0000","last_fullsized":"2024-05-03T22:14:38.298613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:52:38.409271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283420+0000","last_change":"2024-05-03T22:12:52.143583+0000","last_active":"2024-05-03T22:14:38.283420+0000","last_peered":"2024-05-03T22:14:38.283420+0000","last_clean":"2024-05-03T22:14:38.283420+0000","last_became_active":"2024-05-03T22:12:52.142656+0000","last_became_peered":"2024-05-03T22:12:52.142656+0000","last_unstale":"2024-05-03T22:14:38.283420+0000","last_undegraded":"2024-05-03T22:14:38.283420+0000","last_fullsized":"2024-05-03T22:14:38.283420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:13:37.342909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":58,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285797+0000","last_change":"2024-05-03T22:12:31.985223+0000","last_active":"2024-05-03T22:14:38.285797+0000","last_peered":"2024-05-03T22:14:38.285797+0000","last_clean":"2024-05-03T22:14:38.285797+0000","last_became_active":"2024-05-03T22:12:31.984728+0000","last_became_peered":"2024-05-03T22:12:31.984728+0000","last_unstale":"2024-05-03T22:14:38.285797+0000","last_undegraded":"2024-05-03T22:14:38.285797+0000","last_fullsized":"2024-05-03T22:14:38.285797+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:16.493672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728388+0000","last_change":"2024-05-03T22:12:35.999341+0000","last_active":"2024-05-03T22:14:38.728388+0000","last_peered":"2024-05-03T22:14:38.728388+0000","last_clean":"2024-05-03T22:14:38.728388+0000","last_became_active":"2024-05-03T22:12:35.998263+0000","last_became_peered":"2024-05-03T22:12:35.998263+0000","last_unstale":"2024-05-03T22:14:38.728388+0000","last_undegraded":"2024-05-03T22:14:38.728388+0000","last_fullsized":"2024-05-03T22:14:38.728388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:48:23.344678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283346+0000","last_change":"2024-05-03T22:12:52.137263+0000","last_active":"2024-05-03T22:14:38.283346+0000","last_peered":"2024-05-03T22:14:38.283346+0000","last_clean":"2024-05-03T22:14:38.283346+0000","last_became_active":"2024-05-03T22:12:52.136252+0000","last_became_peered":"2024-05-03T22:12:52.136252+0000","last_unstale":"2024-05-03T22:14:38.283346+0000","last_undegraded":"2024-05-03T22:14:38.283346+0000","last_fullsized":"2024-05-03T22:14:38.283346+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:51:13.215710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285356+0000","last_change":"2024-05-03T22:12:31.981027+0000","last_active":"2024-05-03T22:14:38.285356+0000","last_peered":"2024-05-03T22:14:38.285356+0000","last_clean":"2024-05-03T22:14:38.285356+0000","last_became_active":"2024-05-03T22:12:31.980525+0000","last_became_peered":"2024-05-03T22:12:31.980525+0000","last_unstale":"2024-05-03T22:14:38.285356+0000","last_undegraded":"2024-05-03T22:14:38.285356+0000","last_fullsized":"2024-05-03T22:14:38.285356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:45:00.651947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038208+0000","last_change":"2024-05-03T22:12:36.018950+0000","last_active":"2024-05-03T22:14:39.038208+0000","last_peered":"2024-05-03T22:14:39.038208+0000","last_clean":"2024-05-03T22:14:39.038208+0000","last_became_active":"2024-05-03T22:12:36.018617+0000","last_became_peered":"2024-05-03T22:12:36.018617+0000","last_unstale":"2024-05-03T22:14:39.038208+0000","last_undegraded":"2024-05-03T22:14:39.038208+0000","last_fullsized":"2024-05-03T22:14:39.038208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:14:03.619225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.292272+0000","last_change":"2024-05-03T22:12:52.127174+0000","last_active":"2024-05-03T22:14:38.292272+0000","last_peered":"2024-05-03T22:14:38.292272+0000","last_clean":"2024-05-03T22:14:38.292272+0000","last_became_active":"2024-05-03T22:12:52.125762+0000","last_became_peered":"2024-05-03T22:12:52.125762+0000","last_unstale":"2024-05-03T22:14:38.292272+0000","last_undegraded":"2024-05-03T22:14:38.292272+0000","last_fullsized":"2024-05-03T22:14:38.292272+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:21:20.502831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'6","reported_seq":184,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:14.517673+0000","last_change":"2024-05-03T22:12:31.983721+0000","last_active":"2024-05-03T22:16:14.517673+0000","last_peered":"2024-05-03T22:16:14.517673+0000","last_clean":"2024-05-03T22:16:14.517673+0000","last_became_active":"2024-05-03T22:12:31.983192+0000","last_became_peered":"2024-05-03T22:12:31.983192+0000","last_unstale":"2024-05-03T22:16:14.517673+0000","last_undegraded":"2024-05-03T22:16:14.517673+0000","last_fullsized":"2024-05-03T22:16:14.517673+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:02:28.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284857+0000","last_change":"2024-05-03T22:12:36.012909+0000","last_active":"2024-05-03T22:14:38.284857+0000","last_peered":"2024-05-03T22:14:38.284857+0000","last_clean":"2024-05-03T22:14:38.284857+0000","last_became_active":"2024-05-03T22:12:36.011402+0000","last_became_peered":"2024-05-03T22:12:36.011402+0000","last_unstale":"2024-05-03T22:14:38.284857+0000","last_undegraded":"2024-05-03T22:14:38.284857+0000","last_fullsized":"2024-05-03T22:14:38.284857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:46:31.464317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291685+0000","last_change":"2024-05-03T22:13:37.973869+0000","last_active":"2024-05-03T22:14:38.291685+0000","last_peered":"2024-05-03T22:14:38.291685+0000","last_clean":"2024-05-03T22:14:38.291685+0000","last_became_active":"2024-05-03T22:13:37.972089+0000","last_became_peered":"2024-05-03T22:13:37.972089+0000","last_unstale":"2024-05-03T22:14:38.291685+0000","last_undegraded":"2024-05-03T22:14:38.291685+0000","last_fullsized":"2024-05-03T22:14:38.291685+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:18:00.510183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,10],"acting":[2,6,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036289+0000","last_change":"2024-05-03T22:12:31.984789+0000","last_active":"2024-05-03T22:14:39.036289+0000","last_peered":"2024-05-03T22:14:39.036289+0000","last_clean":"2024-05-03T22:14:39.036289+0000","last_became_active":"2024-05-03T22:12:31.980106+0000","last_became_peered":"2024-05-03T22:12:31.980106+0000","last_unstale":"2024-05-03T22:14:39.036289+0000","last_undegraded":"2024-05-03T22:14:39.036289+0000","last_fullsized":"2024-05-03T22:14:39.036289+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:50:09.564802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038328+0000","last_change":"2024-05-03T22:13:37.973316+0000","last_active":"2024-05-03T22:14:39.038328+0000","last_peered":"2024-05-03T22:14:39.038328+0000","last_clean":"2024-05-03T22:14:39.038328+0000","last_became_active":"2024-05-03T22:13:37.972152+0000","last_became_peered":"2024-05-03T22:13:37.972152+0000","last_unstale":"2024-05-03T22:14:39.038328+0000","last_undegraded":"2024-05-03T22:14:39.038328+0000","last_fullsized":"2024-05-03T22:14:39.038328+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:23:21.940322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287468+0000","last_change":"2024-05-03T22:12:52.145126+0000","last_active":"2024-05-03T22:14:38.287468+0000","last_peered":"2024-05-03T22:14:38.287468+0000","last_clean":"2024-05-03T22:14:38.287468+0000","last_became_active":"2024-05-03T22:12:52.144544+0000","last_became_peered":"2024-05-03T22:12:52.144544+0000","last_unstale":"2024-05-03T22:14:38.287468+0000","last_undegraded":"2024-05-03T22:14:38.287468+0000","last_fullsized":"2024-05-03T22:14:38.287468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:59:54.069750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287280+0000","last_change":"2024-05-03T22:12:31.978411+0000","last_active":"2024-05-03T22:14:38.287280+0000","last_peered":"2024-05-03T22:14:38.287280+0000","last_clean":"2024-05-03T22:14:38.287280+0000","last_became_active":"2024-05-03T22:12:31.976914+0000","last_became_peered":"2024-05-03T22:12:31.976914+0000","last_unstale":"2024-05-03T22:14:38.287280+0000","last_undegraded":"2024-05-03T22:14:38.287280+0000","last_fullsized":"2024-05-03T22:14:38.287280+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:52:05.545111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290698+0000","last_change":"2024-05-03T22:12:36.014624+0000","last_active":"2024-05-03T22:14:38.290698+0000","last_peered":"2024-05-03T22:14:38.290698+0000","last_clean":"2024-05-03T22:14:38.290698+0000","last_became_active":"2024-05-03T22:12:36.012531+0000","last_became_peered":"2024-05-03T22:12:36.012531+0000","last_unstale":"2024-05-03T22:14:38.290698+0000","last_undegraded":"2024-05-03T22:14:38.290698+0000","last_fullsized":"2024-05-03T22:14:38.290698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:19:46.840442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298474+0000","last_change":"2024-05-03T22:12:52.137187+0000","last_active":"2024-05-03T22:14:38.298474+0000","last_peered":"2024-05-03T22:14:38.298474+0000","last_clean":"2024-05-03T22:14:38.298474+0000","last_became_active":"2024-05-03T22:12:52.136764+0000","last_became_peered":"2024-05-03T22:12:52.136764+0000","last_unstale":"2024-05-03T22:14:38.298474+0000","last_undegraded":"2024-05-03T22:14:38.298474+0000","last_fullsized":"2024-05-03T22:14:38.298474+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:54:00.922048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037431+0000","last_change":"2024-05-03T22:12:31.982086+0000","last_active":"2024-05-03T22:14:39.037431+0000","last_peered":"2024-05-03T22:14:39.037431+0000","last_clean":"2024-05-03T22:14:39.037431+0000","last_became_active":"2024-05-03T22:12:31.981464+0000","last_became_peered":"2024-05-03T22:12:31.981464+0000","last_unstale":"2024-05-03T22:14:39.037431+0000","last_undegraded":"2024-05-03T22:14:39.037431+0000","last_fullsized":"2024-05-03T22:14:39.037431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:22.450640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283194+0000","last_change":"2024-05-03T22:12:36.015808+0000","last_active":"2024-05-03T22:14:38.283194+0000","last_peered":"2024-05-03T22:14:38.283194+0000","last_clean":"2024-05-03T22:14:38.283194+0000","last_became_active":"2024-05-03T22:12:36.015496+0000","last_became_peered":"2024-05-03T22:12:36.015496+0000","last_unstale":"2024-05-03T22:14:38.283194+0000","last_undegraded":"2024-05-03T22:14:38.283194+0000","last_fullsized":"2024-05-03T22:14:38.283194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:12:18.316985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291668+0000","last_change":"2024-05-03T22:12:52.131977+0000","last_active":"2024-05-03T22:14:38.291668+0000","last_peered":"2024-05-03T22:14:38.291668+0000","last_clean":"2024-05-03T22:14:38.291668+0000","last_became_active":"2024-05-03T22:12:52.131120+0000","last_became_peered":"2024-05-03T22:12:52.131120+0000","last_unstale":"2024-05-03T22:14:38.291668+0000","last_undegraded":"2024-05-03T22:14:38.291668+0000","last_fullsized":"2024-05-03T22:14:38.291668+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:38:28.239495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":307,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:14.515616+0000","last_change":"2024-05-03T22:12:31.977238+0000","last_active":"2024-05-03T22:16:14.515616+0000","last_peered":"2024-05-03T22:16:14.515616+0000","last_clean":"2024-05-03T22:16:14.515616+0000","last_became_active":"2024-05-03T22:12:31.975006+0000","last_became_peered":"2024-05-03T22:12:31.975006+0000","last_unstale":"2024-05-03T22:16:14.515616+0000","last_undegraded":"2024-05-03T22:16:14.515616+0000","last_fullsized":"2024-05-03T22:16:14.515616+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:01.030733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":258,"num_read_kb":258,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728547+0000","last_change":"2024-05-03T22:12:36.007750+0000","last_active":"2024-05-03T22:14:38.728547+0000","last_peered":"2024-05-03T22:14:38.728547+0000","last_clean":"2024-05-03T22:14:38.728547+0000","last_became_active":"2024-05-03T22:12:36.005505+0000","last_became_peered":"2024-05-03T22:12:36.005505+0000","last_unstale":"2024-05-03T22:14:38.728547+0000","last_undegraded":"2024-05-03T22:14:38.728547+0000","last_fullsized":"2024-05-03T22:14:38.728547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:37:28.409920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283193+0000","last_change":"2024-05-03T22:12:52.142733+0000","last_active":"2024-05-03T22:14:38.283193+0000","last_peered":"2024-05-03T22:14:38.283193+0000","last_clean":"2024-05-03T22:14:38.283193+0000","last_became_active":"2024-05-03T22:12:52.142186+0000","last_became_peered":"2024-05-03T22:12:52.142186+0000","last_unstale":"2024-05-03T22:14:38.283193+0000","last_undegraded":"2024-05-03T22:14:38.283193+0000","last_fullsized":"2024-05-03T22:14:38.283193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:05:12.226021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289149+0000","last_change":"2024-05-03T22:12:31.984945+0000","last_active":"2024-05-03T22:14:38.289149+0000","last_peered":"2024-05-03T22:14:38.289149+0000","last_clean":"2024-05-03T22:14:38.289149+0000","last_became_active":"2024-05-03T22:12:31.982844+0000","last_became_peered":"2024-05-03T22:12:31.982844+0000","last_unstale":"2024-05-03T22:14:38.289149+0000","last_undegraded":"2024-05-03T22:14:38.289149+0000","last_fullsized":"2024-05-03T22:14:38.289149+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:51:13.520574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298947+0000","last_change":"2024-05-03T22:12:36.010250+0000","last_active":"2024-05-03T22:14:38.298947+0000","last_peered":"2024-05-03T22:14:38.298947+0000","last_clean":"2024-05-03T22:14:38.298947+0000","last_became_active":"2024-05-03T22:12:36.009867+0000","last_became_peered":"2024-05-03T22:12:36.009867+0000","last_unstale":"2024-05-03T22:14:38.298947+0000","last_undegraded":"2024-05-03T22:14:38.298947+0000","last_fullsized":"2024-05-03T22:14:38.298947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:21:07.114667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283520+0000","last_change":"2024-05-03T22:13:37.973331+0000","last_active":"2024-05-03T22:14:38.283520+0000","last_peered":"2024-05-03T22:14:38.283520+0000","last_clean":"2024-05-03T22:14:38.283520+0000","last_became_active":"2024-05-03T22:13:37.972030+0000","last_became_peered":"2024-05-03T22:13:37.972030+0000","last_unstale":"2024-05-03T22:14:38.283520+0000","last_undegraded":"2024-05-03T22:14:38.283520+0000","last_fullsized":"2024-05-03T22:14:38.283520+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:11:18.105975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037928+0000","last_change":"2024-05-03T22:12:32.021662+0000","last_active":"2024-05-03T22:14:39.037928+0000","last_peered":"2024-05-03T22:14:39.037928+0000","last_clean":"2024-05-03T22:14:39.037928+0000","last_became_active":"2024-05-03T22:12:32.021128+0000","last_became_peered":"2024-05-03T22:12:32.021128+0000","last_unstale":"2024-05-03T22:14:39.037928+0000","last_undegraded":"2024-05-03T22:14:39.037928+0000","last_fullsized":"2024-05-03T22:14:39.037928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:08:02.608160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728509+0000","last_change":"2024-05-03T22:13:37.973105+0000","last_active":"2024-05-03T22:14:38.728509+0000","last_peered":"2024-05-03T22:14:38.728509+0000","last_clean":"2024-05-03T22:14:38.728509+0000","last_became_active":"2024-05-03T22:13:37.971963+0000","last_became_peered":"2024-05-03T22:13:37.971963+0000","last_unstale":"2024-05-03T22:14:38.728509+0000","last_undegraded":"2024-05-03T22:14:38.728509+0000","last_fullsized":"2024-05-03T22:14:38.728509+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:22:50.092753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283190+0000","last_change":"2024-05-03T22:12:52.140596+0000","last_active":"2024-05-03T22:14:38.283190+0000","last_peered":"2024-05-03T22:14:38.283190+0000","last_clean":"2024-05-03T22:14:38.283190+0000","last_became_active":"2024-05-03T22:12:52.140185+0000","last_became_peered":"2024-05-03T22:12:52.140185+0000","last_unstale":"2024-05-03T22:14:38.283190+0000","last_undegraded":"2024-05-03T22:14:38.283190+0000","last_fullsized":"2024-05-03T22:14:38.283190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:01:53.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'35","reported_seq":347,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:14.525699+0000","last_change":"2024-05-03T22:12:31.984670+0000","last_active":"2024-05-03T22:16:14.525699+0000","last_peered":"2024-05-03T22:16:14.525699+0000","last_clean":"2024-05-03T22:16:14.525699+0000","last_became_active":"2024-05-03T22:12:31.983939+0000","last_became_peered":"2024-05-03T22:12:31.983939+0000","last_unstale":"2024-05-03T22:16:14.525699+0000","last_undegraded":"2024-05-03T22:16:14.525699+0000","last_fullsized":"2024-05-03T22:16:14.525699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:29:13.702952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57951,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":267,"num_read_kb":189,"num_write":37,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285349+0000","last_change":"2024-05-03T22:12:36.010032+0000","last_active":"2024-05-03T22:14:38.285349+0000","last_peered":"2024-05-03T22:14:38.285349+0000","last_clean":"2024-05-03T22:14:38.285349+0000","last_became_active":"2024-05-03T22:12:36.009682+0000","last_became_peered":"2024-05-03T22:12:36.009682+0000","last_unstale":"2024-05-03T22:14:38.285349+0000","last_undegraded":"2024-05-03T22:14:38.285349+0000","last_fullsized":"2024-05-03T22:14:38.285349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:58.307939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038806+0000","last_change":"2024-05-03T22:12:52.137858+0000","last_active":"2024-05-03T22:14:39.038806+0000","last_peered":"2024-05-03T22:14:39.038806+0000","last_clean":"2024-05-03T22:14:39.038806+0000","last_became_active":"2024-05-03T22:12:52.137343+0000","last_became_peered":"2024-05-03T22:12:52.137343+0000","last_unstale":"2024-05-03T22:14:39.038806+0000","last_undegraded":"2024-05-03T22:14:39.038806+0000","last_fullsized":"2024-05-03T22:14:39.038806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:30:20.534943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.292015+0000","last_change":"2024-05-03T22:12:31.986574+0000","last_active":"2024-05-03T22:14:38.292015+0000","last_peered":"2024-05-03T22:14:38.292015+0000","last_clean":"2024-05-03T22:14:38.292015+0000","last_became_active":"2024-05-03T22:12:31.986168+0000","last_became_peered":"2024-05-03T22:12:31.986168+0000","last_unstale":"2024-05-03T22:14:38.292015+0000","last_undegraded":"2024-05-03T22:14:38.292015+0000","last_fullsized":"2024-05-03T22:14:38.292015+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:09:22.184243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287388+0000","last_change":"2024-05-03T22:12:36.008859+0000","last_active":"2024-05-03T22:14:38.287388+0000","last_peered":"2024-05-03T22:14:38.287388+0000","last_clean":"2024-05-03T22:14:38.287388+0000","last_became_active":"2024-05-03T22:12:36.008301+0000","last_became_peered":"2024-05-03T22:12:36.008301+0000","last_unstale":"2024-05-03T22:14:38.287388+0000","last_undegraded":"2024-05-03T22:14:38.287388+0000","last_fullsized":"2024-05-03T22:14:38.287388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:09:51.945525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288536+0000","last_change":"2024-05-03T22:12:52.143678+0000","last_active":"2024-05-03T22:14:38.288536+0000","last_peered":"2024-05-03T22:14:38.288536+0000","last_clean":"2024-05-03T22:14:38.288536+0000","last_became_active":"2024-05-03T22:12:52.143240+0000","last_became_peered":"2024-05-03T22:12:52.143240+0000","last_unstale":"2024-05-03T22:14:38.288536+0000","last_undegraded":"2024-05-03T22:14:38.288536+0000","last_fullsized":"2024-05-03T22:14:38.288536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:03.078230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037747+0000","last_change":"2024-05-03T22:12:31.987181+0000","last_active":"2024-05-03T22:14:39.037747+0000","last_peered":"2024-05-03T22:14:39.037747+0000","last_clean":"2024-05-03T22:14:39.037747+0000","last_became_active":"2024-05-03T22:12:31.986795+0000","last_became_peered":"2024-05-03T22:12:31.986795+0000","last_unstale":"2024-05-03T22:14:39.037747+0000","last_undegraded":"2024-05-03T22:14:39.037747+0000","last_fullsized":"2024-05-03T22:14:39.037747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:03.871175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289604+0000","last_change":"2024-05-03T22:12:36.023303+0000","last_active":"2024-05-03T22:14:38.289604+0000","last_peered":"2024-05-03T22:14:38.289604+0000","last_clean":"2024-05-03T22:14:38.289604+0000","last_became_active":"2024-05-03T22:12:36.022969+0000","last_became_peered":"2024-05-03T22:12:36.022969+0000","last_unstale":"2024-05-03T22:14:38.289604+0000","last_undegraded":"2024-05-03T22:14:38.289604+0000","last_fullsized":"2024-05-03T22:14:38.289604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:08:19.277423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283923+0000","last_change":"2024-05-03T22:12:52.145449+0000","last_active":"2024-05-03T22:14:38.283923+0000","last_peered":"2024-05-03T22:14:38.283923+0000","last_clean":"2024-05-03T22:14:38.283923+0000","last_became_active":"2024-05-03T22:12:52.144652+0000","last_became_peered":"2024-05-03T22:12:52.144652+0000","last_unstale":"2024-05-03T22:14:38.283923+0000","last_undegraded":"2024-05-03T22:14:38.283923+0000","last_fullsized":"2024-05-03T22:14:38.283923+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:03:17.916994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":183,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:15.544374+0000","last_change":"2024-05-03T22:12:31.986355+0000","last_active":"2024-05-03T22:16:15.544374+0000","last_peered":"2024-05-03T22:16:15.544374+0000","last_clean":"2024-05-03T22:16:15.544374+0000","last_became_active":"2024-05-03T22:12:31.985927+0000","last_became_peered":"2024-05-03T22:12:31.985927+0000","last_unstale":"2024-05-03T22:16:15.544374+0000","last_undegraded":"2024-05-03T22:16:15.544374+0000","last_fullsized":"2024-05-03T22:16:15.544374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:25:41.683036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288905+0000","last_change":"2024-05-03T22:13:37.973243+0000","last_active":"2024-05-03T22:14:38.288905+0000","last_peered":"2024-05-03T22:14:38.288905+0000","last_clean":"2024-05-03T22:14:38.288905+0000","last_became_active":"2024-05-03T22:13:37.972204+0000","last_became_peered":"2024-05-03T22:13:37.972204+0000","last_unstale":"2024-05-03T22:14:38.288905+0000","last_undegraded":"2024-05-03T22:14:38.288905+0000","last_fullsized":"2024-05-03T22:14:38.288905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:58:23.537262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289792+0000","last_change":"2024-05-03T22:12:52.137933+0000","last_active":"2024-05-03T22:14:38.289792+0000","last_peered":"2024-05-03T22:14:38.289792+0000","last_clean":"2024-05-03T22:14:38.289792+0000","last_became_active":"2024-05-03T22:12:52.137339+0000","last_became_peered":"2024-05-03T22:12:52.137339+0000","last_unstale":"2024-05-03T22:14:38.289792+0000","last_undegraded":"2024-05-03T22:14:38.289792+0000","last_fullsized":"2024-05-03T22:14:38.289792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:10:11.514234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":63,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284540+0000","last_change":"2024-05-03T22:12:32.023719+0000","last_active":"2024-05-03T22:14:38.284540+0000","last_peered":"2024-05-03T22:14:38.284540+0000","last_clean":"2024-05-03T22:14:38.284540+0000","last_became_active":"2024-05-03T22:12:32.022649+0000","last_became_peered":"2024-05-03T22:12:32.022649+0000","last_unstale":"2024-05-03T22:14:38.284540+0000","last_undegraded":"2024-05-03T22:14:38.284540+0000","last_fullsized":"2024-05-03T22:14:38.284540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:24:46.321843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037683+0000","last_change":"2024-05-03T22:12:36.019586+0000","last_active":"2024-05-03T22:14:39.037683+0000","last_peered":"2024-05-03T22:14:39.037683+0000","last_clean":"2024-05-03T22:14:39.037683+0000","last_became_active":"2024-05-03T22:12:36.019209+0000","last_became_peered":"2024-05-03T22:12:36.019209+0000","last_unstale":"2024-05-03T22:14:39.037683+0000","last_undegraded":"2024-05-03T22:14:39.037683+0000","last_fullsized":"2024-05-03T22:14:39.037683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:05:31.897550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037411+0000","last_change":"2024-05-03T22:12:52.137116+0000","last_active":"2024-05-03T22:14:39.037411+0000","last_peered":"2024-05-03T22:14:39.037411+0000","last_clean":"2024-05-03T22:14:39.037411+0000","last_became_active":"2024-05-03T22:12:52.135908+0000","last_became_peered":"2024-05-03T22:12:52.135908+0000","last_unstale":"2024-05-03T22:14:39.037411+0000","last_undegraded":"2024-05-03T22:14:39.037411+0000","last_fullsized":"2024-05-03T22:14:39.037411+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:44.728662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284955+0000","last_change":"2024-05-03T22:12:31.982743+0000","last_active":"2024-05-03T22:14:38.284955+0000","last_peered":"2024-05-03T22:14:38.284955+0000","last_clean":"2024-05-03T22:14:38.284955+0000","last_became_active":"2024-05-03T22:12:31.982181+0000","last_became_peered":"2024-05-03T22:12:31.982181+0000","last_unstale":"2024-05-03T22:14:38.284955+0000","last_undegraded":"2024-05-03T22:14:38.284955+0000","last_fullsized":"2024-05-03T22:14:38.284955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:55:32.178361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288612+0000","last_change":"2024-05-03T22:12:36.017581+0000","last_active":"2024-05-03T22:14:38.288612+0000","last_peered":"2024-05-03T22:14:38.288612+0000","last_clean":"2024-05-03T22:14:38.288612+0000","last_became_active":"2024-05-03T22:12:36.017156+0000","last_became_peered":"2024-05-03T22:12:36.017156+0000","last_unstale":"2024-05-03T22:14:38.288612+0000","last_undegraded":"2024-05-03T22:14:38.288612+0000","last_fullsized":"2024-05-03T22:14:38.288612+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:05:47.432249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284807+0000","last_change":"2024-05-03T22:12:52.149798+0000","last_active":"2024-05-03T22:14:38.284807+0000","last_peered":"2024-05-03T22:14:38.284807+0000","last_clean":"2024-05-03T22:14:38.284807+0000","last_became_active":"2024-05-03T22:12:52.149184+0000","last_became_peered":"2024-05-03T22:12:52.149184+0000","last_unstale":"2024-05-03T22:14:38.284807+0000","last_undegraded":"2024-05-03T22:14:38.284807+0000","last_fullsized":"2024-05-03T22:14:38.284807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:21:38.968847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283619+0000","last_change":"2024-05-03T22:12:32.022315+0000","last_active":"2024-05-03T22:14:38.283619+0000","last_peered":"2024-05-03T22:14:38.283619+0000","last_clean":"2024-05-03T22:14:38.283619+0000","last_became_active":"2024-05-03T22:12:32.021730+0000","last_became_peered":"2024-05-03T22:12:32.021730+0000","last_unstale":"2024-05-03T22:14:38.283619+0000","last_undegraded":"2024-05-03T22:14:38.283619+0000","last_fullsized":"2024-05-03T22:14:38.283619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:26.485434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036593+0000","last_change":"2024-05-03T22:12:36.004242+0000","last_active":"2024-05-03T22:14:39.036593+0000","last_peered":"2024-05-03T22:14:39.036593+0000","last_clean":"2024-05-03T22:14:39.036593+0000","last_became_active":"2024-05-03T22:12:36.003811+0000","last_became_peered":"2024-05-03T22:12:36.003811+0000","last_unstale":"2024-05-03T22:14:39.036593+0000","last_undegraded":"2024-05-03T22:14:39.036593+0000","last_fullsized":"2024-05-03T22:14:39.036593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:16:57.058316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289626+0000","last_change":"2024-05-03T22:12:52.125889+0000","last_active":"2024-05-03T22:14:38.289626+0000","last_peered":"2024-05-03T22:14:38.289626+0000","last_clean":"2024-05-03T22:14:38.289626+0000","last_became_active":"2024-05-03T22:12:52.125401+0000","last_became_peered":"2024-05-03T22:12:52.125401+0000","last_unstale":"2024-05-03T22:14:38.289626+0000","last_undegraded":"2024-05-03T22:14:38.289626+0000","last_fullsized":"2024-05-03T22:14:38.289626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:32:11.112125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'6","reported_seq":184,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:16.014453+0000","last_change":"2024-05-03T22:12:31.981194+0000","last_active":"2024-05-03T22:16:16.014453+0000","last_peered":"2024-05-03T22:16:16.014453+0000","last_clean":"2024-05-03T22:16:16.014453+0000","last_became_active":"2024-05-03T22:12:31.980685+0000","last_became_peered":"2024-05-03T22:12:31.980685+0000","last_unstale":"2024-05-03T22:16:16.014453+0000","last_undegraded":"2024-05-03T22:16:16.014453+0000","last_fullsized":"2024-05-03T22:16:16.014453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:00:04.697119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036298+0000","last_change":"2024-05-03T22:12:36.020405+0000","last_active":"2024-05-03T22:14:39.036298+0000","last_peered":"2024-05-03T22:14:39.036298+0000","last_clean":"2024-05-03T22:14:39.036298+0000","last_became_active":"2024-05-03T22:12:36.020003+0000","last_became_peered":"2024-05-03T22:12:36.020003+0000","last_unstale":"2024-05-03T22:14:39.036298+0000","last_undegraded":"2024-05-03T22:14:39.036298+0000","last_fullsized":"2024-05-03T22:14:39.036298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:21:49.931145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291305+0000","last_change":"2024-05-03T22:12:52.130467+0000","last_active":"2024-05-03T22:14:38.291305+0000","last_peered":"2024-05-03T22:14:38.291305+0000","last_clean":"2024-05-03T22:14:38.291305+0000","last_became_active":"2024-05-03T22:12:52.129639+0000","last_became_peered":"2024-05-03T22:12:52.129639+0000","last_unstale":"2024-05-03T22:14:38.291305+0000","last_undegraded":"2024-05-03T22:14:38.291305+0000","last_fullsized":"2024-05-03T22:14:38.291305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:31:17.043909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037896+0000","last_change":"2024-05-03T22:12:36.010293+0000","last_active":"2024-05-03T22:14:39.037896+0000","last_peered":"2024-05-03T22:14:39.037896+0000","last_clean":"2024-05-03T22:14:39.037896+0000","last_became_active":"2024-05-03T22:12:36.009682+0000","last_became_peered":"2024-05-03T22:12:36.009682+0000","last_unstale":"2024-05-03T22:14:39.037896+0000","last_undegraded":"2024-05-03T22:14:39.037896+0000","last_fullsized":"2024-05-03T22:14:39.037896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:19:32.824272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":182,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:15.543012+0000","last_change":"2024-05-03T22:12:32.019614+0000","last_active":"2024-05-03T22:16:15.543012+0000","last_peered":"2024-05-03T22:16:15.543012+0000","last_clean":"2024-05-03T22:16:15.543012+0000","last_became_active":"2024-05-03T22:12:32.018880+0000","last_became_peered":"2024-05-03T22:12:32.018880+0000","last_unstale":"2024-05-03T22:16:15.543012+0000","last_undegraded":"2024-05-03T22:16:15.543012+0000","last_fullsized":"2024-05-03T22:16:15.543012+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:01:46.354811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289035+0000","last_change":"2024-05-03T22:12:52.142829+0000","last_active":"2024-05-03T22:14:38.289035+0000","last_peered":"2024-05-03T22:14:38.289035+0000","last_clean":"2024-05-03T22:14:38.289035+0000","last_became_active":"2024-05-03T22:12:52.142289+0000","last_became_peered":"2024-05-03T22:12:52.142289+0000","last_unstale":"2024-05-03T22:14:38.289035+0000","last_undegraded":"2024-05-03T22:14:38.289035+0000","last_fullsized":"2024-05-03T22:14:38.289035+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:54:44.815014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.293260+0000","last_change":"2024-05-03T22:12:36.009551+0000","last_active":"2024-05-03T22:14:38.293260+0000","last_peered":"2024-05-03T22:14:38.293260+0000","last_clean":"2024-05-03T22:14:38.293260+0000","last_became_active":"2024-05-03T22:12:36.009180+0000","last_became_peered":"2024-05-03T22:12:36.009180+0000","last_unstale":"2024-05-03T22:14:38.293260+0000","last_undegraded":"2024-05-03T22:14:38.293260+0000","last_fullsized":"2024-05-03T22:14:38.293260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:03:17.824610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283475+0000","last_change":"2024-05-03T22:12:31.988051+0000","last_active":"2024-05-03T22:14:38.283475+0000","last_peered":"2024-05-03T22:14:38.283475+0000","last_clean":"2024-05-03T22:14:38.283475+0000","last_became_active":"2024-05-03T22:12:31.987641+0000","last_became_peered":"2024-05-03T22:12:31.987641+0000","last_unstale":"2024-05-03T22:14:38.283475+0000","last_undegraded":"2024-05-03T22:14:38.283475+0000","last_fullsized":"2024-05-03T22:14:38.283475+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:51:02.824815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":121,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288649+0000","last_change":"2024-05-03T22:10:37.173231+0000","last_active":"2024-05-03T22:14:38.288649+0000","last_peered":"2024-05-03T22:14:38.288649+0000","last_clean":"2024-05-03T22:14:38.288649+0000","last_became_active":"2024-05-03T22:10:37.157400+0000","last_became_peered":"2024-05-03T22:10:37.157400+0000","last_unstale":"2024-05-03T22:14:38.288649+0000","last_undegraded":"2024-05-03T22:14:38.288649+0000","last_fullsized":"2024-05-03T22:14:38.288649+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:05:53.333203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:05:53.333203+0000","last_clean_scrub_stamp":"2024-05-03T22:05:53.333203+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:51:06.825624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038969+0000","last_change":"2024-05-03T22:12:52.137851+0000","last_active":"2024-05-03T22:14:39.038969+0000","last_peered":"2024-05-03T22:14:39.038969+0000","last_clean":"2024-05-03T22:14:39.038969+0000","last_became_active":"2024-05-03T22:12:52.136608+0000","last_became_peered":"2024-05-03T22:12:52.136608+0000","last_unstale":"2024-05-03T22:14:39.038969+0000","last_undegraded":"2024-05-03T22:14:39.038969+0000","last_fullsized":"2024-05-03T22:14:39.038969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:43:59.013159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286653+0000","last_change":"2024-05-03T22:12:36.007079+0000","last_active":"2024-05-03T22:14:38.286653+0000","last_peered":"2024-05-03T22:14:38.286653+0000","last_clean":"2024-05-03T22:14:38.286653+0000","last_became_active":"2024-05-03T22:12:36.006737+0000","last_became_peered":"2024-05-03T22:12:36.006737+0000","last_unstale":"2024-05-03T22:14:38.286653+0000","last_undegraded":"2024-05-03T22:14:38.286653+0000","last_fullsized":"2024-05-03T22:14:38.286653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:24:56.805461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288714+0000","last_change":"2024-05-03T22:12:31.982718+0000","last_active":"2024-05-03T22:14:38.288714+0000","last_peered":"2024-05-03T22:14:38.288714+0000","last_clean":"2024-05-03T22:14:38.288714+0000","last_became_active":"2024-05-03T22:12:31.980502+0000","last_became_peered":"2024-05-03T22:12:31.980502+0000","last_unstale":"2024-05-03T22:14:38.288714+0000","last_undegraded":"2024-05-03T22:14:38.288714+0000","last_fullsized":"2024-05-03T22:14:38.288714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:06:48.543038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286761+0000","last_change":"2024-05-03T22:12:52.130775+0000","last_active":"2024-05-03T22:14:38.286761+0000","last_peered":"2024-05-03T22:14:38.286761+0000","last_clean":"2024-05-03T22:14:38.286761+0000","last_became_active":"2024-05-03T22:12:52.130122+0000","last_became_peered":"2024-05-03T22:12:52.130122+0000","last_unstale":"2024-05-03T22:14:38.286761+0000","last_undegraded":"2024-05-03T22:14:38.286761+0000","last_fullsized":"2024-05-03T22:14:38.286761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:49.308484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.314204+0000","last_change":"2024-05-03T22:14:38.313777+0000","last_active":"2024-05-03T22:14:38.314204+0000","last_peered":"2024-05-03T22:14:38.314204+0000","last_clean":"2024-05-03T22:14:38.314204+0000","last_became_active":"2024-05-03T22:14:38.298126+0000","last_became_peered":"2024-05-03T22:14:38.298126+0000","last_unstale":"2024-05-03T22:14:38.314204+0000","last_undegraded":"2024-05-03T22:14:38.314204+0000","last_fullsized":"2024-05-03T22:14:38.314204+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:24:15.804010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289442+0000","last_change":"2024-05-03T22:12:36.005260+0000","last_active":"2024-05-03T22:14:38.289442+0000","last_peered":"2024-05-03T22:14:38.289442+0000","last_clean":"2024-05-03T22:14:38.289442+0000","last_became_active":"2024-05-03T22:12:36.004942+0000","last_became_peered":"2024-05-03T22:12:36.004942+0000","last_unstale":"2024-05-03T22:14:38.289442+0000","last_undegraded":"2024-05-03T22:14:38.289442+0000","last_fullsized":"2024-05-03T22:14:38.289442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:46.395893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290577+0000","last_change":"2024-05-03T22:12:52.132278+0000","last_active":"2024-05-03T22:14:38.290577+0000","last_peered":"2024-05-03T22:14:38.290577+0000","last_clean":"2024-05-03T22:14:38.290577+0000","last_became_active":"2024-05-03T22:12:52.131836+0000","last_became_peered":"2024-05-03T22:12:52.131836+0000","last_unstale":"2024-05-03T22:14:38.290577+0000","last_undegraded":"2024-05-03T22:14:38.290577+0000","last_fullsized":"2024-05-03T22:14:38.290577+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:54:07.305893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'15","reported_seq":60,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:44.001735+0000","last_change":"2024-05-03T22:12:31.978324+0000","last_active":"2024-05-03T22:14:44.001735+0000","last_peered":"2024-05-03T22:14:44.001735+0000","last_clean":"2024-05-03T22:14:44.001735+0000","last_became_active":"2024-05-03T22:12:31.977156+0000","last_became_peered":"2024-05-03T22:12:31.977156+0000","last_unstale":"2024-05-03T22:14:44.001735+0000","last_undegraded":"2024-05-03T22:14:44.001735+0000","last_fullsized":"2024-05-03T22:14:44.001735+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:45:28.549187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290950+0000","last_change":"2024-05-03T22:12:36.014986+0000","last_active":"2024-05-03T22:14:38.290950+0000","last_peered":"2024-05-03T22:14:38.290950+0000","last_clean":"2024-05-03T22:14:38.290950+0000","last_became_active":"2024-05-03T22:12:36.014664+0000","last_became_peered":"2024-05-03T22:12:36.014664+0000","last_unstale":"2024-05-03T22:14:38.290950+0000","last_undegraded":"2024-05-03T22:14:38.290950+0000","last_fullsized":"2024-05-03T22:14:38.290950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:46:13.807806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291403+0000","last_change":"2024-05-03T22:12:52.126771+0000","last_active":"2024-05-03T22:14:38.291403+0000","last_peered":"2024-05-03T22:14:38.291403+0000","last_clean":"2024-05-03T22:14:38.291403+0000","last_became_active":"2024-05-03T22:12:52.126257+0000","last_became_peered":"2024-05-03T22:12:52.126257+0000","last_unstale":"2024-05-03T22:14:38.291403+0000","last_undegraded":"2024-05-03T22:14:38.291403+0000","last_fullsized":"2024-05-03T22:14:38.291403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:53:03.823305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283848+0000","last_change":"2024-05-03T22:12:31.981674+0000","last_active":"2024-05-03T22:14:38.283848+0000","last_peered":"2024-05-03T22:14:38.283848+0000","last_clean":"2024-05-03T22:14:38.283848+0000","last_became_active":"2024-05-03T22:12:31.976707+0000","last_became_peered":"2024-05-03T22:12:31.976707+0000","last_unstale":"2024-05-03T22:14:38.283848+0000","last_undegraded":"2024-05-03T22:14:38.283848+0000","last_fullsized":"2024-05-03T22:14:38.283848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:44:21.743865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298489+0000","last_change":"2024-05-03T22:12:35.997309+0000","last_active":"2024-05-03T22:14:38.298489+0000","last_peered":"2024-05-03T22:14:38.298489+0000","last_clean":"2024-05-03T22:14:38.298489+0000","last_became_active":"2024-05-03T22:12:35.996879+0000","last_became_peered":"2024-05-03T22:12:35.996879+0000","last_unstale":"2024-05-03T22:14:38.298489+0000","last_undegraded":"2024-05-03T22:14:38.298489+0000","last_fullsized":"2024-05-03T22:14:38.298489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:01:25.009038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283813+0000","last_change":"2024-05-03T22:12:52.145503+0000","last_active":"2024-05-03T22:14:38.283813+0000","last_peered":"2024-05-03T22:14:38.283813+0000","last_clean":"2024-05-03T22:14:38.283813+0000","last_became_active":"2024-05-03T22:12:52.144719+0000","last_became_peered":"2024-05-03T22:12:52.144719+0000","last_unstale":"2024-05-03T22:14:38.283813+0000","last_undegraded":"2024-05-03T22:14:38.283813+0000","last_fullsized":"2024-05-03T22:14:38.283813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:49:30.683367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.727869+0000","last_change":"2024-05-03T22:12:32.019228+0000","last_active":"2024-05-03T22:14:38.727869+0000","last_peered":"2024-05-03T22:14:38.727869+0000","last_clean":"2024-05-03T22:14:38.727869+0000","last_became_active":"2024-05-03T22:12:32.018648+0000","last_became_peered":"2024-05-03T22:12:32.018648+0000","last_unstale":"2024-05-03T22:14:38.727869+0000","last_undegraded":"2024-05-03T22:14:38.727869+0000","last_fullsized":"2024-05-03T22:14:38.727869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:21.695600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284715+0000","last_change":"2024-05-03T22:12:36.012712+0000","last_active":"2024-05-03T22:14:38.284715+0000","last_peered":"2024-05-03T22:14:38.284715+0000","last_clean":"2024-05-03T22:14:38.284715+0000","last_became_active":"2024-05-03T22:12:36.012278+0000","last_became_peered":"2024-05-03T22:12:36.012278+0000","last_unstale":"2024-05-03T22:14:38.284715+0000","last_undegraded":"2024-05-03T22:14:38.284715+0000","last_fullsized":"2024-05-03T22:14:38.284715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:16:21.511575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284202+0000","last_change":"2024-05-03T22:12:52.145070+0000","last_active":"2024-05-03T22:14:38.284202+0000","last_peered":"2024-05-03T22:14:38.284202+0000","last_clean":"2024-05-03T22:14:38.284202+0000","last_became_active":"2024-05-03T22:12:52.144071+0000","last_became_peered":"2024-05-03T22:12:52.144071+0000","last_unstale":"2024-05-03T22:14:38.284202+0000","last_undegraded":"2024-05-03T22:14:38.284202+0000","last_fullsized":"2024-05-03T22:14:38.284202+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:44:12.696121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291762+0000","last_change":"2024-05-03T22:12:31.971569+0000","last_active":"2024-05-03T22:14:38.291762+0000","last_peered":"2024-05-03T22:14:38.291762+0000","last_clean":"2024-05-03T22:14:38.291762+0000","last_became_active":"2024-05-03T22:12:31.970883+0000","last_became_peered":"2024-05-03T22:12:31.970883+0000","last_unstale":"2024-05-03T22:14:38.291762+0000","last_undegraded":"2024-05-03T22:14:38.291762+0000","last_fullsized":"2024-05-03T22:14:38.291762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:12:50.629452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286477+0000","last_change":"2024-05-03T22:12:36.019209+0000","last_active":"2024-05-03T22:14:38.286477+0000","last_peered":"2024-05-03T22:14:38.286477+0000","last_clean":"2024-05-03T22:14:38.286477+0000","last_became_active":"2024-05-03T22:12:36.018887+0000","last_became_peered":"2024-05-03T22:12:36.018887+0000","last_unstale":"2024-05-03T22:14:38.286477+0000","last_undegraded":"2024-05-03T22:14:38.286477+0000","last_fullsized":"2024-05-03T22:14:38.286477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:29:36.775592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283462+0000","last_change":"2024-05-03T22:12:52.145179+0000","last_active":"2024-05-03T22:14:38.283462+0000","last_peered":"2024-05-03T22:14:38.283462+0000","last_clean":"2024-05-03T22:14:38.283462+0000","last_became_active":"2024-05-03T22:12:52.144344+0000","last_became_peered":"2024-05-03T22:12:52.144344+0000","last_unstale":"2024-05-03T22:14:38.283462+0000","last_undegraded":"2024-05-03T22:14:38.283462+0000","last_fullsized":"2024-05-03T22:14:38.283462+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:54:10.637934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.307151+0000","last_change":"2024-05-03T22:14:38.306297+0000","last_active":"2024-05-03T22:14:38.307151+0000","last_peered":"2024-05-03T22:14:38.307151+0000","last_clean":"2024-05-03T22:14:38.307151+0000","last_became_active":"2024-05-03T22:14:38.298089+0000","last_became_peered":"2024-05-03T22:14:38.298089+0000","last_unstale":"2024-05-03T22:14:38.307151+0000","last_undegraded":"2024-05-03T22:14:38.307151+0000","last_fullsized":"2024-05-03T22:14:38.307151+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:44.456436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291153+0000","last_change":"2024-05-03T22:12:36.002569+0000","last_active":"2024-05-03T22:14:38.291153+0000","last_peered":"2024-05-03T22:14:38.291153+0000","last_clean":"2024-05-03T22:14:38.291153+0000","last_became_active":"2024-05-03T22:12:36.002219+0000","last_became_peered":"2024-05-03T22:12:36.002219+0000","last_unstale":"2024-05-03T22:14:38.291153+0000","last_undegraded":"2024-05-03T22:14:38.291153+0000","last_fullsized":"2024-05-03T22:14:38.291153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:43:56.530139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283470+0000","last_change":"2024-05-03T22:12:52.137365+0000","last_active":"2024-05-03T22:14:38.283470+0000","last_peered":"2024-05-03T22:14:38.283470+0000","last_clean":"2024-05-03T22:14:38.283470+0000","last_became_active":"2024-05-03T22:12:52.136695+0000","last_became_peered":"2024-05-03T22:12:52.136695+0000","last_unstale":"2024-05-03T22:14:38.283470+0000","last_undegraded":"2024-05-03T22:14:38.283470+0000","last_fullsized":"2024-05-03T22:14:38.283470+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:06:05.439487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285151+0000","last_change":"2024-05-03T22:12:31.983289+0000","last_active":"2024-05-03T22:14:38.285151+0000","last_peered":"2024-05-03T22:14:38.285151+0000","last_clean":"2024-05-03T22:14:38.285151+0000","last_became_active":"2024-05-03T22:12:31.982873+0000","last_became_peered":"2024-05-03T22:12:31.982873+0000","last_unstale":"2024-05-03T22:14:38.285151+0000","last_undegraded":"2024-05-03T22:14:38.285151+0000","last_fullsized":"2024-05-03T22:14:38.285151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:50.973960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289190+0000","last_change":"2024-05-03T22:12:36.025173+0000","last_active":"2024-05-03T22:14:38.289190+0000","last_peered":"2024-05-03T22:14:38.289190+0000","last_clean":"2024-05-03T22:14:38.289190+0000","last_became_active":"2024-05-03T22:12:36.021875+0000","last_became_peered":"2024-05-03T22:12:36.021875+0000","last_unstale":"2024-05-03T22:14:38.289190+0000","last_undegraded":"2024-05-03T22:14:38.289190+0000","last_fullsized":"2024-05-03T22:14:38.289190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:05:15.963921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728021+0000","last_change":"2024-05-03T22:12:52.132608+0000","last_active":"2024-05-03T22:14:38.728021+0000","last_peered":"2024-05-03T22:14:38.728021+0000","last_clean":"2024-05-03T22:14:38.728021+0000","last_became_active":"2024-05-03T22:12:52.132115+0000","last_became_peered":"2024-05-03T22:12:52.132115+0000","last_unstale":"2024-05-03T22:14:38.728021+0000","last_undegraded":"2024-05-03T22:14:38.728021+0000","last_fullsized":"2024-05-03T22:14:38.728021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:01:30.571145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":182,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:14.517191+0000","last_change":"2024-05-03T22:12:32.021562+0000","last_active":"2024-05-03T22:16:14.517191+0000","last_peered":"2024-05-03T22:16:14.517191+0000","last_clean":"2024-05-03T22:16:14.517191+0000","last_became_active":"2024-05-03T22:12:32.020913+0000","last_became_peered":"2024-05-03T22:12:32.020913+0000","last_unstale":"2024-05-03T22:16:14.517191+0000","last_undegraded":"2024-05-03T22:16:14.517191+0000","last_fullsized":"2024-05-03T22:16:14.517191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:02:37.549388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289417+0000","last_change":"2024-05-03T22:12:36.019237+0000","last_active":"2024-05-03T22:14:38.289417+0000","last_peered":"2024-05-03T22:14:38.289417+0000","last_clean":"2024-05-03T22:14:38.289417+0000","last_became_active":"2024-05-03T22:12:36.018411+0000","last_became_peered":"2024-05-03T22:12:36.018411+0000","last_unstale":"2024-05-03T22:14:38.289417+0000","last_undegraded":"2024-05-03T22:14:38.289417+0000","last_fullsized":"2024-05-03T22:14:38.289417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:45:59.701403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297080+0000","last_change":"2024-05-03T22:12:52.146882+0000","last_active":"2024-05-03T22:14:38.297080+0000","last_peered":"2024-05-03T22:14:38.297080+0000","last_clean":"2024-05-03T22:14:38.297080+0000","last_became_active":"2024-05-03T22:12:52.146316+0000","last_became_peered":"2024-05-03T22:12:52.146316+0000","last_unstale":"2024-05-03T22:14:38.297080+0000","last_undegraded":"2024-05-03T22:14:38.297080+0000","last_fullsized":"2024-05-03T22:14:38.297080+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:01:03.443777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038508+0000","last_change":"2024-05-03T22:12:31.983036+0000","last_active":"2024-05-03T22:14:39.038508+0000","last_peered":"2024-05-03T22:14:39.038508+0000","last_clean":"2024-05-03T22:14:39.038508+0000","last_became_active":"2024-05-03T22:12:31.979875+0000","last_became_peered":"2024-05-03T22:12:31.979875+0000","last_unstale":"2024-05-03T22:14:39.038508+0000","last_undegraded":"2024-05-03T22:14:39.038508+0000","last_fullsized":"2024-05-03T22:14:39.038508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:26:56.227766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288821+0000","last_change":"2024-05-03T22:13:37.972323+0000","last_active":"2024-05-03T22:14:38.288821+0000","last_peered":"2024-05-03T22:14:38.288821+0000","last_clean":"2024-05-03T22:14:38.288821+0000","last_became_active":"2024-05-03T22:13:37.971207+0000","last_became_peered":"2024-05-03T22:13:37.971207+0000","last_unstale":"2024-05-03T22:14:38.288821+0000","last_undegraded":"2024-05-03T22:14:38.288821+0000","last_fullsized":"2024-05-03T22:14:38.288821+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:49.939213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037078+0000","last_change":"2024-05-03T22:12:52.125489+0000","last_active":"2024-05-03T22:14:39.037078+0000","last_peered":"2024-05-03T22:14:39.037078+0000","last_clean":"2024-05-03T22:14:39.037078+0000","last_became_active":"2024-05-03T22:12:52.124767+0000","last_became_peered":"2024-05-03T22:12:52.124767+0000","last_unstale":"2024-05-03T22:14:39.037078+0000","last_undegraded":"2024-05-03T22:14:39.037078+0000","last_fullsized":"2024-05-03T22:14:39.037078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:47:29.027353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":62,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.312346+0000","last_change":"2024-05-03T22:14:38.311637+0000","last_active":"2024-05-03T22:14:38.312346+0000","last_peered":"2024-05-03T22:14:38.312346+0000","last_clean":"2024-05-03T22:14:38.312346+0000","last_became_active":"2024-05-03T22:14:38.299881+0000","last_became_peered":"2024-05-03T22:14:38.299881+0000","last_unstale":"2024-05-03T22:14:38.312346+0000","last_undegraded":"2024-05-03T22:14:38.312346+0000","last_fullsized":"2024-05-03T22:14:38.312346+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:51:27.491122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289597+0000","last_change":"2024-05-03T22:12:36.015753+0000","last_active":"2024-05-03T22:14:38.289597+0000","last_peered":"2024-05-03T22:14:38.289597+0000","last_clean":"2024-05-03T22:14:38.289597+0000","last_became_active":"2024-05-03T22:12:36.011569+0000","last_became_peered":"2024-05-03T22:12:36.011569+0000","last_unstale":"2024-05-03T22:14:38.289597+0000","last_undegraded":"2024-05-03T22:14:38.289597+0000","last_fullsized":"2024-05-03T22:14:38.289597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:30:48.897252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286581+0000","last_change":"2024-05-03T22:12:36.017738+0000","last_active":"2024-05-03T22:14:38.286581+0000","last_peered":"2024-05-03T22:14:38.286581+0000","last_clean":"2024-05-03T22:14:38.286581+0000","last_became_active":"2024-05-03T22:12:36.017293+0000","last_became_peered":"2024-05-03T22:12:36.017293+0000","last_unstale":"2024-05-03T22:14:38.286581+0000","last_undegraded":"2024-05-03T22:14:38.286581+0000","last_fullsized":"2024-05-03T22:14:38.286581+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:20:35.141892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291607+0000","last_change":"2024-05-03T22:13:37.911165+0000","last_active":"2024-05-03T22:14:38.291607+0000","last_peered":"2024-05-03T22:14:38.291607+0000","last_clean":"2024-05-03T22:14:38.291607+0000","last_became_active":"2024-05-03T22:13:37.910476+0000","last_became_peered":"2024-05-03T22:13:37.910476+0000","last_unstale":"2024-05-03T22:14:38.291607+0000","last_undegraded":"2024-05-03T22:14:38.291607+0000","last_fullsized":"2024-05-03T22:14:38.291607+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:07.195308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290909+0000","last_change":"2024-05-03T22:12:36.001119+0000","last_active":"2024-05-03T22:14:38.290909+0000","last_peered":"2024-05-03T22:14:38.290909+0000","last_clean":"2024-05-03T22:14:38.290909+0000","last_became_active":"2024-05-03T22:12:36.000728+0000","last_became_peered":"2024-05-03T22:12:36.000728+0000","last_unstale":"2024-05-03T22:14:38.290909+0000","last_undegraded":"2024-05-03T22:14:38.290909+0000","last_fullsized":"2024-05-03T22:14:38.290909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:02:29.413354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297854+0000","last_change":"2024-05-03T22:12:36.004256+0000","last_active":"2024-05-03T22:14:38.297854+0000","last_peered":"2024-05-03T22:14:38.297854+0000","last_clean":"2024-05-03T22:14:38.297854+0000","last_became_active":"2024-05-03T22:12:36.004002+0000","last_became_peered":"2024-05-03T22:12:36.004002+0000","last_unstale":"2024-05-03T22:14:38.297854+0000","last_undegraded":"2024-05-03T22:14:38.297854+0000","last_fullsized":"2024-05-03T22:14:38.297854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:50:55.748069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289338+0000","last_change":"2024-05-03T22:12:36.006160+0000","last_active":"2024-05-03T22:14:38.289338+0000","last_peered":"2024-05-03T22:14:38.289338+0000","last_clean":"2024-05-03T22:14:38.289338+0000","last_became_active":"2024-05-03T22:12:36.001061+0000","last_became_peered":"2024-05-03T22:12:36.001061+0000","last_unstale":"2024-05-03T22:14:38.289338+0000","last_undegraded":"2024-05-03T22:14:38.289338+0000","last_fullsized":"2024-05-03T22:14:38.289338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:49:32.033970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287681+0000","last_change":"2024-05-03T22:13:37.974073+0000","last_active":"2024-05-03T22:14:38.287681+0000","last_peered":"2024-05-03T22:14:38.287681+0000","last_clean":"2024-05-03T22:14:38.287681+0000","last_became_active":"2024-05-03T22:13:37.973009+0000","last_became_peered":"2024-05-03T22:13:37.973009+0000","last_unstale":"2024-05-03T22:14:38.287681+0000","last_undegraded":"2024-05-03T22:14:38.287681+0000","last_fullsized":"2024-05-03T22:14:38.287681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:00:37.511026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291431+0000","last_change":"2024-05-03T22:12:36.014463+0000","last_active":"2024-05-03T22:14:38.291431+0000","last_peered":"2024-05-03T22:14:38.291431+0000","last_clean":"2024-05-03T22:14:38.291431+0000","last_became_active":"2024-05-03T22:12:36.014130+0000","last_became_peered":"2024-05-03T22:12:36.014130+0000","last_unstale":"2024-05-03T22:14:38.291431+0000","last_undegraded":"2024-05-03T22:14:38.291431+0000","last_fullsized":"2024-05-03T22:14:38.291431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:44:28.681255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291878+0000","last_change":"2024-05-03T22:12:36.000528+0000","last_active":"2024-05-03T22:14:38.291878+0000","last_peered":"2024-05-03T22:14:38.291878+0000","last_clean":"2024-05-03T22:14:38.291878+0000","last_became_active":"2024-05-03T22:12:35.999985+0000","last_became_peered":"2024-05-03T22:12:35.999985+0000","last_unstale":"2024-05-03T22:14:38.291878+0000","last_undegraded":"2024-05-03T22:14:38.291878+0000","last_fullsized":"2024-05-03T22:14:38.291878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:36:13.835098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037474+0000","last_change":"2024-05-03T22:12:36.010009+0000","last_active":"2024-05-03T22:14:39.037474+0000","last_peered":"2024-05-03T22:14:39.037474+0000","last_clean":"2024-05-03T22:14:39.037474+0000","last_became_active":"2024-05-03T22:12:36.009139+0000","last_became_peered":"2024-05-03T22:12:36.009139+0000","last_unstale":"2024-05-03T22:14:39.037474+0000","last_undegraded":"2024-05-03T22:14:39.037474+0000","last_fullsized":"2024-05-03T22:14:39.037474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:59.111774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291850+0000","last_change":"2024-05-03T22:12:36.015949+0000","last_active":"2024-05-03T22:14:38.291850+0000","last_peered":"2024-05-03T22:14:38.291850+0000","last_clean":"2024-05-03T22:14:38.291850+0000","last_became_active":"2024-05-03T22:12:36.015597+0000","last_became_peered":"2024-05-03T22:12:36.015597+0000","last_unstale":"2024-05-03T22:14:38.291850+0000","last_undegraded":"2024-05-03T22:14:38.291850+0000","last_fullsized":"2024-05-03T22:14:38.291850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:24:29.855732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728220+0000","last_change":"2024-05-03T22:12:36.013462+0000","last_active":"2024-05-03T22:14:38.728220+0000","last_peered":"2024-05-03T22:14:38.728220+0000","last_clean":"2024-05-03T22:14:38.728220+0000","last_became_active":"2024-05-03T22:12:36.012664+0000","last_became_peered":"2024-05-03T22:12:36.012664+0000","last_unstale":"2024-05-03T22:14:38.728220+0000","last_undegraded":"2024-05-03T22:14:38.728220+0000","last_fullsized":"2024-05-03T22:14:38.728220+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:28:53.979742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288879+0000","last_change":"2024-05-03T22:12:36.010367+0000","last_active":"2024-05-03T22:14:38.288879+0000","last_peered":"2024-05-03T22:14:38.288879+0000","last_clean":"2024-05-03T22:14:38.288879+0000","last_became_active":"2024-05-03T22:12:36.009968+0000","last_became_peered":"2024-05-03T22:12:36.009968+0000","last_unstale":"2024-05-03T22:14:38.288879+0000","last_undegraded":"2024-05-03T22:14:38.288879+0000","last_fullsized":"2024-05-03T22:14:38.288879+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:34:48.542080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288982+0000","last_change":"2024-05-03T22:12:36.023670+0000","last_active":"2024-05-03T22:14:38.288982+0000","last_peered":"2024-05-03T22:14:38.288982+0000","last_clean":"2024-05-03T22:14:38.288982+0000","last_became_active":"2024-05-03T22:12:36.022774+0000","last_became_peered":"2024-05-03T22:12:36.022774+0000","last_unstale":"2024-05-03T22:14:38.288982+0000","last_undegraded":"2024-05-03T22:14:38.288982+0000","last_fullsized":"2024-05-03T22:14:38.288982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:33:05.929349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65155,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1331,"num_read_kb":731,"num_write":249,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":195465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612671,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":530005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808904,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32892,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712260,"statfs":{"total":95995035648,"available":95961354240,"internally_reserved":0,"allocated":1753088,"data_stored":1174660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005133,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":533919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201366,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1069056,"data_stored":529417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397597,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32824,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712328,"statfs":{"total":95995035648,"available":95961423872,"internally_reserved":0,"allocated":1683456,"data_stored":1127089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561124,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":525718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":585371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738510,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":526783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1146880,"data_stored":584919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149818,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":525035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953587,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":529401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757355,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32832,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712320,"statfs":{"total":95995035648,"available":95961415680,"internally_reserved":0,"allocated":1691648,"data_stored":1122280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T22:16:20.890 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T22:16:21.368 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:16:21.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:21 smithi116 ceph-mon[31828]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:16:21.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:21 smithi082 ceph-mon[28404]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:16:21.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:21 smithi130 ceph-mon[32417]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:16:22.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:22 smithi082 ceph-mon[28404]: pgmap v494: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:16:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:22 smithi116 ceph-mon[31828]: pgmap v494: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:16:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:22 smithi130 ceph-mon[32417]: pgmap v494: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:16:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.738+0000 7f53ff200700 1 -- 172.21.15.82:0/168090702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54001055d0 msgr2=0x7f5400105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.738+0000 7f53ff200700 1 --2- 172.21.15.82:0/168090702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54001055d0 0x7f5400105a50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0099c0 tx=0x7f53ec009cd0 comp rx=0 tx=0).stop 2024-05-03T22:16:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.738+0000 7f53ff200700 1 -- 172.21.15.82:0/168090702 shutdown_connections 2024-05-03T22:16:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.738+0000 7f53ff200700 1 --2- 172.21.15.82:0/168090702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5400105f90 0x7f5400112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.738+0000 7f53ff200700 1 --2- 172.21.15.82:0/168090702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f540010b680 0x7f540010ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.738+0000 7f53ff200700 1 --2- 172.21.15.82:0/168090702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54001055d0 0x7f5400105a50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.738+0000 7f53ff200700 1 -- 172.21.15.82:0/168090702 >> 172.21.15.82:0/168090702 conn(0x7f5400101080 msgr2=0x7f54001034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.738+0000 7f53ff200700 1 -- 172.21.15.82:0/168090702 shutdown_connections 2024-05-03T22:16:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.738+0000 7f53ff200700 1 -- 172.21.15.82:0/168090702 wait complete. 2024-05-03T22:16:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.739+0000 7f53ff200700 1 Processor -- start 2024-05-03T22:16:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.739+0000 7f53ff200700 1 -- start start 2024-05-03T22:16:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.740+0000 7f53ff200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54001055d0 0x7f54001a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.740+0000 7f53ff200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5400105f90 0x7f54001a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.740+0000 7f53ff200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540010b680 0x7f540019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.740+0000 7f53ff200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5400115760 con 0x7f540010b680 2024-05-03T22:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.740+0000 7f53ff200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f54001155e0 con 0x7f54001055d0 2024-05-03T22:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.740+0000 7f53ff200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54001158e0 con 0x7f5400105f90 2024-05-03T22:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.740+0000 7f53fe800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540010b680 0x7f540019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.740+0000 7f53fe800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540010b680 0x7f540019ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40306/0 (socket says 172.21.15.82:40306) 2024-05-03T22:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.740+0000 7f53fe800700 1 -- 172.21.15.82:0/1045064542 learned_addr learned my addr 172.21.15.82:0/1045064542 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.740+0000 7f53fde00700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54001055d0 0x7f54001a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.740+0000 7f53fd400700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5400105f90 0x7f54001a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.741+0000 7f53fe800700 1 -- 172.21.15.82:0/1045064542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5400105f90 msgr2=0x7f54001a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.741+0000 7f53fe800700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5400105f90 0x7f54001a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.741+0000 7f53fe800700 1 -- 172.21.15.82:0/1045064542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54001055d0 msgr2=0x7f54001a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.741+0000 7f53fe800700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54001055d0 0x7f54001a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.741+0000 7f53fe800700 1 -- 172.21.15.82:0/1045064542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540019c1a0 con 0x7f540010b680 2024-05-03T22:16:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.741+0000 7f53fde00700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54001055d0 0x7f54001a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:16:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.741+0000 7f53fe800700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540010b680 0x7f540019ba40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f53f800b970 tx=0x7f53f800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.741+0000 7f53f6a00700 1 -- 172.21.15.82:0/1045064542 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8019070 con 0x7f540010b680 2024-05-03T22:16:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.742+0000 7f53f6a00700 1 -- 172.21.15.82:0/1045064542 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53f800ce40 con 0x7f540010b680 2024-05-03T22:16:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.742+0000 7f53f6a00700 1 -- 172.21.15.82:0/1045064542 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8007370 con 0x7f540010b680 2024-05-03T22:16:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.742+0000 7f53ff200700 1 -- 172.21.15.82:0/1045064542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540019c490 con 0x7f540010b680 2024-05-03T22:16:23.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.742+0000 7f53ff200700 1 -- 172.21.15.82:0/1045064542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54001a8750 con 0x7f540010b680 2024-05-03T22:16:23.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.743+0000 7f53ff200700 1 -- 172.21.15.82:0/1045064542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f540010db10 con 0x7f540010b680 2024-05-03T22:16:23.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.745+0000 7f53f6a00700 1 -- 172.21.15.82:0/1045064542 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f53f801c070 con 0x7f540010b680 2024-05-03T22:16:23.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.747+0000 7f53f6a00700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f53e40b2990 0x7f53e40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:23.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.748+0000 7f53f6a00700 1 -- 172.21.15.82:0/1045064542 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f53f80e1c90 con 0x7f540010b680 2024-05-03T22:16:23.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.748+0000 7f53fde00700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f53e40b2990 0x7f53e40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:23.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.748+0000 7f53fde00700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f53e40b2990 0x7f53e40b4e50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f540019cb80 tx=0x7f53f0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.752+0000 7f53f6a00700 1 -- 172.21.15.82:0/1045064542 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f53f8051d70 con 0x7f540010b680 2024-05-03T22:16:23.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:23.981+0000 7f53ff200700 1 -- 172.21.15.82:0/1045064542 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54000638e0 con 0x7f53e40b2990 2024-05-03T22:16:24.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.012+0000 7f53f6a00700 1 -- 172.21.15.82:0/1045064542 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340415 (secure 0 0 0) 0x7f54000638e0 con 0x7f53e40b2990 2024-05-03T22:16:24.020 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:16:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 -- 172.21.15.82:0/1045064542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f53e40b2990 msgr2=0x7f53e40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f53e40b2990 0x7f53e40b4e50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f540019cb80 tx=0x7f53f0008040 comp rx=0 tx=0).stop 2024-05-03T22:16:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 -- 172.21.15.82:0/1045064542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540010b680 msgr2=0x7f540019ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540010b680 0x7f540019ba40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f53f800b970 tx=0x7f53f800bd30 comp rx=0 tx=0).stop 2024-05-03T22:16:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 -- 172.21.15.82:0/1045064542 shutdown_connections 2024-05-03T22:16:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f53e40b2990 0x7f53e40b4e50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540010b680 0x7f540019ba40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54001055d0 0x7f54001a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 --2- 172.21.15.82:0/1045064542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5400105f90 0x7f54001a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 -- 172.21.15.82:0/1045064542 >> 172.21.15.82:0/1045064542 conn(0x7f5400101080 msgr2=0x7f54001027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 -- 172.21.15.82:0/1045064542 shutdown_connections 2024-05-03T22:16:24.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:24.019+0000 7f53ff200700 1 -- 172.21.15.82:0/1045064542 wait complete. 2024-05-03T22:16:24.024 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-03T22:16:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:24 smithi116 ceph-mon[31828]: pgmap v495: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:16:24.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:24 smithi082 ceph-mon[28404]: pgmap v495: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:16:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:24 smithi130 ceph-mon[32417]: pgmap v495: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:16:24.923 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":495,"stamp":"2024-05-03T22:16:22.699387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655757,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1456,"num_read_kb":819,"num_write":374,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2952624,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359664,"kb_used_data":14600,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124582160,"statfs":{"total":1151940427776,"available":1151572131840,"internally_reserved":0,"allocated":14950400,"data_stored":8294597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":54,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005079"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288498+0000","last_change":"2024-05-03T22:12:36.021433+0000","last_active":"2024-05-03T22:14:38.288498+0000","last_peered":"2024-05-03T22:14:38.288498+0000","last_clean":"2024-05-03T22:14:38.288498+0000","last_became_active":"2024-05-03T22:12:36.019902+0000","last_became_peered":"2024-05-03T22:12:36.019902+0000","last_unstale":"2024-05-03T22:14:38.288498+0000","last_undegraded":"2024-05-03T22:14:38.288498+0000","last_fullsized":"2024-05-03T22:14:38.288498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:08:27.361044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298298+0000","last_change":"2024-05-03T22:12:36.012811+0000","last_active":"2024-05-03T22:14:38.298298+0000","last_peered":"2024-05-03T22:14:38.298298+0000","last_clean":"2024-05-03T22:14:38.298298+0000","last_became_active":"2024-05-03T22:12:36.012491+0000","last_became_peered":"2024-05-03T22:12:36.012491+0000","last_unstale":"2024-05-03T22:14:38.298298+0000","last_undegraded":"2024-05-03T22:14:38.298298+0000","last_fullsized":"2024-05-03T22:14:38.298298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:19:01.773304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297615+0000","last_change":"2024-05-03T22:12:36.009783+0000","last_active":"2024-05-03T22:14:38.297615+0000","last_peered":"2024-05-03T22:14:38.297615+0000","last_clean":"2024-05-03T22:14:38.297615+0000","last_became_active":"2024-05-03T22:12:36.009461+0000","last_became_peered":"2024-05-03T22:12:36.009461+0000","last_unstale":"2024-05-03T22:14:38.297615+0000","last_undegraded":"2024-05-03T22:14:38.297615+0000","last_fullsized":"2024-05-03T22:14:38.297615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:04:17.127323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283737+0000","last_change":"2024-05-03T22:12:36.005887+0000","last_active":"2024-05-03T22:14:38.283737+0000","last_peered":"2024-05-03T22:14:38.283737+0000","last_clean":"2024-05-03T22:14:38.283737+0000","last_became_active":"2024-05-03T22:12:36.005519+0000","last_became_peered":"2024-05-03T22:12:36.005519+0000","last_unstale":"2024-05-03T22:14:38.283737+0000","last_undegraded":"2024-05-03T22:14:38.283737+0000","last_fullsized":"2024-05-03T22:14:38.283737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:15:23.962047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285269+0000","last_change":"2024-05-03T22:12:35.988566+0000","last_active":"2024-05-03T22:14:38.285269+0000","last_peered":"2024-05-03T22:14:38.285269+0000","last_clean":"2024-05-03T22:14:38.285269+0000","last_became_active":"2024-05-03T22:12:35.986766+0000","last_became_peered":"2024-05-03T22:12:35.986766+0000","last_unstale":"2024-05-03T22:14:38.285269+0000","last_undegraded":"2024-05-03T22:14:38.285269+0000","last_fullsized":"2024-05-03T22:14:38.285269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:38:52.877608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036290+0000","last_change":"2024-05-03T22:12:36.013994+0000","last_active":"2024-05-03T22:14:39.036290+0000","last_peered":"2024-05-03T22:14:39.036290+0000","last_clean":"2024-05-03T22:14:39.036290+0000","last_became_active":"2024-05-03T22:12:36.013134+0000","last_became_peered":"2024-05-03T22:12:36.013134+0000","last_unstale":"2024-05-03T22:14:39.036290+0000","last_undegraded":"2024-05-03T22:14:39.036290+0000","last_fullsized":"2024-05-03T22:14:39.036290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:21:47.881727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288908+0000","last_change":"2024-05-03T22:12:36.016165+0000","last_active":"2024-05-03T22:14:38.288908+0000","last_peered":"2024-05-03T22:14:38.288908+0000","last_clean":"2024-05-03T22:14:38.288908+0000","last_became_active":"2024-05-03T22:12:36.009230+0000","last_became_peered":"2024-05-03T22:12:36.009230+0000","last_unstale":"2024-05-03T22:14:38.288908+0000","last_undegraded":"2024-05-03T22:14:38.288908+0000","last_fullsized":"2024-05-03T22:14:38.288908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:27:38.042296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290453+0000","last_change":"2024-05-03T22:12:36.006859+0000","last_active":"2024-05-03T22:14:38.290453+0000","last_peered":"2024-05-03T22:14:38.290453+0000","last_clean":"2024-05-03T22:14:38.290453+0000","last_became_active":"2024-05-03T22:12:36.006396+0000","last_became_peered":"2024-05-03T22:12:36.006396+0000","last_unstale":"2024-05-03T22:14:38.290453+0000","last_undegraded":"2024-05-03T22:14:38.290453+0000","last_fullsized":"2024-05-03T22:14:38.290453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:45:00.863115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728852+0000","last_change":"2024-05-03T22:12:36.020513+0000","last_active":"2024-05-03T22:14:38.728852+0000","last_peered":"2024-05-03T22:14:38.728852+0000","last_clean":"2024-05-03T22:14:38.728852+0000","last_became_active":"2024-05-03T22:12:36.017852+0000","last_became_peered":"2024-05-03T22:12:36.017852+0000","last_unstale":"2024-05-03T22:14:38.728852+0000","last_undegraded":"2024-05-03T22:14:38.728852+0000","last_fullsized":"2024-05-03T22:14:38.728852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:20:33.567258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036842+0000","last_change":"2024-05-03T22:12:36.009729+0000","last_active":"2024-05-03T22:14:39.036842+0000","last_peered":"2024-05-03T22:14:39.036842+0000","last_clean":"2024-05-03T22:14:39.036842+0000","last_became_active":"2024-05-03T22:12:36.007356+0000","last_became_peered":"2024-05-03T22:12:36.007356+0000","last_unstale":"2024-05-03T22:14:39.036842+0000","last_undegraded":"2024-05-03T22:14:39.036842+0000","last_fullsized":"2024-05-03T22:14:39.036842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:49:56.964694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289209+0000","last_change":"2024-05-03T22:12:36.019438+0000","last_active":"2024-05-03T22:14:38.289209+0000","last_peered":"2024-05-03T22:14:38.289209+0000","last_clean":"2024-05-03T22:14:38.289209+0000","last_became_active":"2024-05-03T22:12:36.019049+0000","last_became_peered":"2024-05-03T22:12:36.019049+0000","last_unstale":"2024-05-03T22:14:38.289209+0000","last_undegraded":"2024-05-03T22:14:38.289209+0000","last_fullsized":"2024-05-03T22:14:38.289209+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:06:01.344591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283667+0000","last_change":"2024-05-03T22:12:36.015763+0000","last_active":"2024-05-03T22:14:38.283667+0000","last_peered":"2024-05-03T22:14:38.283667+0000","last_clean":"2024-05-03T22:14:38.283667+0000","last_became_active":"2024-05-03T22:12:36.010804+0000","last_became_peered":"2024-05-03T22:12:36.010804+0000","last_unstale":"2024-05-03T22:14:38.283667+0000","last_undegraded":"2024-05-03T22:14:38.283667+0000","last_fullsized":"2024-05-03T22:14:38.283667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:06:14.150027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289012+0000","last_change":"2024-05-03T22:12:36.018442+0000","last_active":"2024-05-03T22:14:38.289012+0000","last_peered":"2024-05-03T22:14:38.289012+0000","last_clean":"2024-05-03T22:14:38.289012+0000","last_became_active":"2024-05-03T22:12:36.017288+0000","last_became_peered":"2024-05-03T22:12:36.017288+0000","last_unstale":"2024-05-03T22:14:38.289012+0000","last_undegraded":"2024-05-03T22:14:38.289012+0000","last_fullsized":"2024-05-03T22:14:38.289012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:06.097579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.296827+0000","last_change":"2024-05-03T22:12:36.015322+0000","last_active":"2024-05-03T22:14:38.296827+0000","last_peered":"2024-05-03T22:14:38.296827+0000","last_clean":"2024-05-03T22:14:38.296827+0000","last_became_active":"2024-05-03T22:12:36.014933+0000","last_became_peered":"2024-05-03T22:12:36.014933+0000","last_unstale":"2024-05-03T22:14:38.296827+0000","last_undegraded":"2024-05-03T22:14:38.296827+0000","last_fullsized":"2024-05-03T22:14:38.296827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:35:07.654487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.296705+0000","last_change":"2024-05-03T22:12:36.016161+0000","last_active":"2024-05-03T22:14:38.296705+0000","last_peered":"2024-05-03T22:14:38.296705+0000","last_clean":"2024-05-03T22:14:38.296705+0000","last_became_active":"2024-05-03T22:12:36.015827+0000","last_became_peered":"2024-05-03T22:12:36.015827+0000","last_unstale":"2024-05-03T22:14:38.296705+0000","last_undegraded":"2024-05-03T22:14:38.296705+0000","last_fullsized":"2024-05-03T22:14:38.296705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:27.585544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.727778+0000","last_change":"2024-05-03T22:12:36.010741+0000","last_active":"2024-05-03T22:14:38.727778+0000","last_peered":"2024-05-03T22:14:38.727778+0000","last_clean":"2024-05-03T22:14:38.727778+0000","last_became_active":"2024-05-03T22:12:36.010391+0000","last_became_peered":"2024-05-03T22:12:36.010391+0000","last_unstale":"2024-05-03T22:14:38.727778+0000","last_undegraded":"2024-05-03T22:14:38.727778+0000","last_fullsized":"2024-05-03T22:14:38.727778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:58:18.400114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287618+0000","last_change":"2024-05-03T22:12:36.024248+0000","last_active":"2024-05-03T22:14:38.287618+0000","last_peered":"2024-05-03T22:14:38.287618+0000","last_clean":"2024-05-03T22:14:38.287618+0000","last_became_active":"2024-05-03T22:12:36.023864+0000","last_became_peered":"2024-05-03T22:12:36.023864+0000","last_unstale":"2024-05-03T22:14:38.287618+0000","last_undegraded":"2024-05-03T22:14:38.287618+0000","last_fullsized":"2024-05-03T22:14:38.287618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:29:22.455105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285872+0000","last_change":"2024-05-03T22:12:36.006077+0000","last_active":"2024-05-03T22:14:38.285872+0000","last_peered":"2024-05-03T22:14:38.285872+0000","last_clean":"2024-05-03T22:14:38.285872+0000","last_became_active":"2024-05-03T22:12:36.005745+0000","last_became_peered":"2024-05-03T22:12:36.005745+0000","last_unstale":"2024-05-03T22:14:38.285872+0000","last_undegraded":"2024-05-03T22:14:38.285872+0000","last_fullsized":"2024-05-03T22:14:38.285872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:46:47.245132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.292534+0000","last_change":"2024-05-03T22:12:36.001122+0000","last_active":"2024-05-03T22:14:38.292534+0000","last_peered":"2024-05-03T22:14:38.292534+0000","last_clean":"2024-05-03T22:14:38.292534+0000","last_became_active":"2024-05-03T22:12:36.000396+0000","last_became_peered":"2024-05-03T22:12:36.000396+0000","last_unstale":"2024-05-03T22:14:38.292534+0000","last_undegraded":"2024-05-03T22:14:38.292534+0000","last_fullsized":"2024-05-03T22:14:38.292534+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:13:50.457303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291483+0000","last_change":"2024-05-03T22:12:52.138524+0000","last_active":"2024-05-03T22:14:38.291483+0000","last_peered":"2024-05-03T22:14:38.291483+0000","last_clean":"2024-05-03T22:14:38.291483+0000","last_became_active":"2024-05-03T22:12:52.136455+0000","last_became_peered":"2024-05-03T22:12:52.136455+0000","last_unstale":"2024-05-03T22:14:38.291483+0000","last_undegraded":"2024-05-03T22:14:38.291483+0000","last_fullsized":"2024-05-03T22:14:38.291483+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:46:24.807062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":211,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:17.015526+0000","last_change":"2024-05-03T22:14:38.745729+0000","last_active":"2024-05-03T22:16:17.015526+0000","last_peered":"2024-05-03T22:16:17.015526+0000","last_clean":"2024-05-03T22:16:17.015526+0000","last_became_active":"2024-05-03T22:14:38.730211+0000","last_became_peered":"2024-05-03T22:14:38.730211+0000","last_unstale":"2024-05-03T22:16:17.015526+0000","last_undegraded":"2024-05-03T22:16:17.015526+0000","last_fullsized":"2024-05-03T22:16:17.015526+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:23:32.539747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":127,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290952+0000","last_change":"2024-05-03T22:12:36.008931+0000","last_active":"2024-05-03T22:14:38.290952+0000","last_peered":"2024-05-03T22:14:38.290952+0000","last_clean":"2024-05-03T22:14:38.290952+0000","last_became_active":"2024-05-03T22:12:36.008550+0000","last_became_peered":"2024-05-03T22:12:36.008550+0000","last_unstale":"2024-05-03T22:14:38.290952+0000","last_undegraded":"2024-05-03T22:14:38.290952+0000","last_fullsized":"2024-05-03T22:14:38.290952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:13:14.542598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283233+0000","last_change":"2024-05-03T22:13:37.973509+0000","last_active":"2024-05-03T22:14:38.283233+0000","last_peered":"2024-05-03T22:14:38.283233+0000","last_clean":"2024-05-03T22:14:38.283233+0000","last_became_active":"2024-05-03T22:13:37.972160+0000","last_became_peered":"2024-05-03T22:13:37.972160+0000","last_unstale":"2024-05-03T22:14:38.283233+0000","last_undegraded":"2024-05-03T22:14:38.283233+0000","last_fullsized":"2024-05-03T22:14:38.283233+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:04.292667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291284+0000","last_change":"2024-05-03T22:12:32.023501+0000","last_active":"2024-05-03T22:14:38.291284+0000","last_peered":"2024-05-03T22:14:38.291284+0000","last_clean":"2024-05-03T22:14:38.291284+0000","last_became_active":"2024-05-03T22:12:32.022961+0000","last_became_peered":"2024-05-03T22:12:32.022961+0000","last_unstale":"2024-05-03T22:14:38.291284+0000","last_undegraded":"2024-05-03T22:14:38.291284+0000","last_fullsized":"2024-05-03T22:14:38.291284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:03:42.477600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298613+0000","last_change":"2024-05-03T22:12:36.003449+0000","last_active":"2024-05-03T22:14:38.298613+0000","last_peered":"2024-05-03T22:14:38.298613+0000","last_clean":"2024-05-03T22:14:38.298613+0000","last_became_active":"2024-05-03T22:12:36.002257+0000","last_became_peered":"2024-05-03T22:12:36.002257+0000","last_unstale":"2024-05-03T22:14:38.298613+0000","last_undegraded":"2024-05-03T22:14:38.298613+0000","last_fullsized":"2024-05-03T22:14:38.298613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:52:38.409271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283420+0000","last_change":"2024-05-03T22:12:52.143583+0000","last_active":"2024-05-03T22:14:38.283420+0000","last_peered":"2024-05-03T22:14:38.283420+0000","last_clean":"2024-05-03T22:14:38.283420+0000","last_became_active":"2024-05-03T22:12:52.142656+0000","last_became_peered":"2024-05-03T22:12:52.142656+0000","last_unstale":"2024-05-03T22:14:38.283420+0000","last_undegraded":"2024-05-03T22:14:38.283420+0000","last_fullsized":"2024-05-03T22:14:38.283420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:13:37.342909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":58,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285797+0000","last_change":"2024-05-03T22:12:31.985223+0000","last_active":"2024-05-03T22:14:38.285797+0000","last_peered":"2024-05-03T22:14:38.285797+0000","last_clean":"2024-05-03T22:14:38.285797+0000","last_became_active":"2024-05-03T22:12:31.984728+0000","last_became_peered":"2024-05-03T22:12:31.984728+0000","last_unstale":"2024-05-03T22:14:38.285797+0000","last_undegraded":"2024-05-03T22:14:38.285797+0000","last_fullsized":"2024-05-03T22:14:38.285797+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:16.493672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728388+0000","last_change":"2024-05-03T22:12:35.999341+0000","last_active":"2024-05-03T22:14:38.728388+0000","last_peered":"2024-05-03T22:14:38.728388+0000","last_clean":"2024-05-03T22:14:38.728388+0000","last_became_active":"2024-05-03T22:12:35.998263+0000","last_became_peered":"2024-05-03T22:12:35.998263+0000","last_unstale":"2024-05-03T22:14:38.728388+0000","last_undegraded":"2024-05-03T22:14:38.728388+0000","last_fullsized":"2024-05-03T22:14:38.728388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:48:23.344678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283346+0000","last_change":"2024-05-03T22:12:52.137263+0000","last_active":"2024-05-03T22:14:38.283346+0000","last_peered":"2024-05-03T22:14:38.283346+0000","last_clean":"2024-05-03T22:14:38.283346+0000","last_became_active":"2024-05-03T22:12:52.136252+0000","last_became_peered":"2024-05-03T22:12:52.136252+0000","last_unstale":"2024-05-03T22:14:38.283346+0000","last_undegraded":"2024-05-03T22:14:38.283346+0000","last_fullsized":"2024-05-03T22:14:38.283346+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:51:13.215710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285356+0000","last_change":"2024-05-03T22:12:31.981027+0000","last_active":"2024-05-03T22:14:38.285356+0000","last_peered":"2024-05-03T22:14:38.285356+0000","last_clean":"2024-05-03T22:14:38.285356+0000","last_became_active":"2024-05-03T22:12:31.980525+0000","last_became_peered":"2024-05-03T22:12:31.980525+0000","last_unstale":"2024-05-03T22:14:38.285356+0000","last_undegraded":"2024-05-03T22:14:38.285356+0000","last_fullsized":"2024-05-03T22:14:38.285356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:45:00.651947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038208+0000","last_change":"2024-05-03T22:12:36.018950+0000","last_active":"2024-05-03T22:14:39.038208+0000","last_peered":"2024-05-03T22:14:39.038208+0000","last_clean":"2024-05-03T22:14:39.038208+0000","last_became_active":"2024-05-03T22:12:36.018617+0000","last_became_peered":"2024-05-03T22:12:36.018617+0000","last_unstale":"2024-05-03T22:14:39.038208+0000","last_undegraded":"2024-05-03T22:14:39.038208+0000","last_fullsized":"2024-05-03T22:14:39.038208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:14:03.619225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.292272+0000","last_change":"2024-05-03T22:12:52.127174+0000","last_active":"2024-05-03T22:14:38.292272+0000","last_peered":"2024-05-03T22:14:38.292272+0000","last_clean":"2024-05-03T22:14:38.292272+0000","last_became_active":"2024-05-03T22:12:52.125762+0000","last_became_peered":"2024-05-03T22:12:52.125762+0000","last_unstale":"2024-05-03T22:14:38.292272+0000","last_undegraded":"2024-05-03T22:14:38.292272+0000","last_fullsized":"2024-05-03T22:14:38.292272+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:21:20.502831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'6","reported_seq":189,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:19.534076+0000","last_change":"2024-05-03T22:12:31.983721+0000","last_active":"2024-05-03T22:16:19.534076+0000","last_peered":"2024-05-03T22:16:19.534076+0000","last_clean":"2024-05-03T22:16:19.534076+0000","last_became_active":"2024-05-03T22:12:31.983192+0000","last_became_peered":"2024-05-03T22:12:31.983192+0000","last_unstale":"2024-05-03T22:16:19.534076+0000","last_undegraded":"2024-05-03T22:16:19.534076+0000","last_fullsized":"2024-05-03T22:16:19.534076+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:02:28.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284857+0000","last_change":"2024-05-03T22:12:36.012909+0000","last_active":"2024-05-03T22:14:38.284857+0000","last_peered":"2024-05-03T22:14:38.284857+0000","last_clean":"2024-05-03T22:14:38.284857+0000","last_became_active":"2024-05-03T22:12:36.011402+0000","last_became_peered":"2024-05-03T22:12:36.011402+0000","last_unstale":"2024-05-03T22:14:38.284857+0000","last_undegraded":"2024-05-03T22:14:38.284857+0000","last_fullsized":"2024-05-03T22:14:38.284857+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:46:31.464317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291685+0000","last_change":"2024-05-03T22:13:37.973869+0000","last_active":"2024-05-03T22:14:38.291685+0000","last_peered":"2024-05-03T22:14:38.291685+0000","last_clean":"2024-05-03T22:14:38.291685+0000","last_became_active":"2024-05-03T22:13:37.972089+0000","last_became_peered":"2024-05-03T22:13:37.972089+0000","last_unstale":"2024-05-03T22:14:38.291685+0000","last_undegraded":"2024-05-03T22:14:38.291685+0000","last_fullsized":"2024-05-03T22:14:38.291685+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:18:00.510183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,10],"acting":[2,6,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036289+0000","last_change":"2024-05-03T22:12:31.984789+0000","last_active":"2024-05-03T22:14:39.036289+0000","last_peered":"2024-05-03T22:14:39.036289+0000","last_clean":"2024-05-03T22:14:39.036289+0000","last_became_active":"2024-05-03T22:12:31.980106+0000","last_became_peered":"2024-05-03T22:12:31.980106+0000","last_unstale":"2024-05-03T22:14:39.036289+0000","last_undegraded":"2024-05-03T22:14:39.036289+0000","last_fullsized":"2024-05-03T22:14:39.036289+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:50:09.564802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038328+0000","last_change":"2024-05-03T22:13:37.973316+0000","last_active":"2024-05-03T22:14:39.038328+0000","last_peered":"2024-05-03T22:14:39.038328+0000","last_clean":"2024-05-03T22:14:39.038328+0000","last_became_active":"2024-05-03T22:13:37.972152+0000","last_became_peered":"2024-05-03T22:13:37.972152+0000","last_unstale":"2024-05-03T22:14:39.038328+0000","last_undegraded":"2024-05-03T22:14:39.038328+0000","last_fullsized":"2024-05-03T22:14:39.038328+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:23:21.940322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287468+0000","last_change":"2024-05-03T22:12:52.145126+0000","last_active":"2024-05-03T22:14:38.287468+0000","last_peered":"2024-05-03T22:14:38.287468+0000","last_clean":"2024-05-03T22:14:38.287468+0000","last_became_active":"2024-05-03T22:12:52.144544+0000","last_became_peered":"2024-05-03T22:12:52.144544+0000","last_unstale":"2024-05-03T22:14:38.287468+0000","last_undegraded":"2024-05-03T22:14:38.287468+0000","last_fullsized":"2024-05-03T22:14:38.287468+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:59:54.069750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287280+0000","last_change":"2024-05-03T22:12:31.978411+0000","last_active":"2024-05-03T22:14:38.287280+0000","last_peered":"2024-05-03T22:14:38.287280+0000","last_clean":"2024-05-03T22:14:38.287280+0000","last_became_active":"2024-05-03T22:12:31.976914+0000","last_became_peered":"2024-05-03T22:12:31.976914+0000","last_unstale":"2024-05-03T22:14:38.287280+0000","last_undegraded":"2024-05-03T22:14:38.287280+0000","last_fullsized":"2024-05-03T22:14:38.287280+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:52:05.545111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290698+0000","last_change":"2024-05-03T22:12:36.014624+0000","last_active":"2024-05-03T22:14:38.290698+0000","last_peered":"2024-05-03T22:14:38.290698+0000","last_clean":"2024-05-03T22:14:38.290698+0000","last_became_active":"2024-05-03T22:12:36.012531+0000","last_became_peered":"2024-05-03T22:12:36.012531+0000","last_unstale":"2024-05-03T22:14:38.290698+0000","last_undegraded":"2024-05-03T22:14:38.290698+0000","last_fullsized":"2024-05-03T22:14:38.290698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:19:46.840442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298474+0000","last_change":"2024-05-03T22:12:52.137187+0000","last_active":"2024-05-03T22:14:38.298474+0000","last_peered":"2024-05-03T22:14:38.298474+0000","last_clean":"2024-05-03T22:14:38.298474+0000","last_became_active":"2024-05-03T22:12:52.136764+0000","last_became_peered":"2024-05-03T22:12:52.136764+0000","last_unstale":"2024-05-03T22:14:38.298474+0000","last_undegraded":"2024-05-03T22:14:38.298474+0000","last_fullsized":"2024-05-03T22:14:38.298474+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:54:00.922048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037431+0000","last_change":"2024-05-03T22:12:31.982086+0000","last_active":"2024-05-03T22:14:39.037431+0000","last_peered":"2024-05-03T22:14:39.037431+0000","last_clean":"2024-05-03T22:14:39.037431+0000","last_became_active":"2024-05-03T22:12:31.981464+0000","last_became_peered":"2024-05-03T22:12:31.981464+0000","last_unstale":"2024-05-03T22:14:39.037431+0000","last_undegraded":"2024-05-03T22:14:39.037431+0000","last_fullsized":"2024-05-03T22:14:39.037431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:22.450640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283194+0000","last_change":"2024-05-03T22:12:36.015808+0000","last_active":"2024-05-03T22:14:38.283194+0000","last_peered":"2024-05-03T22:14:38.283194+0000","last_clean":"2024-05-03T22:14:38.283194+0000","last_became_active":"2024-05-03T22:12:36.015496+0000","last_became_peered":"2024-05-03T22:12:36.015496+0000","last_unstale":"2024-05-03T22:14:38.283194+0000","last_undegraded":"2024-05-03T22:14:38.283194+0000","last_fullsized":"2024-05-03T22:14:38.283194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:12:18.316985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291668+0000","last_change":"2024-05-03T22:12:52.131977+0000","last_active":"2024-05-03T22:14:38.291668+0000","last_peered":"2024-05-03T22:14:38.291668+0000","last_clean":"2024-05-03T22:14:38.291668+0000","last_became_active":"2024-05-03T22:12:52.131120+0000","last_became_peered":"2024-05-03T22:12:52.131120+0000","last_unstale":"2024-05-03T22:14:38.291668+0000","last_undegraded":"2024-05-03T22:14:38.291668+0000","last_fullsized":"2024-05-03T22:14:38.291668+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:38:28.239495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":317,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:19.532356+0000","last_change":"2024-05-03T22:12:31.977238+0000","last_active":"2024-05-03T22:16:19.532356+0000","last_peered":"2024-05-03T22:16:19.532356+0000","last_clean":"2024-05-03T22:16:19.532356+0000","last_became_active":"2024-05-03T22:12:31.975006+0000","last_became_peered":"2024-05-03T22:12:31.975006+0000","last_unstale":"2024-05-03T22:16:19.532356+0000","last_undegraded":"2024-05-03T22:16:19.532356+0000","last_fullsized":"2024-05-03T22:16:19.532356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:01.030733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":268,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728547+0000","last_change":"2024-05-03T22:12:36.007750+0000","last_active":"2024-05-03T22:14:38.728547+0000","last_peered":"2024-05-03T22:14:38.728547+0000","last_clean":"2024-05-03T22:14:38.728547+0000","last_became_active":"2024-05-03T22:12:36.005505+0000","last_became_peered":"2024-05-03T22:12:36.005505+0000","last_unstale":"2024-05-03T22:14:38.728547+0000","last_undegraded":"2024-05-03T22:14:38.728547+0000","last_fullsized":"2024-05-03T22:14:38.728547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:37:28.409920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283193+0000","last_change":"2024-05-03T22:12:52.142733+0000","last_active":"2024-05-03T22:14:38.283193+0000","last_peered":"2024-05-03T22:14:38.283193+0000","last_clean":"2024-05-03T22:14:38.283193+0000","last_became_active":"2024-05-03T22:12:52.142186+0000","last_became_peered":"2024-05-03T22:12:52.142186+0000","last_unstale":"2024-05-03T22:14:38.283193+0000","last_undegraded":"2024-05-03T22:14:38.283193+0000","last_fullsized":"2024-05-03T22:14:38.283193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:05:12.226021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289149+0000","last_change":"2024-05-03T22:12:31.984945+0000","last_active":"2024-05-03T22:14:38.289149+0000","last_peered":"2024-05-03T22:14:38.289149+0000","last_clean":"2024-05-03T22:14:38.289149+0000","last_became_active":"2024-05-03T22:12:31.982844+0000","last_became_peered":"2024-05-03T22:12:31.982844+0000","last_unstale":"2024-05-03T22:14:38.289149+0000","last_undegraded":"2024-05-03T22:14:38.289149+0000","last_fullsized":"2024-05-03T22:14:38.289149+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:51:13.520574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298947+0000","last_change":"2024-05-03T22:12:36.010250+0000","last_active":"2024-05-03T22:14:38.298947+0000","last_peered":"2024-05-03T22:14:38.298947+0000","last_clean":"2024-05-03T22:14:38.298947+0000","last_became_active":"2024-05-03T22:12:36.009867+0000","last_became_peered":"2024-05-03T22:12:36.009867+0000","last_unstale":"2024-05-03T22:14:38.298947+0000","last_undegraded":"2024-05-03T22:14:38.298947+0000","last_fullsized":"2024-05-03T22:14:38.298947+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:21:07.114667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283520+0000","last_change":"2024-05-03T22:13:37.973331+0000","last_active":"2024-05-03T22:14:38.283520+0000","last_peered":"2024-05-03T22:14:38.283520+0000","last_clean":"2024-05-03T22:14:38.283520+0000","last_became_active":"2024-05-03T22:13:37.972030+0000","last_became_peered":"2024-05-03T22:13:37.972030+0000","last_unstale":"2024-05-03T22:14:38.283520+0000","last_undegraded":"2024-05-03T22:14:38.283520+0000","last_fullsized":"2024-05-03T22:14:38.283520+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:11:18.105975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037928+0000","last_change":"2024-05-03T22:12:32.021662+0000","last_active":"2024-05-03T22:14:39.037928+0000","last_peered":"2024-05-03T22:14:39.037928+0000","last_clean":"2024-05-03T22:14:39.037928+0000","last_became_active":"2024-05-03T22:12:32.021128+0000","last_became_peered":"2024-05-03T22:12:32.021128+0000","last_unstale":"2024-05-03T22:14:39.037928+0000","last_undegraded":"2024-05-03T22:14:39.037928+0000","last_fullsized":"2024-05-03T22:14:39.037928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:08:02.608160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728509+0000","last_change":"2024-05-03T22:13:37.973105+0000","last_active":"2024-05-03T22:14:38.728509+0000","last_peered":"2024-05-03T22:14:38.728509+0000","last_clean":"2024-05-03T22:14:38.728509+0000","last_became_active":"2024-05-03T22:13:37.971963+0000","last_became_peered":"2024-05-03T22:13:37.971963+0000","last_unstale":"2024-05-03T22:14:38.728509+0000","last_undegraded":"2024-05-03T22:14:38.728509+0000","last_fullsized":"2024-05-03T22:14:38.728509+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:22:50.092753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283190+0000","last_change":"2024-05-03T22:12:52.140596+0000","last_active":"2024-05-03T22:14:38.283190+0000","last_peered":"2024-05-03T22:14:38.283190+0000","last_clean":"2024-05-03T22:14:38.283190+0000","last_became_active":"2024-05-03T22:12:52.140185+0000","last_became_peered":"2024-05-03T22:12:52.140185+0000","last_unstale":"2024-05-03T22:14:38.283190+0000","last_undegraded":"2024-05-03T22:14:38.283190+0000","last_fullsized":"2024-05-03T22:14:38.283190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:01:53.792225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'35","reported_seq":357,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:19.539642+0000","last_change":"2024-05-03T22:12:31.984670+0000","last_active":"2024-05-03T22:16:19.539642+0000","last_peered":"2024-05-03T22:16:19.539642+0000","last_clean":"2024-05-03T22:16:19.539642+0000","last_became_active":"2024-05-03T22:12:31.983939+0000","last_became_peered":"2024-05-03T22:12:31.983939+0000","last_unstale":"2024-05-03T22:16:19.539642+0000","last_undegraded":"2024-05-03T22:16:19.539642+0000","last_fullsized":"2024-05-03T22:16:19.539642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:29:13.702952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57951,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":277,"num_read_kb":194,"num_write":37,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285349+0000","last_change":"2024-05-03T22:12:36.010032+0000","last_active":"2024-05-03T22:14:38.285349+0000","last_peered":"2024-05-03T22:14:38.285349+0000","last_clean":"2024-05-03T22:14:38.285349+0000","last_became_active":"2024-05-03T22:12:36.009682+0000","last_became_peered":"2024-05-03T22:12:36.009682+0000","last_unstale":"2024-05-03T22:14:38.285349+0000","last_undegraded":"2024-05-03T22:14:38.285349+0000","last_fullsized":"2024-05-03T22:14:38.285349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:58.307939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038806+0000","last_change":"2024-05-03T22:12:52.137858+0000","last_active":"2024-05-03T22:14:39.038806+0000","last_peered":"2024-05-03T22:14:39.038806+0000","last_clean":"2024-05-03T22:14:39.038806+0000","last_became_active":"2024-05-03T22:12:52.137343+0000","last_became_peered":"2024-05-03T22:12:52.137343+0000","last_unstale":"2024-05-03T22:14:39.038806+0000","last_undegraded":"2024-05-03T22:14:39.038806+0000","last_fullsized":"2024-05-03T22:14:39.038806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:30:20.534943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.292015+0000","last_change":"2024-05-03T22:12:31.986574+0000","last_active":"2024-05-03T22:14:38.292015+0000","last_peered":"2024-05-03T22:14:38.292015+0000","last_clean":"2024-05-03T22:14:38.292015+0000","last_became_active":"2024-05-03T22:12:31.986168+0000","last_became_peered":"2024-05-03T22:12:31.986168+0000","last_unstale":"2024-05-03T22:14:38.292015+0000","last_undegraded":"2024-05-03T22:14:38.292015+0000","last_fullsized":"2024-05-03T22:14:38.292015+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:09:22.184243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287388+0000","last_change":"2024-05-03T22:12:36.008859+0000","last_active":"2024-05-03T22:14:38.287388+0000","last_peered":"2024-05-03T22:14:38.287388+0000","last_clean":"2024-05-03T22:14:38.287388+0000","last_became_active":"2024-05-03T22:12:36.008301+0000","last_became_peered":"2024-05-03T22:12:36.008301+0000","last_unstale":"2024-05-03T22:14:38.287388+0000","last_undegraded":"2024-05-03T22:14:38.287388+0000","last_fullsized":"2024-05-03T22:14:38.287388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:09:51.945525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288536+0000","last_change":"2024-05-03T22:12:52.143678+0000","last_active":"2024-05-03T22:14:38.288536+0000","last_peered":"2024-05-03T22:14:38.288536+0000","last_clean":"2024-05-03T22:14:38.288536+0000","last_became_active":"2024-05-03T22:12:52.143240+0000","last_became_peered":"2024-05-03T22:12:52.143240+0000","last_unstale":"2024-05-03T22:14:38.288536+0000","last_undegraded":"2024-05-03T22:14:38.288536+0000","last_fullsized":"2024-05-03T22:14:38.288536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:57:03.078230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037747+0000","last_change":"2024-05-03T22:12:31.987181+0000","last_active":"2024-05-03T22:14:39.037747+0000","last_peered":"2024-05-03T22:14:39.037747+0000","last_clean":"2024-05-03T22:14:39.037747+0000","last_became_active":"2024-05-03T22:12:31.986795+0000","last_became_peered":"2024-05-03T22:12:31.986795+0000","last_unstale":"2024-05-03T22:14:39.037747+0000","last_undegraded":"2024-05-03T22:14:39.037747+0000","last_fullsized":"2024-05-03T22:14:39.037747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:08:03.871175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289604+0000","last_change":"2024-05-03T22:12:36.023303+0000","last_active":"2024-05-03T22:14:38.289604+0000","last_peered":"2024-05-03T22:14:38.289604+0000","last_clean":"2024-05-03T22:14:38.289604+0000","last_became_active":"2024-05-03T22:12:36.022969+0000","last_became_peered":"2024-05-03T22:12:36.022969+0000","last_unstale":"2024-05-03T22:14:38.289604+0000","last_undegraded":"2024-05-03T22:14:38.289604+0000","last_fullsized":"2024-05-03T22:14:38.289604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:08:19.277423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283923+0000","last_change":"2024-05-03T22:12:52.145449+0000","last_active":"2024-05-03T22:14:38.283923+0000","last_peered":"2024-05-03T22:14:38.283923+0000","last_clean":"2024-05-03T22:14:38.283923+0000","last_became_active":"2024-05-03T22:12:52.144652+0000","last_became_peered":"2024-05-03T22:12:52.144652+0000","last_unstale":"2024-05-03T22:14:38.283923+0000","last_undegraded":"2024-05-03T22:14:38.283923+0000","last_fullsized":"2024-05-03T22:14:38.283923+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:03:17.916994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":188,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:20.559588+0000","last_change":"2024-05-03T22:12:31.986355+0000","last_active":"2024-05-03T22:16:20.559588+0000","last_peered":"2024-05-03T22:16:20.559588+0000","last_clean":"2024-05-03T22:16:20.559588+0000","last_became_active":"2024-05-03T22:12:31.985927+0000","last_became_peered":"2024-05-03T22:12:31.985927+0000","last_unstale":"2024-05-03T22:16:20.559588+0000","last_undegraded":"2024-05-03T22:16:20.559588+0000","last_fullsized":"2024-05-03T22:16:20.559588+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:25:41.683036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288905+0000","last_change":"2024-05-03T22:13:37.973243+0000","last_active":"2024-05-03T22:14:38.288905+0000","last_peered":"2024-05-03T22:14:38.288905+0000","last_clean":"2024-05-03T22:14:38.288905+0000","last_became_active":"2024-05-03T22:13:37.972204+0000","last_became_peered":"2024-05-03T22:13:37.972204+0000","last_unstale":"2024-05-03T22:14:38.288905+0000","last_undegraded":"2024-05-03T22:14:38.288905+0000","last_fullsized":"2024-05-03T22:14:38.288905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:58:23.537262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289792+0000","last_change":"2024-05-03T22:12:52.137933+0000","last_active":"2024-05-03T22:14:38.289792+0000","last_peered":"2024-05-03T22:14:38.289792+0000","last_clean":"2024-05-03T22:14:38.289792+0000","last_became_active":"2024-05-03T22:12:52.137339+0000","last_became_peered":"2024-05-03T22:12:52.137339+0000","last_unstale":"2024-05-03T22:14:38.289792+0000","last_undegraded":"2024-05-03T22:14:38.289792+0000","last_fullsized":"2024-05-03T22:14:38.289792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:10:11.514234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":63,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284540+0000","last_change":"2024-05-03T22:12:32.023719+0000","last_active":"2024-05-03T22:14:38.284540+0000","last_peered":"2024-05-03T22:14:38.284540+0000","last_clean":"2024-05-03T22:14:38.284540+0000","last_became_active":"2024-05-03T22:12:32.022649+0000","last_became_peered":"2024-05-03T22:12:32.022649+0000","last_unstale":"2024-05-03T22:14:38.284540+0000","last_undegraded":"2024-05-03T22:14:38.284540+0000","last_fullsized":"2024-05-03T22:14:38.284540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:24:46.321843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037683+0000","last_change":"2024-05-03T22:12:36.019586+0000","last_active":"2024-05-03T22:14:39.037683+0000","last_peered":"2024-05-03T22:14:39.037683+0000","last_clean":"2024-05-03T22:14:39.037683+0000","last_became_active":"2024-05-03T22:12:36.019209+0000","last_became_peered":"2024-05-03T22:12:36.019209+0000","last_unstale":"2024-05-03T22:14:39.037683+0000","last_undegraded":"2024-05-03T22:14:39.037683+0000","last_fullsized":"2024-05-03T22:14:39.037683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:05:31.897550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037411+0000","last_change":"2024-05-03T22:12:52.137116+0000","last_active":"2024-05-03T22:14:39.037411+0000","last_peered":"2024-05-03T22:14:39.037411+0000","last_clean":"2024-05-03T22:14:39.037411+0000","last_became_active":"2024-05-03T22:12:52.135908+0000","last_became_peered":"2024-05-03T22:12:52.135908+0000","last_unstale":"2024-05-03T22:14:39.037411+0000","last_undegraded":"2024-05-03T22:14:39.037411+0000","last_fullsized":"2024-05-03T22:14:39.037411+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:44.728662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284955+0000","last_change":"2024-05-03T22:12:31.982743+0000","last_active":"2024-05-03T22:14:38.284955+0000","last_peered":"2024-05-03T22:14:38.284955+0000","last_clean":"2024-05-03T22:14:38.284955+0000","last_became_active":"2024-05-03T22:12:31.982181+0000","last_became_peered":"2024-05-03T22:12:31.982181+0000","last_unstale":"2024-05-03T22:14:38.284955+0000","last_undegraded":"2024-05-03T22:14:38.284955+0000","last_fullsized":"2024-05-03T22:14:38.284955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:55:32.178361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288612+0000","last_change":"2024-05-03T22:12:36.017581+0000","last_active":"2024-05-03T22:14:38.288612+0000","last_peered":"2024-05-03T22:14:38.288612+0000","last_clean":"2024-05-03T22:14:38.288612+0000","last_became_active":"2024-05-03T22:12:36.017156+0000","last_became_peered":"2024-05-03T22:12:36.017156+0000","last_unstale":"2024-05-03T22:14:38.288612+0000","last_undegraded":"2024-05-03T22:14:38.288612+0000","last_fullsized":"2024-05-03T22:14:38.288612+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:05:47.432249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284807+0000","last_change":"2024-05-03T22:12:52.149798+0000","last_active":"2024-05-03T22:14:38.284807+0000","last_peered":"2024-05-03T22:14:38.284807+0000","last_clean":"2024-05-03T22:14:38.284807+0000","last_became_active":"2024-05-03T22:12:52.149184+0000","last_became_peered":"2024-05-03T22:12:52.149184+0000","last_unstale":"2024-05-03T22:14:38.284807+0000","last_undegraded":"2024-05-03T22:14:38.284807+0000","last_fullsized":"2024-05-03T22:14:38.284807+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:21:38.968847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283619+0000","last_change":"2024-05-03T22:12:32.022315+0000","last_active":"2024-05-03T22:14:38.283619+0000","last_peered":"2024-05-03T22:14:38.283619+0000","last_clean":"2024-05-03T22:14:38.283619+0000","last_became_active":"2024-05-03T22:12:32.021730+0000","last_became_peered":"2024-05-03T22:12:32.021730+0000","last_unstale":"2024-05-03T22:14:38.283619+0000","last_undegraded":"2024-05-03T22:14:38.283619+0000","last_fullsized":"2024-05-03T22:14:38.283619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:26.485434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036593+0000","last_change":"2024-05-03T22:12:36.004242+0000","last_active":"2024-05-03T22:14:39.036593+0000","last_peered":"2024-05-03T22:14:39.036593+0000","last_clean":"2024-05-03T22:14:39.036593+0000","last_became_active":"2024-05-03T22:12:36.003811+0000","last_became_peered":"2024-05-03T22:12:36.003811+0000","last_unstale":"2024-05-03T22:14:39.036593+0000","last_undegraded":"2024-05-03T22:14:39.036593+0000","last_fullsized":"2024-05-03T22:14:39.036593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:16:57.058316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289626+0000","last_change":"2024-05-03T22:12:52.125889+0000","last_active":"2024-05-03T22:14:38.289626+0000","last_peered":"2024-05-03T22:14:38.289626+0000","last_clean":"2024-05-03T22:14:38.289626+0000","last_became_active":"2024-05-03T22:12:52.125401+0000","last_became_peered":"2024-05-03T22:12:52.125401+0000","last_unstale":"2024-05-03T22:14:38.289626+0000","last_undegraded":"2024-05-03T22:14:38.289626+0000","last_fullsized":"2024-05-03T22:14:38.289626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:32:11.112125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'6","reported_seq":189,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:21.027800+0000","last_change":"2024-05-03T22:12:31.981194+0000","last_active":"2024-05-03T22:16:21.027800+0000","last_peered":"2024-05-03T22:16:21.027800+0000","last_clean":"2024-05-03T22:16:21.027800+0000","last_became_active":"2024-05-03T22:12:31.980685+0000","last_became_peered":"2024-05-03T22:12:31.980685+0000","last_unstale":"2024-05-03T22:16:21.027800+0000","last_undegraded":"2024-05-03T22:16:21.027800+0000","last_fullsized":"2024-05-03T22:16:21.027800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:00:04.697119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.036298+0000","last_change":"2024-05-03T22:12:36.020405+0000","last_active":"2024-05-03T22:14:39.036298+0000","last_peered":"2024-05-03T22:14:39.036298+0000","last_clean":"2024-05-03T22:14:39.036298+0000","last_became_active":"2024-05-03T22:12:36.020003+0000","last_became_peered":"2024-05-03T22:12:36.020003+0000","last_unstale":"2024-05-03T22:14:39.036298+0000","last_undegraded":"2024-05-03T22:14:39.036298+0000","last_fullsized":"2024-05-03T22:14:39.036298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:21:49.931145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291305+0000","last_change":"2024-05-03T22:12:52.130467+0000","last_active":"2024-05-03T22:14:38.291305+0000","last_peered":"2024-05-03T22:14:38.291305+0000","last_clean":"2024-05-03T22:14:38.291305+0000","last_became_active":"2024-05-03T22:12:52.129639+0000","last_became_peered":"2024-05-03T22:12:52.129639+0000","last_unstale":"2024-05-03T22:14:38.291305+0000","last_undegraded":"2024-05-03T22:14:38.291305+0000","last_fullsized":"2024-05-03T22:14:38.291305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:31:17.043909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037896+0000","last_change":"2024-05-03T22:12:36.010293+0000","last_active":"2024-05-03T22:14:39.037896+0000","last_peered":"2024-05-03T22:14:39.037896+0000","last_clean":"2024-05-03T22:14:39.037896+0000","last_became_active":"2024-05-03T22:12:36.009682+0000","last_became_peered":"2024-05-03T22:12:36.009682+0000","last_unstale":"2024-05-03T22:14:39.037896+0000","last_undegraded":"2024-05-03T22:14:39.037896+0000","last_fullsized":"2024-05-03T22:14:39.037896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:19:32.824272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":187,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:20.558139+0000","last_change":"2024-05-03T22:12:32.019614+0000","last_active":"2024-05-03T22:16:20.558139+0000","last_peered":"2024-05-03T22:16:20.558139+0000","last_clean":"2024-05-03T22:16:20.558139+0000","last_became_active":"2024-05-03T22:12:32.018880+0000","last_became_peered":"2024-05-03T22:12:32.018880+0000","last_unstale":"2024-05-03T22:16:20.558139+0000","last_undegraded":"2024-05-03T22:16:20.558139+0000","last_fullsized":"2024-05-03T22:16:20.558139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:01:46.354811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":137,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289035+0000","last_change":"2024-05-03T22:12:52.142829+0000","last_active":"2024-05-03T22:14:38.289035+0000","last_peered":"2024-05-03T22:14:38.289035+0000","last_clean":"2024-05-03T22:14:38.289035+0000","last_became_active":"2024-05-03T22:12:52.142289+0000","last_became_peered":"2024-05-03T22:12:52.142289+0000","last_unstale":"2024-05-03T22:14:38.289035+0000","last_undegraded":"2024-05-03T22:14:38.289035+0000","last_fullsized":"2024-05-03T22:14:38.289035+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:54:44.815014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.293260+0000","last_change":"2024-05-03T22:12:36.009551+0000","last_active":"2024-05-03T22:14:38.293260+0000","last_peered":"2024-05-03T22:14:38.293260+0000","last_clean":"2024-05-03T22:14:38.293260+0000","last_became_active":"2024-05-03T22:12:36.009180+0000","last_became_peered":"2024-05-03T22:12:36.009180+0000","last_unstale":"2024-05-03T22:14:38.293260+0000","last_undegraded":"2024-05-03T22:14:38.293260+0000","last_fullsized":"2024-05-03T22:14:38.293260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:03:17.824610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283475+0000","last_change":"2024-05-03T22:12:31.988051+0000","last_active":"2024-05-03T22:14:38.283475+0000","last_peered":"2024-05-03T22:14:38.283475+0000","last_clean":"2024-05-03T22:14:38.283475+0000","last_became_active":"2024-05-03T22:12:31.987641+0000","last_became_peered":"2024-05-03T22:12:31.987641+0000","last_unstale":"2024-05-03T22:14:38.283475+0000","last_undegraded":"2024-05-03T22:14:38.283475+0000","last_fullsized":"2024-05-03T22:14:38.283475+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:51:02.824815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":121,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288649+0000","last_change":"2024-05-03T22:10:37.173231+0000","last_active":"2024-05-03T22:14:38.288649+0000","last_peered":"2024-05-03T22:14:38.288649+0000","last_clean":"2024-05-03T22:14:38.288649+0000","last_became_active":"2024-05-03T22:10:37.157400+0000","last_became_peered":"2024-05-03T22:10:37.157400+0000","last_unstale":"2024-05-03T22:14:38.288649+0000","last_undegraded":"2024-05-03T22:14:38.288649+0000","last_fullsized":"2024-05-03T22:14:38.288649+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:05:53.333203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:05:53.333203+0000","last_clean_scrub_stamp":"2024-05-03T22:05:53.333203+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:51:06.825624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038969+0000","last_change":"2024-05-03T22:12:52.137851+0000","last_active":"2024-05-03T22:14:39.038969+0000","last_peered":"2024-05-03T22:14:39.038969+0000","last_clean":"2024-05-03T22:14:39.038969+0000","last_became_active":"2024-05-03T22:12:52.136608+0000","last_became_peered":"2024-05-03T22:12:52.136608+0000","last_unstale":"2024-05-03T22:14:39.038969+0000","last_undegraded":"2024-05-03T22:14:39.038969+0000","last_fullsized":"2024-05-03T22:14:39.038969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:43:59.013159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286653+0000","last_change":"2024-05-03T22:12:36.007079+0000","last_active":"2024-05-03T22:14:38.286653+0000","last_peered":"2024-05-03T22:14:38.286653+0000","last_clean":"2024-05-03T22:14:38.286653+0000","last_became_active":"2024-05-03T22:12:36.006737+0000","last_became_peered":"2024-05-03T22:12:36.006737+0000","last_unstale":"2024-05-03T22:14:38.286653+0000","last_undegraded":"2024-05-03T22:14:38.286653+0000","last_fullsized":"2024-05-03T22:14:38.286653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:24:56.805461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288714+0000","last_change":"2024-05-03T22:12:31.982718+0000","last_active":"2024-05-03T22:14:38.288714+0000","last_peered":"2024-05-03T22:14:38.288714+0000","last_clean":"2024-05-03T22:14:38.288714+0000","last_became_active":"2024-05-03T22:12:31.980502+0000","last_became_peered":"2024-05-03T22:12:31.980502+0000","last_unstale":"2024-05-03T22:14:38.288714+0000","last_undegraded":"2024-05-03T22:14:38.288714+0000","last_fullsized":"2024-05-03T22:14:38.288714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:06:48.543038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286761+0000","last_change":"2024-05-03T22:12:52.130775+0000","last_active":"2024-05-03T22:14:38.286761+0000","last_peered":"2024-05-03T22:14:38.286761+0000","last_clean":"2024-05-03T22:14:38.286761+0000","last_became_active":"2024-05-03T22:12:52.130122+0000","last_became_peered":"2024-05-03T22:12:52.130122+0000","last_unstale":"2024-05-03T22:14:38.286761+0000","last_undegraded":"2024-05-03T22:14:38.286761+0000","last_fullsized":"2024-05-03T22:14:38.286761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:49.308484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.314204+0000","last_change":"2024-05-03T22:14:38.313777+0000","last_active":"2024-05-03T22:14:38.314204+0000","last_peered":"2024-05-03T22:14:38.314204+0000","last_clean":"2024-05-03T22:14:38.314204+0000","last_became_active":"2024-05-03T22:14:38.298126+0000","last_became_peered":"2024-05-03T22:14:38.298126+0000","last_unstale":"2024-05-03T22:14:38.314204+0000","last_undegraded":"2024-05-03T22:14:38.314204+0000","last_fullsized":"2024-05-03T22:14:38.314204+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:24:15.804010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289442+0000","last_change":"2024-05-03T22:12:36.005260+0000","last_active":"2024-05-03T22:14:38.289442+0000","last_peered":"2024-05-03T22:14:38.289442+0000","last_clean":"2024-05-03T22:14:38.289442+0000","last_became_active":"2024-05-03T22:12:36.004942+0000","last_became_peered":"2024-05-03T22:12:36.004942+0000","last_unstale":"2024-05-03T22:14:38.289442+0000","last_undegraded":"2024-05-03T22:14:38.289442+0000","last_fullsized":"2024-05-03T22:14:38.289442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:46.395893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290577+0000","last_change":"2024-05-03T22:12:52.132278+0000","last_active":"2024-05-03T22:14:38.290577+0000","last_peered":"2024-05-03T22:14:38.290577+0000","last_clean":"2024-05-03T22:14:38.290577+0000","last_became_active":"2024-05-03T22:12:52.131836+0000","last_became_peered":"2024-05-03T22:12:52.131836+0000","last_unstale":"2024-05-03T22:14:38.290577+0000","last_undegraded":"2024-05-03T22:14:38.290577+0000","last_fullsized":"2024-05-03T22:14:38.290577+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:54:07.305893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'15","reported_seq":60,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:44.001735+0000","last_change":"2024-05-03T22:12:31.978324+0000","last_active":"2024-05-03T22:14:44.001735+0000","last_peered":"2024-05-03T22:14:44.001735+0000","last_clean":"2024-05-03T22:14:44.001735+0000","last_became_active":"2024-05-03T22:12:31.977156+0000","last_became_peered":"2024-05-03T22:12:31.977156+0000","last_unstale":"2024-05-03T22:14:44.001735+0000","last_undegraded":"2024-05-03T22:14:44.001735+0000","last_fullsized":"2024-05-03T22:14:44.001735+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:45:28.549187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290950+0000","last_change":"2024-05-03T22:12:36.014986+0000","last_active":"2024-05-03T22:14:38.290950+0000","last_peered":"2024-05-03T22:14:38.290950+0000","last_clean":"2024-05-03T22:14:38.290950+0000","last_became_active":"2024-05-03T22:12:36.014664+0000","last_became_peered":"2024-05-03T22:12:36.014664+0000","last_unstale":"2024-05-03T22:14:38.290950+0000","last_undegraded":"2024-05-03T22:14:38.290950+0000","last_fullsized":"2024-05-03T22:14:38.290950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:46:13.807806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291403+0000","last_change":"2024-05-03T22:12:52.126771+0000","last_active":"2024-05-03T22:14:38.291403+0000","last_peered":"2024-05-03T22:14:38.291403+0000","last_clean":"2024-05-03T22:14:38.291403+0000","last_became_active":"2024-05-03T22:12:52.126257+0000","last_became_peered":"2024-05-03T22:12:52.126257+0000","last_unstale":"2024-05-03T22:14:38.291403+0000","last_undegraded":"2024-05-03T22:14:38.291403+0000","last_fullsized":"2024-05-03T22:14:38.291403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:53:03.823305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283848+0000","last_change":"2024-05-03T22:12:31.981674+0000","last_active":"2024-05-03T22:14:38.283848+0000","last_peered":"2024-05-03T22:14:38.283848+0000","last_clean":"2024-05-03T22:14:38.283848+0000","last_became_active":"2024-05-03T22:12:31.976707+0000","last_became_peered":"2024-05-03T22:12:31.976707+0000","last_unstale":"2024-05-03T22:14:38.283848+0000","last_undegraded":"2024-05-03T22:14:38.283848+0000","last_fullsized":"2024-05-03T22:14:38.283848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:44:21.743865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.298489+0000","last_change":"2024-05-03T22:12:35.997309+0000","last_active":"2024-05-03T22:14:38.298489+0000","last_peered":"2024-05-03T22:14:38.298489+0000","last_clean":"2024-05-03T22:14:38.298489+0000","last_became_active":"2024-05-03T22:12:35.996879+0000","last_became_peered":"2024-05-03T22:12:35.996879+0000","last_unstale":"2024-05-03T22:14:38.298489+0000","last_undegraded":"2024-05-03T22:14:38.298489+0000","last_fullsized":"2024-05-03T22:14:38.298489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:01:25.009038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283813+0000","last_change":"2024-05-03T22:12:52.145503+0000","last_active":"2024-05-03T22:14:38.283813+0000","last_peered":"2024-05-03T22:14:38.283813+0000","last_clean":"2024-05-03T22:14:38.283813+0000","last_became_active":"2024-05-03T22:12:52.144719+0000","last_became_peered":"2024-05-03T22:12:52.144719+0000","last_unstale":"2024-05-03T22:14:38.283813+0000","last_undegraded":"2024-05-03T22:14:38.283813+0000","last_fullsized":"2024-05-03T22:14:38.283813+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:49:30.683367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.727869+0000","last_change":"2024-05-03T22:12:32.019228+0000","last_active":"2024-05-03T22:14:38.727869+0000","last_peered":"2024-05-03T22:14:38.727869+0000","last_clean":"2024-05-03T22:14:38.727869+0000","last_became_active":"2024-05-03T22:12:32.018648+0000","last_became_peered":"2024-05-03T22:12:32.018648+0000","last_unstale":"2024-05-03T22:14:38.727869+0000","last_undegraded":"2024-05-03T22:14:38.727869+0000","last_fullsized":"2024-05-03T22:14:38.727869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:21.695600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284715+0000","last_change":"2024-05-03T22:12:36.012712+0000","last_active":"2024-05-03T22:14:38.284715+0000","last_peered":"2024-05-03T22:14:38.284715+0000","last_clean":"2024-05-03T22:14:38.284715+0000","last_became_active":"2024-05-03T22:12:36.012278+0000","last_became_peered":"2024-05-03T22:12:36.012278+0000","last_unstale":"2024-05-03T22:14:38.284715+0000","last_undegraded":"2024-05-03T22:14:38.284715+0000","last_fullsized":"2024-05-03T22:14:38.284715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:16:21.511575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.284202+0000","last_change":"2024-05-03T22:12:52.145070+0000","last_active":"2024-05-03T22:14:38.284202+0000","last_peered":"2024-05-03T22:14:38.284202+0000","last_clean":"2024-05-03T22:14:38.284202+0000","last_became_active":"2024-05-03T22:12:52.144071+0000","last_became_peered":"2024-05-03T22:12:52.144071+0000","last_unstale":"2024-05-03T22:14:38.284202+0000","last_undegraded":"2024-05-03T22:14:38.284202+0000","last_fullsized":"2024-05-03T22:14:38.284202+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:44:12.696121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291762+0000","last_change":"2024-05-03T22:12:31.971569+0000","last_active":"2024-05-03T22:14:38.291762+0000","last_peered":"2024-05-03T22:14:38.291762+0000","last_clean":"2024-05-03T22:14:38.291762+0000","last_became_active":"2024-05-03T22:12:31.970883+0000","last_became_peered":"2024-05-03T22:12:31.970883+0000","last_unstale":"2024-05-03T22:14:38.291762+0000","last_undegraded":"2024-05-03T22:14:38.291762+0000","last_fullsized":"2024-05-03T22:14:38.291762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:12:50.629452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286477+0000","last_change":"2024-05-03T22:12:36.019209+0000","last_active":"2024-05-03T22:14:38.286477+0000","last_peered":"2024-05-03T22:14:38.286477+0000","last_clean":"2024-05-03T22:14:38.286477+0000","last_became_active":"2024-05-03T22:12:36.018887+0000","last_became_peered":"2024-05-03T22:12:36.018887+0000","last_unstale":"2024-05-03T22:14:38.286477+0000","last_undegraded":"2024-05-03T22:14:38.286477+0000","last_fullsized":"2024-05-03T22:14:38.286477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:29:36.775592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283462+0000","last_change":"2024-05-03T22:12:52.145179+0000","last_active":"2024-05-03T22:14:38.283462+0000","last_peered":"2024-05-03T22:14:38.283462+0000","last_clean":"2024-05-03T22:14:38.283462+0000","last_became_active":"2024-05-03T22:12:52.144344+0000","last_became_peered":"2024-05-03T22:12:52.144344+0000","last_unstale":"2024-05-03T22:14:38.283462+0000","last_undegraded":"2024-05-03T22:14:38.283462+0000","last_fullsized":"2024-05-03T22:14:38.283462+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:54:10.637934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.307151+0000","last_change":"2024-05-03T22:14:38.306297+0000","last_active":"2024-05-03T22:14:38.307151+0000","last_peered":"2024-05-03T22:14:38.307151+0000","last_clean":"2024-05-03T22:14:38.307151+0000","last_became_active":"2024-05-03T22:14:38.298089+0000","last_became_peered":"2024-05-03T22:14:38.298089+0000","last_unstale":"2024-05-03T22:14:38.307151+0000","last_undegraded":"2024-05-03T22:14:38.307151+0000","last_fullsized":"2024-05-03T22:14:38.307151+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:44.456436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291153+0000","last_change":"2024-05-03T22:12:36.002569+0000","last_active":"2024-05-03T22:14:38.291153+0000","last_peered":"2024-05-03T22:14:38.291153+0000","last_clean":"2024-05-03T22:14:38.291153+0000","last_became_active":"2024-05-03T22:12:36.002219+0000","last_became_peered":"2024-05-03T22:12:36.002219+0000","last_unstale":"2024-05-03T22:14:38.291153+0000","last_undegraded":"2024-05-03T22:14:38.291153+0000","last_fullsized":"2024-05-03T22:14:38.291153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:43:56.530139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.283470+0000","last_change":"2024-05-03T22:12:52.137365+0000","last_active":"2024-05-03T22:14:38.283470+0000","last_peered":"2024-05-03T22:14:38.283470+0000","last_clean":"2024-05-03T22:14:38.283470+0000","last_became_active":"2024-05-03T22:12:52.136695+0000","last_became_peered":"2024-05-03T22:12:52.136695+0000","last_unstale":"2024-05-03T22:14:38.283470+0000","last_undegraded":"2024-05-03T22:14:38.283470+0000","last_fullsized":"2024-05-03T22:14:38.283470+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:06:05.439487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.285151+0000","last_change":"2024-05-03T22:12:31.983289+0000","last_active":"2024-05-03T22:14:38.285151+0000","last_peered":"2024-05-03T22:14:38.285151+0000","last_clean":"2024-05-03T22:14:38.285151+0000","last_became_active":"2024-05-03T22:12:31.982873+0000","last_became_peered":"2024-05-03T22:12:31.982873+0000","last_unstale":"2024-05-03T22:14:38.285151+0000","last_undegraded":"2024-05-03T22:14:38.285151+0000","last_fullsized":"2024-05-03T22:14:38.285151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:50.973960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289190+0000","last_change":"2024-05-03T22:12:36.025173+0000","last_active":"2024-05-03T22:14:38.289190+0000","last_peered":"2024-05-03T22:14:38.289190+0000","last_clean":"2024-05-03T22:14:38.289190+0000","last_became_active":"2024-05-03T22:12:36.021875+0000","last_became_peered":"2024-05-03T22:12:36.021875+0000","last_unstale":"2024-05-03T22:14:38.289190+0000","last_undegraded":"2024-05-03T22:14:38.289190+0000","last_fullsized":"2024-05-03T22:14:38.289190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:05:15.963921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728021+0000","last_change":"2024-05-03T22:12:52.132608+0000","last_active":"2024-05-03T22:14:38.728021+0000","last_peered":"2024-05-03T22:14:38.728021+0000","last_clean":"2024-05-03T22:14:38.728021+0000","last_became_active":"2024-05-03T22:12:52.132115+0000","last_became_peered":"2024-05-03T22:12:52.132115+0000","last_unstale":"2024-05-03T22:14:38.728021+0000","last_undegraded":"2024-05-03T22:14:38.728021+0000","last_fullsized":"2024-05-03T22:14:38.728021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:01:30.571145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":187,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:16:19.533645+0000","last_change":"2024-05-03T22:12:32.021562+0000","last_active":"2024-05-03T22:16:19.533645+0000","last_peered":"2024-05-03T22:16:19.533645+0000","last_clean":"2024-05-03T22:16:19.533645+0000","last_became_active":"2024-05-03T22:12:32.020913+0000","last_became_peered":"2024-05-03T22:12:32.020913+0000","last_unstale":"2024-05-03T22:16:19.533645+0000","last_undegraded":"2024-05-03T22:16:19.533645+0000","last_fullsized":"2024-05-03T22:16:19.533645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:02:37.549388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289417+0000","last_change":"2024-05-03T22:12:36.019237+0000","last_active":"2024-05-03T22:14:38.289417+0000","last_peered":"2024-05-03T22:14:38.289417+0000","last_clean":"2024-05-03T22:14:38.289417+0000","last_became_active":"2024-05-03T22:12:36.018411+0000","last_became_peered":"2024-05-03T22:12:36.018411+0000","last_unstale":"2024-05-03T22:14:38.289417+0000","last_undegraded":"2024-05-03T22:14:38.289417+0000","last_fullsized":"2024-05-03T22:14:38.289417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:45:59.701403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297080+0000","last_change":"2024-05-03T22:12:52.146882+0000","last_active":"2024-05-03T22:14:38.297080+0000","last_peered":"2024-05-03T22:14:38.297080+0000","last_clean":"2024-05-03T22:14:38.297080+0000","last_became_active":"2024-05-03T22:12:52.146316+0000","last_became_peered":"2024-05-03T22:12:52.146316+0000","last_unstale":"2024-05-03T22:14:38.297080+0000","last_undegraded":"2024-05-03T22:14:38.297080+0000","last_fullsized":"2024-05-03T22:14:38.297080+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:01:03.443777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.038508+0000","last_change":"2024-05-03T22:12:31.983036+0000","last_active":"2024-05-03T22:14:39.038508+0000","last_peered":"2024-05-03T22:14:39.038508+0000","last_clean":"2024-05-03T22:14:39.038508+0000","last_became_active":"2024-05-03T22:12:31.979875+0000","last_became_peered":"2024-05-03T22:12:31.979875+0000","last_unstale":"2024-05-03T22:14:39.038508+0000","last_undegraded":"2024-05-03T22:14:39.038508+0000","last_fullsized":"2024-05-03T22:14:39.038508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:26:56.227766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288821+0000","last_change":"2024-05-03T22:13:37.972323+0000","last_active":"2024-05-03T22:14:38.288821+0000","last_peered":"2024-05-03T22:14:38.288821+0000","last_clean":"2024-05-03T22:14:38.288821+0000","last_became_active":"2024-05-03T22:13:37.971207+0000","last_became_peered":"2024-05-03T22:13:37.971207+0000","last_unstale":"2024-05-03T22:14:38.288821+0000","last_undegraded":"2024-05-03T22:14:38.288821+0000","last_fullsized":"2024-05-03T22:14:38.288821+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:49.939213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037078+0000","last_change":"2024-05-03T22:12:52.125489+0000","last_active":"2024-05-03T22:14:39.037078+0000","last_peered":"2024-05-03T22:14:39.037078+0000","last_clean":"2024-05-03T22:14:39.037078+0000","last_became_active":"2024-05-03T22:12:52.124767+0000","last_became_peered":"2024-05-03T22:12:52.124767+0000","last_unstale":"2024-05-03T22:14:39.037078+0000","last_undegraded":"2024-05-03T22:14:39.037078+0000","last_fullsized":"2024-05-03T22:14:39.037078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:51.073278+0000","last_clean_scrub_stamp":"2024-05-03T22:12:51.073278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:47:29.027353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":62,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.312346+0000","last_change":"2024-05-03T22:14:38.311637+0000","last_active":"2024-05-03T22:14:38.312346+0000","last_peered":"2024-05-03T22:14:38.312346+0000","last_clean":"2024-05-03T22:14:38.312346+0000","last_became_active":"2024-05-03T22:14:38.299881+0000","last_became_peered":"2024-05-03T22:14:38.299881+0000","last_unstale":"2024-05-03T22:14:38.312346+0000","last_undegraded":"2024-05-03T22:14:38.312346+0000","last_fullsized":"2024-05-03T22:14:38.312346+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:30.943030+0000","last_clean_scrub_stamp":"2024-05-03T22:12:30.943030+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:51:27.491122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289597+0000","last_change":"2024-05-03T22:12:36.015753+0000","last_active":"2024-05-03T22:14:38.289597+0000","last_peered":"2024-05-03T22:14:38.289597+0000","last_clean":"2024-05-03T22:14:38.289597+0000","last_became_active":"2024-05-03T22:12:36.011569+0000","last_became_peered":"2024-05-03T22:12:36.011569+0000","last_unstale":"2024-05-03T22:14:38.289597+0000","last_undegraded":"2024-05-03T22:14:38.289597+0000","last_fullsized":"2024-05-03T22:14:38.289597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:30:48.897252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.286581+0000","last_change":"2024-05-03T22:12:36.017738+0000","last_active":"2024-05-03T22:14:38.286581+0000","last_peered":"2024-05-03T22:14:38.286581+0000","last_clean":"2024-05-03T22:14:38.286581+0000","last_became_active":"2024-05-03T22:12:36.017293+0000","last_became_peered":"2024-05-03T22:12:36.017293+0000","last_unstale":"2024-05-03T22:14:38.286581+0000","last_undegraded":"2024-05-03T22:14:38.286581+0000","last_fullsized":"2024-05-03T22:14:38.286581+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:20:35.141892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291607+0000","last_change":"2024-05-03T22:13:37.911165+0000","last_active":"2024-05-03T22:14:38.291607+0000","last_peered":"2024-05-03T22:14:38.291607+0000","last_clean":"2024-05-03T22:14:38.291607+0000","last_became_active":"2024-05-03T22:13:37.910476+0000","last_became_peered":"2024-05-03T22:13:37.910476+0000","last_unstale":"2024-05-03T22:14:38.291607+0000","last_undegraded":"2024-05-03T22:14:38.291607+0000","last_fullsized":"2024-05-03T22:14:38.291607+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:07.195308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.290909+0000","last_change":"2024-05-03T22:12:36.001119+0000","last_active":"2024-05-03T22:14:38.290909+0000","last_peered":"2024-05-03T22:14:38.290909+0000","last_clean":"2024-05-03T22:14:38.290909+0000","last_became_active":"2024-05-03T22:12:36.000728+0000","last_became_peered":"2024-05-03T22:12:36.000728+0000","last_unstale":"2024-05-03T22:14:38.290909+0000","last_undegraded":"2024-05-03T22:14:38.290909+0000","last_fullsized":"2024-05-03T22:14:38.290909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:02:29.413354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.297854+0000","last_change":"2024-05-03T22:12:36.004256+0000","last_active":"2024-05-03T22:14:38.297854+0000","last_peered":"2024-05-03T22:14:38.297854+0000","last_clean":"2024-05-03T22:14:38.297854+0000","last_became_active":"2024-05-03T22:12:36.004002+0000","last_became_peered":"2024-05-03T22:12:36.004002+0000","last_unstale":"2024-05-03T22:14:38.297854+0000","last_undegraded":"2024-05-03T22:14:38.297854+0000","last_fullsized":"2024-05-03T22:14:38.297854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:50:55.748069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.289338+0000","last_change":"2024-05-03T22:12:36.006160+0000","last_active":"2024-05-03T22:14:38.289338+0000","last_peered":"2024-05-03T22:14:38.289338+0000","last_clean":"2024-05-03T22:14:38.289338+0000","last_became_active":"2024-05-03T22:12:36.001061+0000","last_became_peered":"2024-05-03T22:12:36.001061+0000","last_unstale":"2024-05-03T22:14:38.289338+0000","last_undegraded":"2024-05-03T22:14:38.289338+0000","last_fullsized":"2024-05-03T22:14:38.289338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:49:32.033970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.287681+0000","last_change":"2024-05-03T22:13:37.974073+0000","last_active":"2024-05-03T22:14:38.287681+0000","last_peered":"2024-05-03T22:14:38.287681+0000","last_clean":"2024-05-03T22:14:38.287681+0000","last_became_active":"2024-05-03T22:13:37.973009+0000","last_became_peered":"2024-05-03T22:13:37.973009+0000","last_unstale":"2024-05-03T22:14:38.287681+0000","last_undegraded":"2024-05-03T22:14:38.287681+0000","last_fullsized":"2024-05-03T22:14:38.287681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:00:37.511026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291431+0000","last_change":"2024-05-03T22:12:36.014463+0000","last_active":"2024-05-03T22:14:38.291431+0000","last_peered":"2024-05-03T22:14:38.291431+0000","last_clean":"2024-05-03T22:14:38.291431+0000","last_became_active":"2024-05-03T22:12:36.014130+0000","last_became_peered":"2024-05-03T22:12:36.014130+0000","last_unstale":"2024-05-03T22:14:38.291431+0000","last_undegraded":"2024-05-03T22:14:38.291431+0000","last_fullsized":"2024-05-03T22:14:38.291431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:44:28.681255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291878+0000","last_change":"2024-05-03T22:12:36.000528+0000","last_active":"2024-05-03T22:14:38.291878+0000","last_peered":"2024-05-03T22:14:38.291878+0000","last_clean":"2024-05-03T22:14:38.291878+0000","last_became_active":"2024-05-03T22:12:35.999985+0000","last_became_peered":"2024-05-03T22:12:35.999985+0000","last_unstale":"2024-05-03T22:14:38.291878+0000","last_undegraded":"2024-05-03T22:14:38.291878+0000","last_fullsized":"2024-05-03T22:14:38.291878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:36:13.835098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:39.037474+0000","last_change":"2024-05-03T22:12:36.010009+0000","last_active":"2024-05-03T22:14:39.037474+0000","last_peered":"2024-05-03T22:14:39.037474+0000","last_clean":"2024-05-03T22:14:39.037474+0000","last_became_active":"2024-05-03T22:12:36.009139+0000","last_became_peered":"2024-05-03T22:12:36.009139+0000","last_unstale":"2024-05-03T22:14:39.037474+0000","last_undegraded":"2024-05-03T22:14:39.037474+0000","last_fullsized":"2024-05-03T22:14:39.037474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:59.111774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.291850+0000","last_change":"2024-05-03T22:12:36.015949+0000","last_active":"2024-05-03T22:14:38.291850+0000","last_peered":"2024-05-03T22:14:38.291850+0000","last_clean":"2024-05-03T22:14:38.291850+0000","last_became_active":"2024-05-03T22:12:36.015597+0000","last_became_peered":"2024-05-03T22:12:36.015597+0000","last_unstale":"2024-05-03T22:14:38.291850+0000","last_undegraded":"2024-05-03T22:14:38.291850+0000","last_fullsized":"2024-05-03T22:14:38.291850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:24:29.855732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.728220+0000","last_change":"2024-05-03T22:12:36.013462+0000","last_active":"2024-05-03T22:14:38.728220+0000","last_peered":"2024-05-03T22:14:38.728220+0000","last_clean":"2024-05-03T22:14:38.728220+0000","last_became_active":"2024-05-03T22:12:36.012664+0000","last_became_peered":"2024-05-03T22:12:36.012664+0000","last_unstale":"2024-05-03T22:14:38.728220+0000","last_undegraded":"2024-05-03T22:14:38.728220+0000","last_fullsized":"2024-05-03T22:14:38.728220+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:28:53.979742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288879+0000","last_change":"2024-05-03T22:12:36.010367+0000","last_active":"2024-05-03T22:14:38.288879+0000","last_peered":"2024-05-03T22:14:38.288879+0000","last_clean":"2024-05-03T22:14:38.288879+0000","last_became_active":"2024-05-03T22:12:36.009968+0000","last_became_peered":"2024-05-03T22:12:36.009968+0000","last_unstale":"2024-05-03T22:14:38.288879+0000","last_undegraded":"2024-05-03T22:14:38.288879+0000","last_fullsized":"2024-05-03T22:14:38.288879+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:34:48.542080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-03T22:14:38.288982+0000","last_change":"2024-05-03T22:12:36.023670+0000","last_active":"2024-05-03T22:14:38.288982+0000","last_peered":"2024-05-03T22:14:38.288982+0000","last_clean":"2024-05-03T22:14:38.288982+0000","last_became_active":"2024-05-03T22:12:36.022774+0000","last_became_peered":"2024-05-03T22:12:36.022774+0000","last_unstale":"2024-05-03T22:14:38.288982+0000","last_undegraded":"2024-05-03T22:14:38.288982+0000","last_fullsized":"2024-05-03T22:14:38.288982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:12:34.955948+0000","last_clean_scrub_stamp":"2024-05-03T22:12:34.955948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:33:05.929349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65155,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1380,"num_read_kb":755,"num_write":249,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":195465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612672,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":530005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808905,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32892,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712260,"statfs":{"total":95995035648,"available":95961354240,"internally_reserved":0,"allocated":1753088,"data_stored":1174660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005134,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":533919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201367,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1069056,"data_stored":529417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397598,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32824,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712328,"statfs":{"total":95995035648,"available":95961423872,"internally_reserved":0,"allocated":1683456,"data_stored":1127089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561125,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":525718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1134592,"data_stored":585371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738511,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":526783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411458,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1146880,"data_stored":584919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149819,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":525035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953588,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":529401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757356,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32832,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712320,"statfs":{"total":95995035648,"available":95961415680,"internally_reserved":0,"allocated":1691648,"data_stored":1122280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T22:16:24.928 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-03T22:16:24.928 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-03T22:16:24.929 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-03T22:16:24.929 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-03T22:16:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:16:25.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:25 smithi116 ceph-mon[31828]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:16:25.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:25 smithi082 ceph-mon[28404]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:16:25.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:25 smithi130 ceph-mon[32417]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:16:26.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:26 smithi082 ceph-mon[28404]: pgmap v496: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:16:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:26 smithi116 ceph-mon[31828]: pgmap v496: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:16:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:26 smithi130 ceph-mon[32417]: pgmap v496: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:16:28.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.089+0000 7f7dda000700 1 -- 172.21.15.82:0/1526885878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd40782f0 msgr2=0x7f7dd4113d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:28.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.089+0000 7f7dda000700 1 --2- 172.21.15.82:0/1526885878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd40782f0 0x7f7dd4113d10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009990 tx=0x7f7dc4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:16:28.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.089+0000 7f7dda000700 1 -- 172.21.15.82:0/1526885878 shutdown_connections 2024-05-03T22:16:28.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.089+0000 7f7dda000700 1 --2- 172.21.15.82:0/1526885878 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd4114250 0x7f7dd4116640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:28.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.089+0000 7f7dda000700 1 --2- 172.21.15.82:0/1526885878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7dd40779d0 0x7f7dd4077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:28.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.089+0000 7f7dda000700 1 --2- 172.21.15.82:0/1526885878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd40782f0 0x7f7dd4113d10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:28.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.089+0000 7f7dda000700 1 -- 172.21.15.82:0/1526885878 >> 172.21.15.82:0/1526885878 conn(0x7f7dd41010e0 msgr2=0x7f7dd4103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:28.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.089+0000 7f7dda000700 1 -- 172.21.15.82:0/1526885878 shutdown_connections 2024-05-03T22:16:28.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.089+0000 7f7dda000700 1 -- 172.21.15.82:0/1526885878 wait complete. 2024-05-03T22:16:28.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.090+0000 7f7dda000700 1 Processor -- start 2024-05-03T22:16:28.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.090+0000 7f7dda000700 1 -- start start 2024-05-03T22:16:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.091+0000 7f7dda000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd40779d0 0x7f7dd41a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.091+0000 7f7dda000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd40782f0 0x7f7dd41a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.091+0000 7f7dda000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7dd4114250 0x7f7dd41a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.091+0000 7f7dda000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4119ae0 con 0x7f7dd40779d0 2024-05-03T22:16:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.091+0000 7f7dda000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4119960 con 0x7f7dd40782f0 2024-05-03T22:16:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.091+0000 7f7dda000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4119c60 con 0x7f7dd4114250 2024-05-03T22:16:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.091+0000 7f7dd8c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd40779d0 0x7f7dd41a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.091+0000 7f7dd8c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd40779d0 0x7f7dd41a0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54446/0 (socket says 172.21.15.82:54446) 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.091+0000 7f7dd8c00700 1 -- 172.21.15.82:0/3246993003 learned_addr learned my addr 172.21.15.82:0/3246993003 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dd3e00700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd40782f0 0x7f7dd41a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dd8c00700 1 -- 172.21.15.82:0/3246993003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7dd4114250 msgr2=0x7f7dd41a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dd8c00700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7dd4114250 0x7f7dd41a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dd8c00700 1 -- 172.21.15.82:0/3246993003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd40782f0 msgr2=0x7f7dd41a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dd8c00700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd40782f0 0x7f7dd41a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dd8c00700 1 -- 172.21.15.82:0/3246993003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd41a5060 con 0x7f7dd40779d0 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dd8c00700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd40779d0 0x7f7dd41a0050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800d980 tx=0x7f7dc800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dd1600700 1 -- 172.21.15.82:0/3246993003 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8017070 con 0x7f7dd40779d0 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dda000700 1 -- 172.21.15.82:0/3246993003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd41a5350 con 0x7f7dd40779d0 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dd1600700 1 -- 172.21.15.82:0/3246993003 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7dc8004830 con 0x7f7dd40779d0 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dd1600700 1 -- 172.21.15.82:0/3246993003 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80053a0 con 0x7f7dd40779d0 2024-05-03T22:16:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.092+0000 7f7dda000700 1 -- 172.21.15.82:0/3246993003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd41acbd0 con 0x7f7dd40779d0 2024-05-03T22:16:28.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.094+0000 7f7dda000700 1 -- 172.21.15.82:0/3246993003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd406a190 con 0x7f7dd40779d0 2024-05-03T22:16:28.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.096+0000 7f7dd1600700 1 -- 172.21.15.82:0/3246993003 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7dc80049e0 con 0x7f7dd40779d0 2024-05-03T22:16:28.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.098+0000 7f7dd1600700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7dbc0b2990 0x7f7dbc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:28.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.099+0000 7f7dd1600700 1 -- 172.21.15.82:0/3246993003 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f7dc80e2ae0 con 0x7f7dd40779d0 2024-05-03T22:16:28.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.099+0000 7f7dd3e00700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7dbc0b2990 0x7f7dbc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:28.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.099+0000 7f7dd3e00700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7dbc0b2990 0x7f7dbc0b4e50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4005f50 tx=0x7f7dc4005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:28.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.101+0000 7f7dd1600700 1 -- 172.21.15.82:0/3246993003 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7dc8020020 con 0x7f7dd40779d0 2024-05-03T22:16:28.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.391+0000 7f7dda000700 1 -- 172.21.15.82:0/3246993003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7dd402e510 con 0x7f7dd40779d0 2024-05-03T22:16:28.393 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:28 smithi082 ceph-mon[28404]: pgmap v497: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:16:28.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.392+0000 7f7dd1600700 1 -- 172.21.15.82:0/3246993003 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7dc80aa300 con 0x7f7dd40779d0 2024-05-03T22:16:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:16:28.394 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-03T22:16:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.396+0000 7f7dda000700 1 -- 172.21.15.82:0/3246993003 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7dbc0b2990 msgr2=0x7f7dbc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.396+0000 7f7dda000700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7dbc0b2990 0x7f7dbc0b4e50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4005f50 tx=0x7f7dc4005e80 comp rx=0 tx=0).stop 2024-05-03T22:16:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.397+0000 7f7dda000700 1 -- 172.21.15.82:0/3246993003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd40779d0 msgr2=0x7f7dd41a0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.397+0000 7f7dda000700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd40779d0 0x7f7dd41a0050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800d980 tx=0x7f7dc800dd40 comp rx=0 tx=0).stop 2024-05-03T22:16:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.397+0000 7f7dda000700 1 -- 172.21.15.82:0/3246993003 shutdown_connections 2024-05-03T22:16:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.397+0000 7f7dda000700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f7dbc0b2990 0x7f7dbc0b4e50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.397+0000 7f7dda000700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd40779d0 0x7f7dd41a0050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.397+0000 7f7dda000700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7dd4114250 0x7f7dd41a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.397+0000 7f7dda000700 1 --2- 172.21.15.82:0/3246993003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd40782f0 0x7f7dd41a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.397+0000 7f7dda000700 1 -- 172.21.15.82:0/3246993003 >> 172.21.15.82:0/3246993003 conn(0x7f7dd41010e0 msgr2=0x7f7dd41034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:28.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.397+0000 7f7dda000700 1 -- 172.21.15.82:0/3246993003 shutdown_connections 2024-05-03T22:16:28.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:28.397+0000 7f7dda000700 1 -- 172.21.15.82:0/3246993003 wait complete. 2024-05-03T22:16:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:28 smithi116 ceph-mon[31828]: pgmap v497: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:16:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:28 smithi130 ceph-mon[32417]: pgmap v497: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:16:29.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:29 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3246993003' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-03T22:16:29.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:29 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3246993003' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-03T22:16:29.450 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-03T22:16:29.450 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:16:29.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:29 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3246993003' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-03T22:16:29.907 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:16:30.336 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:30 smithi082 ceph-mon[28404]: pgmap v498: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:16:30.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:30 smithi116 ceph-mon[31828]: pgmap v498: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:16:30.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:30 smithi130 ceph-mon[32417]: pgmap v498: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:16:32.315 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:32 smithi082 ceph-mon[28404]: pgmap v499: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:16:32.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:32 smithi116 ceph-mon[31828]: pgmap v499: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:16:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:32 smithi130 ceph-mon[32417]: pgmap v499: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:16:32.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.608+0000 7fc840e00700 1 -- 172.21.15.82:0/2809290538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c105ee0 msgr2=0x7fc83c106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:32.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.608+0000 7fc840e00700 1 --2- 172.21.15.82:0/2809290538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c105ee0 0x7fc83c106370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc83400b0a0 tx=0x7fc83400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:16:32.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.608+0000 7fc840e00700 1 -- 172.21.15.82:0/2809290538 shutdown_connections 2024-05-03T22:16:32.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.608+0000 7fc840e00700 1 --2- 172.21.15.82:0/2809290538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c105ee0 0x7fc83c106370 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:32.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.608+0000 7fc840e00700 1 --2- 172.21.15.82:0/2809290538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc83c1083d0 0x7fc83c06b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:32.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.608+0000 7fc840e00700 1 --2- 172.21.15.82:0/2809290538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc83c06b6f0 0x7fc83c06bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:32.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.608+0000 7fc840e00700 1 -- 172.21.15.82:0/2809290538 >> 172.21.15.82:0/2809290538 conn(0x7fc83c079350 msgr2=0x7fc83c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.608+0000 7fc840e00700 1 -- 172.21.15.82:0/2809290538 shutdown_connections 2024-05-03T22:16:32.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.609+0000 7fc840e00700 1 -- 172.21.15.82:0/2809290538 wait complete. 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.610+0000 7fc840e00700 1 Processor -- start 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.610+0000 7fc840e00700 1 -- start start 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.610+0000 7fc840e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c06b6f0 0x7fc83c1a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.610+0000 7fc840e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc83c105ee0 0x7fc83c1a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.610+0000 7fc840e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc83c1083d0 0x7fc83c1a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.610+0000 7fc840e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c119b20 con 0x7fc83c06b6f0 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.610+0000 7fc840e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c1199a0 con 0x7fc83c105ee0 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.610+0000 7fc840e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c119ca0 con 0x7fc83c1083d0 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc839e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c06b6f0 0x7fc83c1a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc839e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c06b6f0 0x7fc83c1a0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54464/0 (socket says 172.21.15.82:54464) 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc839e00700 1 -- 172.21.15.82:0/1655427300 learned_addr learned my addr 172.21.15.82:0/1655427300 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:32.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc839400700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc83c105ee0 0x7fc83c1a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc83a800700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc83c1083d0 0x7fc83c1a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc839e00700 1 -- 172.21.15.82:0/1655427300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc83c1083d0 msgr2=0x7fc83c1a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc839e00700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc83c1083d0 0x7fc83c1a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc839e00700 1 -- 172.21.15.82:0/1655427300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc83c105ee0 msgr2=0x7fc83c1a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc839e00700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc83c105ee0 0x7fc83c1a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc839e00700 1 -- 172.21.15.82:0/1655427300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c1a5020 con 0x7fc83c06b6f0 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc839400700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc83c105ee0 0x7fc83c1a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc83a800700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc83c1083d0 0x7fc83c1a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.611+0000 7fc839e00700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c06b6f0 0x7fc83c1a0010 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00d980 tx=0x7fc82c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.612+0000 7fc832a00700 1 -- 172.21.15.82:0/1655427300 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c017070 con 0x7fc83c06b6f0 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.612+0000 7fc832a00700 1 -- 172.21.15.82:0/1655427300 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc82c004830 con 0x7fc83c06b6f0 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.612+0000 7fc840e00700 1 -- 172.21.15.82:0/1655427300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc83c1a52b0 con 0x7fc83c06b6f0 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.612+0000 7fc832a00700 1 -- 172.21.15.82:0/1655427300 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0053a0 con 0x7fc83c06b6f0 2024-05-03T22:16:32.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.612+0000 7fc840e00700 1 -- 172.21.15.82:0/1655427300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83c1acb90 con 0x7fc83c06b6f0 2024-05-03T22:16:32.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.613+0000 7fc840e00700 1 -- 172.21.15.82:0/1655427300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc83c06a190 con 0x7fc83c06b6f0 2024-05-03T22:16:32.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.615+0000 7fc832a00700 1 -- 172.21.15.82:0/1655427300 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc82c0049e0 con 0x7fc83c06b6f0 2024-05-03T22:16:32.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.617+0000 7fc832a00700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8200b2910 0x7fc8200b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:32.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.617+0000 7fc832a00700 1 -- 172.21.15.82:0/1655427300 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fc82c0e2700 con 0x7fc83c06b6f0 2024-05-03T22:16:32.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.617+0000 7fc839400700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8200b2910 0x7fc8200b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:32.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.618+0000 7fc839400700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8200b2910 0x7fc8200b4dd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc83c079aa0 tx=0x7fc82400b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:32.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.621+0000 7fc832a00700 1 -- 172.21.15.82:0/1655427300 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc82c020020 con 0x7fc83c06b6f0 2024-05-03T22:16:32.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.903+0000 7fc840e00700 1 -- 172.21.15.82:0/1655427300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc83c1acd60 con 0x7fc83c06b6f0 2024-05-03T22:16:32.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.905+0000 7fc832a00700 1 -- 172.21.15.82:0/1655427300 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fc82c0a9ea0 con 0x7fc83c06b6f0 2024-05-03T22:16:32.907 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:16:32.907 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:12:39.270198+0000","modified":"2024-05-03T22:14:10.244210+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34460,"mds_1":34433,"mds_2":34412,"mds_3":34403,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":40,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34412":{"gid":34412,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6839/3254019270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3254019270},{"type":"v1","addr":"172.21.15.116:6839","nonce":3254019270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34460,"qdb_cluster":[24469,34403,34460,34433,34412]},"id":1}]} 2024-05-03T22:16:32.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 -- 172.21.15.82:0/1655427300 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8200b2910 msgr2=0x7fc8200b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:32.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8200b2910 0x7fc8200b4dd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc83c079aa0 tx=0x7fc82400b2c0 comp rx=0 tx=0).stop 2024-05-03T22:16:32.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 -- 172.21.15.82:0/1655427300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c06b6f0 msgr2=0x7fc83c1a0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:32.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c06b6f0 0x7fc83c1a0010 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00d980 tx=0x7fc82c00dd40 comp rx=0 tx=0).stop 2024-05-03T22:16:32.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 -- 172.21.15.82:0/1655427300 shutdown_connections 2024-05-03T22:16:32.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc8200b2910 0x7fc8200b4dd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:32.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83c06b6f0 0x7fc83c1a0010 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:32.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc83c1083d0 0x7fc83c1a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:32.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 --2- 172.21.15.82:0/1655427300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc83c105ee0 0x7fc83c1a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:32.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 -- 172.21.15.82:0/1655427300 >> 172.21.15.82:0/1655427300 conn(0x7fc83c079350 msgr2=0x7fc83c104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:32.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 -- 172.21.15.82:0/1655427300 shutdown_connections 2024-05-03T22:16:32.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:32.908+0000 7fc840e00700 1 -- 172.21.15.82:0/1655427300 wait complete. 2024-05-03T22:16:32.911 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-05-03T22:16:33.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:33 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1655427300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:16:33.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:33 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1655427300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:16:33.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:33 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1655427300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:16:33.954 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:16:34.418 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:34 smithi082 ceph-mon[28404]: pgmap v500: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:34.430 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:16:34.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:34 smithi116 ceph-mon[31828]: pgmap v500: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:34 smithi130 ceph-mon[32417]: pgmap v500: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:36.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:36 smithi082 ceph-mon[28404]: pgmap v501: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:36.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:36 smithi116 ceph-mon[31828]: pgmap v501: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:36.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:36 smithi130 ceph-mon[32417]: pgmap v501: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.876+0000 7f1f52600700 1 -- 172.21.15.82:0/3090487431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c1056c0 msgr2=0x7f1f4c105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.876+0000 7f1f52600700 1 --2- 172.21.15.82:0/3090487431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c1056c0 0x7f1f4c105b40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009990 tx=0x7f1f38009ca0 comp rx=0 tx=0).stop 2024-05-03T22:16:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.876+0000 7f1f52600700 1 -- 172.21.15.82:0/3090487431 shutdown_connections 2024-05-03T22:16:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.876+0000 7f1f52600700 1 --2- 172.21.15.82:0/3090487431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f4c106080 0x7f1f4c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.876+0000 7f1f52600700 1 --2- 172.21.15.82:0/3090487431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f4c10b6c0 0x7f1f4c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.876+0000 7f1f52600700 1 --2- 172.21.15.82:0/3090487431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c1056c0 0x7f1f4c105b40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.876+0000 7f1f52600700 1 -- 172.21.15.82:0/3090487431 >> 172.21.15.82:0/3090487431 conn(0x7f1f4c1011b0 msgr2=0x7f1f4c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.876+0000 7f1f52600700 1 -- 172.21.15.82:0/3090487431 shutdown_connections 2024-05-03T22:16:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.876+0000 7f1f52600700 1 -- 172.21.15.82:0/3090487431 wait complete. 2024-05-03T22:16:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.877+0000 7f1f52600700 1 Processor -- start 2024-05-03T22:16:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.877+0000 7f1f52600700 1 -- start start 2024-05-03T22:16:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.878+0000 7f1f52600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c1056c0 0x7f1f4c1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.878+0000 7f1f52600700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f4c106080 0x7f1f4c1a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.878+0000 7f1f52600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f4c10b6c0 0x7f1f4c19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.878+0000 7f1f52600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c1157b0 con 0x7f1f4c1056c0 2024-05-03T22:16:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.878+0000 7f1f52600700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c115630 con 0x7f1f4c106080 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.878+0000 7f1f52600700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c115930 con 0x7f1f4c10b6c0 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.878+0000 7f1f4b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c1056c0 0x7f1f4c1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.878+0000 7f1f4b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c1056c0 0x7f1f4c1a18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51746/0 (socket says 172.21.15.82:51746) 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.878+0000 7f1f4b400700 1 -- 172.21.15.82:0/1565079599 learned_addr learned my addr 172.21.15.82:0/1565079599 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f4be00700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f4c10b6c0 0x7f1f4c19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f4aa00700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f4c106080 0x7f1f4c1a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f4b400700 1 -- 172.21.15.82:0/1565079599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f4c10b6c0 msgr2=0x7f1f4c19bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f4b400700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f4c10b6c0 0x7f1f4c19bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f4b400700 1 -- 172.21.15.82:0/1565079599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f4c106080 msgr2=0x7f1f4c1a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f4b400700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f4c106080 0x7f1f4c1a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f4b400700 1 -- 172.21.15.82:0/1565079599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c19c210 con 0x7f1f4c1056c0 2024-05-03T22:16:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f4aa00700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f4c106080 0x7f1f4c1a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f4b400700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c1056c0 0x7f1f4c1a18f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00d950 tx=0x7f1f3c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f43e00700 1 -- 172.21.15.82:0/1565079599 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c016070 con 0x7f1f4c1056c0 2024-05-03T22:16:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f43e00700 1 -- 172.21.15.82:0/1565079599 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f3c010460 con 0x7f1f4c1056c0 2024-05-03T22:16:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f52600700 1 -- 172.21.15.82:0/1565079599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f4c19c500 con 0x7f1f4c1056c0 2024-05-03T22:16:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.879+0000 7f1f43e00700 1 -- 172.21.15.82:0/1565079599 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00f620 con 0x7f1f4c1056c0 2024-05-03T22:16:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.880+0000 7f1f52600700 1 -- 172.21.15.82:0/1565079599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f4c1a87c0 con 0x7f1f4c1056c0 2024-05-03T22:16:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.882+0000 7f1f52600700 1 -- 172.21.15.82:0/1565079599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f4c06a190 con 0x7f1f4c1056c0 2024-05-03T22:16:36.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.883+0000 7f1f43e00700 1 -- 172.21.15.82:0/1565079599 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1f3c019070 con 0x7f1f4c1056c0 2024-05-03T22:16:36.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.886+0000 7f1f43e00700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1f300b2910 0x7f1f300b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:36.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.886+0000 7f1f43e00700 1 -- 172.21.15.82:0/1565079599 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f1f3c0e1d90 con 0x7f1f4c1056c0 2024-05-03T22:16:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.886+0000 7f1f4aa00700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1f300b2910 0x7f1f300b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.887+0000 7f1f4aa00700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1f300b2910 0x7f1f300b4dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1f38000c00 tx=0x7f1f38005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:36.891+0000 7f1f43e00700 1 -- 172.21.15.82:0/1565079599 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1f3c0a9530 con 0x7f1f4c1056c0 2024-05-03T22:16:37.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.177+0000 7f1f52600700 1 -- 172.21.15.82:0/1565079599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f4c02e510 con 0x7f1f4c1056c0 2024-05-03T22:16:37.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.179+0000 7f1f43e00700 1 -- 172.21.15.82:0/1565079599 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f1f3c0a8e30 con 0x7f1f4c1056c0 2024-05-03T22:16:37.181 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:16:37.181 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:12:39.270198+0000","modified":"2024-05-03T22:14:10.244210+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34460,"mds_1":34433,"mds_2":34412,"mds_3":34403,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":40,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34412":{"gid":34412,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6839/3254019270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3254019270},{"type":"v1","addr":"172.21.15.116:6839","nonce":3254019270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34460,"qdb_cluster":[24469,34403,34460,34433,34412]},"id":1}]} 2024-05-03T22:16:37.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 -- 172.21.15.82:0/1565079599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1f300b2910 msgr2=0x7f1f300b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:37.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1f300b2910 0x7f1f300b4dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1f38000c00 tx=0x7f1f38005fb0 comp rx=0 tx=0).stop 2024-05-03T22:16:37.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 -- 172.21.15.82:0/1565079599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c1056c0 msgr2=0x7f1f4c1a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:37.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c1056c0 0x7f1f4c1a18f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00d950 tx=0x7f1f3c00dd10 comp rx=0 tx=0).stop 2024-05-03T22:16:37.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 -- 172.21.15.82:0/1565079599 shutdown_connections 2024-05-03T22:16:37.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f1f300b2910 0x7f1f300b4dd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:37.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4c1056c0 0x7f1f4c1a18f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:37.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f4c10b6c0 0x7f1f4c19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:37.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 --2- 172.21.15.82:0/1565079599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f4c106080 0x7f1f4c1a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:37.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 -- 172.21.15.82:0/1565079599 >> 172.21.15.82:0/1565079599 conn(0x7f1f4c1011b0 msgr2=0x7f1f4c101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:37.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 -- 172.21.15.82:0/1565079599 shutdown_connections 2024-05-03T22:16:37.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:37.182+0000 7f1f52600700 1 -- 172.21.15.82:0/1565079599 wait complete. 2024-05-03T22:16:37.186 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-05-03T22:16:38.163 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:16:38.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:38 smithi116 ceph-mon[31828]: pgmap v502: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:38.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:38 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1565079599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:16:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:38 smithi082 ceph-mon[28404]: pgmap v502: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:38 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1565079599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:16:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:38 smithi130 ceph-mon[32417]: pgmap v502: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:38 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1565079599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:16:38.599 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:16:40.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:40 smithi116 ceph-mon[31828]: pgmap v503: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:40.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:40 smithi082 ceph-mon[28404]: pgmap v503: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:40.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:40 smithi130 ceph-mon[32417]: pgmap v503: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:41.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.099+0000 7f2909a00700 1 -- 172.21.15.82:0/4139160160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f290406b6f0 msgr2=0x7f290406bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:41.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.099+0000 7f2909a00700 1 --2- 172.21.15.82:0/4139160160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f290406b6f0 0x7f290406bb50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009990 tx=0x7f28ec009ca0 comp rx=0 tx=0).stop 2024-05-03T22:16:41.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.099+0000 7f2909a00700 1 -- 172.21.15.82:0/4139160160 shutdown_connections 2024-05-03T22:16:41.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.099+0000 7f2909a00700 1 --2- 172.21.15.82:0/4139160160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2904105ee0 0x7f2904106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:41.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.099+0000 7f2909a00700 1 --2- 172.21.15.82:0/4139160160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f29041083d0 0x7f290406b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:41.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.099+0000 7f2909a00700 1 --2- 172.21.15.82:0/4139160160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f290406b6f0 0x7f290406bb50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:41.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.099+0000 7f2909a00700 1 -- 172.21.15.82:0/4139160160 >> 172.21.15.82:0/4139160160 conn(0x7f2904079350 msgr2=0x7f2904079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:41.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.099+0000 7f2909a00700 1 -- 172.21.15.82:0/4139160160 shutdown_connections 2024-05-03T22:16:41.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.099+0000 7f2909a00700 1 -- 172.21.15.82:0/4139160160 wait complete. 2024-05-03T22:16:41.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.100+0000 7f2909a00700 1 Processor -- start 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.101+0000 7f2909a00700 1 -- start start 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.101+0000 7f2909a00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f290406b6f0 0x7f29041a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.101+0000 7f2909a00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2904105ee0 0x7f29041a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.101+0000 7f2909a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29041083d0 0x7f29041a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.101+0000 7f2909a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2904119b90 con 0x7f29041083d0 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.101+0000 7f2909a00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2904119a10 con 0x7f290406b6f0 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.101+0000 7f2909a00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2904119d10 con 0x7f2904105ee0 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.101+0000 7f2903400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29041083d0 0x7f29041a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.101+0000 7f2903400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29041083d0 0x7f29041a4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51762/0 (socket says 172.21.15.82:51762) 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.101+0000 7f2903400700 1 -- 172.21.15.82:0/110403489 learned_addr learned my addr 172.21.15.82:0/110403489 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.102+0000 7f2902a00700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f290406b6f0 0x7f29041a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.102+0000 7f28fa000700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2904105ee0 0x7f29041a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.102+0000 7f2903400700 1 -- 172.21.15.82:0/110403489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2904105ee0 msgr2=0x7f29041a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.102+0000 7f2903400700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2904105ee0 0x7f29041a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.102+0000 7f2903400700 1 -- 172.21.15.82:0/110403489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f290406b6f0 msgr2=0x7f29041a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.102+0000 7f2903400700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f290406b6f0 0x7f29041a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.102+0000 7f2903400700 1 -- 172.21.15.82:0/110403489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29041a5090 con 0x7f29041083d0 2024-05-03T22:16:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.102+0000 7f28fa000700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2904105ee0 0x7f29041a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.102+0000 7f2903400700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29041083d0 0x7f29041a4950 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00b550 tx=0x7f28fc00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.103+0000 7f28fbe00700 1 -- 172.21.15.82:0/110403489 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc015020 con 0x7f29041083d0 2024-05-03T22:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.103+0000 7f2909a00700 1 -- 172.21.15.82:0/110403489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29041a5380 con 0x7f29041083d0 2024-05-03T22:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.103+0000 7f28fbe00700 1 -- 172.21.15.82:0/110403489 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28fc011cc0 con 0x7f29041083d0 2024-05-03T22:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.103+0000 7f28fbe00700 1 -- 172.21.15.82:0/110403489 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc010c80 con 0x7f29041083d0 2024-05-03T22:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.103+0000 7f2909a00700 1 -- 172.21.15.82:0/110403489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29041acc00 con 0x7f29041083d0 2024-05-03T22:16:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.104+0000 7f2909a00700 1 -- 172.21.15.82:0/110403489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f290406a190 con 0x7f29041083d0 2024-05-03T22:16:41.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.106+0000 7f28fbe00700 1 -- 172.21.15.82:0/110403489 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f28fc018020 con 0x7f29041083d0 2024-05-03T22:16:41.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.109+0000 7f28fbe00700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f28e80b2910 0x7f28e80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:41.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.109+0000 7f28fbe00700 1 -- 172.21.15.82:0/110403489 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f28fc0e23a0 con 0x7f29041083d0 2024-05-03T22:16:41.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.109+0000 7f2902a00700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f28e80b2910 0x7f28e80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:41.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.110+0000 7f2902a00700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f28e80b2910 0x7f28e80b4dd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f28f400f440 tx=0x7f28f40079e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:41.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.112+0000 7f28fbe00700 1 -- 172.21.15.82:0/110403489 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f28fc01f020 con 0x7f29041083d0 2024-05-03T22:16:41.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.349+0000 7f2909a00700 1 -- 172.21.15.82:0/110403489 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29041a13e0 con 0x7f29041083d0 2024-05-03T22:16:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.352+0000 7f28fbe00700 1 -- 172.21.15.82:0/110403489 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24803 (secure 0 0 0) 0x7f29041a13e0 con 0x7f29041083d0 2024-05-03T22:16:41.355 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:16:41.355 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:14:38.277415+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:12:30.512363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:12:34.936483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:12:50.095758+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:16:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.355+0000 7f2909a00700 1 -- 172.21.15.82:0/110403489 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f28e80b2910 msgr2=0x7f28e80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.355+0000 7f2909a00700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f28e80b2910 0x7f28e80b4dd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f28f400f440 tx=0x7f28f40079e0 comp rx=0 tx=0).stop 2024-05-03T22:16:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.355+0000 7f2909a00700 1 -- 172.21.15.82:0/110403489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29041083d0 msgr2=0x7f29041a4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.355+0000 7f2909a00700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29041083d0 0x7f29041a4950 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00b550 tx=0x7f28fc00b860 comp rx=0 tx=0).stop 2024-05-03T22:16:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.356+0000 7f2909a00700 1 -- 172.21.15.82:0/110403489 shutdown_connections 2024-05-03T22:16:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.356+0000 7f2909a00700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f28e80b2910 0x7f28e80b4dd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.356+0000 7f2909a00700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29041083d0 0x7f29041a4950 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.356+0000 7f2909a00700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f290406b6f0 0x7f29041a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.356+0000 7f2909a00700 1 --2- 172.21.15.82:0/110403489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2904105ee0 0x7f29041a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.356+0000 7f2909a00700 1 -- 172.21.15.82:0/110403489 >> 172.21.15.82:0/110403489 conn(0x7f2904079350 msgr2=0x7f2904104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.356+0000 7f2909a00700 1 -- 172.21.15.82:0/110403489 shutdown_connections 2024-05-03T22:16:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:41.356+0000 7f2909a00700 1 -- 172.21.15.82:0/110403489 wait complete. 2024-05-03T22:16:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:42 smithi116 ceph-mon[31828]: pgmap v504: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:42 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/110403489' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:16:42.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:42 smithi082 ceph-mon[28404]: pgmap v504: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:42.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:42 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/110403489' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:16:42.454 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:16:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:42 smithi130 ceph-mon[32417]: pgmap v504: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:42 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/110403489' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:16:42.915 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:16:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:44 smithi116 ceph-mon[31828]: pgmap v505: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:44 smithi082 ceph-mon[28404]: pgmap v505: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:44 smithi130 ceph-mon[32417]: pgmap v505: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:45.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.419+0000 7f12b3e00700 1 -- 172.21.15.82:0/3454194917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12b4103d90 msgr2=0x7f12b41102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.419+0000 7f12b3e00700 1 --2- 172.21.15.82:0/3454194917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12b4103d90 0x7f12b41102a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00b0a0 tx=0x7f12ac00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:16:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.419+0000 7f12b3e00700 1 -- 172.21.15.82:0/3454194917 shutdown_connections 2024-05-03T22:16:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.419+0000 7f12b3e00700 1 --2- 172.21.15.82:0/3454194917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12b4103d90 0x7f12b41102a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.419+0000 7f12b3e00700 1 --2- 172.21.15.82:0/3454194917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12b4109460 0x7f12b4109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.419+0000 7f12b3e00700 1 --2- 172.21.15.82:0/3454194917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b41033d0 0x7f12b4103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.419+0000 7f12b3e00700 1 -- 172.21.15.82:0/3454194917 >> 172.21.15.82:0/3454194917 conn(0x7f12b40fef20 msgr2=0x7f12b4101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.419+0000 7f12b3e00700 1 -- 172.21.15.82:0/3454194917 shutdown_connections 2024-05-03T22:16:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.420+0000 7f12b3e00700 1 -- 172.21.15.82:0/3454194917 wait complete. 2024-05-03T22:16:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.421+0000 7f12b3e00700 1 Processor -- start 2024-05-03T22:16:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.421+0000 7f12b3e00700 1 -- start start 2024-05-03T22:16:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.422+0000 7f12b3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12b41033d0 0x7f12b41a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:45.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.422+0000 7f12b3e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b4103d90 0x7f12b41a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:45.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.422+0000 7f12b3e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12b4109460 0x7f12b419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:45.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.422+0000 7f12b3e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12b41134a0 con 0x7f12b41033d0 2024-05-03T22:16:45.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.422+0000 7f12b3e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f12b4113320 con 0x7f12b4109460 2024-05-03T22:16:45.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.422+0000 7f12b3e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12b4113620 con 0x7f12b4103d90 2024-05-03T22:16:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.422+0000 7f12b2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12b41033d0 0x7f12b41a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.422+0000 7f12b2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12b41033d0 0x7f12b41a1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46590/0 (socket says 172.21.15.82:46590) 2024-05-03T22:16:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.422+0000 7f12b2a00700 1 -- 172.21.15.82:0/1970133913 learned_addr learned my addr 172.21.15.82:0/1970133913 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.423+0000 7f12b2a00700 1 -- 172.21.15.82:0/1970133913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b4103d90 msgr2=0x7f12b41a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.423+0000 7f12b2a00700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b4103d90 0x7f12b41a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.423+0000 7f12b2a00700 1 -- 172.21.15.82:0/1970133913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12b4109460 msgr2=0x7f12b419b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.423+0000 7f12b2a00700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12b4109460 0x7f12b419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.423+0000 7f12b2a00700 1 -- 172.21.15.82:0/1970133913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b419c140 con 0x7f12b41033d0 2024-05-03T22:16:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.423+0000 7f12b2a00700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12b41033d0 0x7f12b41a1820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f12a400d950 tx=0x7f12a400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.423+0000 7f12b8a00700 1 -- 172.21.15.82:0/1970133913 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a4016070 con 0x7f12b41033d0 2024-05-03T22:16:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.424+0000 7f12b8a00700 1 -- 172.21.15.82:0/1970133913 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12a4010460 con 0x7f12b41033d0 2024-05-03T22:16:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.424+0000 7f12b8a00700 1 -- 172.21.15.82:0/1970133913 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a400f620 con 0x7f12b41033d0 2024-05-03T22:16:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.424+0000 7f12b3e00700 1 -- 172.21.15.82:0/1970133913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b419c430 con 0x7f12b41033d0 2024-05-03T22:16:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.424+0000 7f12b3e00700 1 -- 172.21.15.82:0/1970133913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b41a86f0 con 0x7f12b41033d0 2024-05-03T22:16:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.425+0000 7f12b3e00700 1 -- 172.21.15.82:0/1970133913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b406a190 con 0x7f12b41033d0 2024-05-03T22:16:45.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.429+0000 7f12b8a00700 1 -- 172.21.15.82:0/1970133913 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f12a4019070 con 0x7f12b41033d0 2024-05-03T22:16:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.431+0000 7f12b8a00700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f12980b2910 0x7f12980b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.431+0000 7f12b8a00700 1 -- 172.21.15.82:0/1970133913 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f12a40e2340 con 0x7f12b41033d0 2024-05-03T22:16:45.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.431+0000 7f12b2000700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f12980b2910 0x7f12980b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:45.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.432+0000 7f12b2000700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f12980b2910 0x7f12980b4dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f12a0005950 tx=0x7f12a00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:45.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.434+0000 7f12b8a00700 1 -- 172.21.15.82:0/1970133913 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f12a40a9ae0 con 0x7f12b41033d0 2024-05-03T22:16:45.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.729+0000 7f12b3e00700 1 -- 172.21.15.82:0/1970133913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12b419cf10 con 0x7f12b41033d0 2024-05-03T22:16:45.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.731+0000 7f12b8a00700 1 -- 172.21.15.82:0/1970133913 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f12b419cf10 con 0x7f12b41033d0 2024-05-03T22:16:45.733 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:16:45.733 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:12:39.270198+0000","modified":"2024-05-03T22:14:10.244210+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34460,"mds_1":34433,"mds_2":34412,"mds_3":34403,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":40,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34412":{"gid":34412,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6839/3254019270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3254019270},{"type":"v1","addr":"172.21.15.116:6839","nonce":3254019270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34460,"qdb_cluster":[24469,34403,34460,34433,34412]},"id":1}]} 2024-05-03T22:16:45.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.734+0000 7f12b3e00700 1 -- 172.21.15.82:0/1970133913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f12980b2910 msgr2=0x7f12980b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:45.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.734+0000 7f12b3e00700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f12980b2910 0x7f12980b4dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f12a0005950 tx=0x7f12a00058e0 comp rx=0 tx=0).stop 2024-05-03T22:16:45.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.734+0000 7f12b3e00700 1 -- 172.21.15.82:0/1970133913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12b41033d0 msgr2=0x7f12b41a1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:45.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.734+0000 7f12b3e00700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12b41033d0 0x7f12b41a1820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f12a400d950 tx=0x7f12a400dd10 comp rx=0 tx=0).stop 2024-05-03T22:16:45.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.734+0000 7f12b3e00700 1 -- 172.21.15.82:0/1970133913 shutdown_connections 2024-05-03T22:16:45.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.734+0000 7f12b3e00700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f12980b2910 0x7f12980b4dd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:45.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.734+0000 7f12b3e00700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12b41033d0 0x7f12b41a1820 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:45.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.734+0000 7f12b3e00700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12b4109460 0x7f12b419b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:45.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.734+0000 7f12b3e00700 1 --2- 172.21.15.82:0/1970133913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b4103d90 0x7f12b41a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:45.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.734+0000 7f12b3e00700 1 -- 172.21.15.82:0/1970133913 >> 172.21.15.82:0/1970133913 conn(0x7f12b40fef20 msgr2=0x7f12b410ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:45.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.735+0000 7f12b3e00700 1 -- 172.21.15.82:0/1970133913 shutdown_connections 2024-05-03T22:16:45.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:45.735+0000 7f12b3e00700 1 -- 172.21.15.82:0/1970133913 wait complete. 2024-05-03T22:16:45.738 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-05-03T22:16:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:46 smithi082 ceph-mon[28404]: pgmap v506: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:46.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:46 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:16:46.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:46 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1970133913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:16:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:46 smithi130 ceph-mon[32417]: pgmap v506: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:46 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:16:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:46 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1970133913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:16:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:46 smithi116 ceph-mon[31828]: pgmap v506: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:46 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:16:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:46 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1970133913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:16:46.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-03T22:12:39.270198+0000', 'modified': '2024-05-03T22:14:10.244210+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34460, 'mds_1': 34433, 'mds_2': 34412, 'mds_3': 34403, 'mds_4': 24469}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14583': {'gid': 14583, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6839/4287485607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 4287485607}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 4287485607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14595': {'gid': 14595, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6841/1188447125', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6840', 'nonce': 1188447125}, {'type': 'v1', 'addr': '172.21.15.82:6841', 'nonce': 1188447125}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6833/2041703143', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6832', 'nonce': 2041703143}, {'type': 'v1', 'addr': '172.21.15.130:6833', 'nonce': 2041703143}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6835/710741525', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 710741525}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 710741525}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6837/4246597354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 4246597354}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 4246597354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.130:6839/944732551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 944732551}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 944732551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34403': {'gid': 34403, 'name': 'k', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 40, 'addr': '172.21.15.116:6833/1484646572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6832', 'nonce': 1484646572}, {'type': 'v1', 'addr': '172.21.15.116:6833', 'nonce': 1484646572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34412': {'gid': 34412, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 36, 'addr': '172.21.15.116:6835/1544765094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 1544765094}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 1544765094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34433': {'gid': 34433, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.116:6837/2428901446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 2428901446}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 2428901446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34460': {'gid': 34460, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.116:6839/3254019270', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 3254019270}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 3254019270}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34460, 'qdb_cluster': [24469, 34403, 34460, 34433, 34412]} 2024-05-03T22:16:46.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-03T22:16:46.819 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-03T22:16:47.262 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:16:48.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:48 smithi082 ceph-mon[28404]: pgmap v507: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:48.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:48 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:16:48.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:48 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:16:48.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:48 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:16:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:48 smithi130 ceph-mon[32417]: pgmap v507: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:48 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:16:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:48 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:16:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:48 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:16:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:48 smithi116 ceph-mon[31828]: pgmap v507: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:48 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:16:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:48 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:16:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:48 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:16:49.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.814+0000 7f6da8600700 1 -- 172.21.15.82:0/1996190105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6da006bb40 msgr2=0x7f6da0110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:49.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.814+0000 7f6da8600700 1 --2- 172.21.15.82:0/1996190105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6da006bb40 0x7f6da0110330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800b0a0 tx=0x7f6d9800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.814+0000 7f6da8600700 1 -- 172.21.15.82:0/1996190105 shutdown_connections 2024-05-03T22:16:49.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.814+0000 7f6da8600700 1 --2- 172.21.15.82:0/1996190105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6da006bb40 0x7f6da0110330 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.814+0000 7f6da8600700 1 --2- 172.21.15.82:0/1996190105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6da0109510 0x7f6da01098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.814+0000 7f6da8600700 1 --2- 172.21.15.82:0/1996190105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da006b180 0x7f6da006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.814+0000 7f6da8600700 1 -- 172.21.15.82:0/1996190105 >> 172.21.15.82:0/1996190105 conn(0x7f6da0079350 msgr2=0x7f6da0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:49.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.814+0000 7f6da8600700 1 -- 172.21.15.82:0/1996190105 shutdown_connections 2024-05-03T22:16:49.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.815+0000 7f6da8600700 1 -- 172.21.15.82:0/1996190105 wait complete. 2024-05-03T22:16:49.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.816+0000 7f6da8600700 1 Processor -- start 2024-05-03T22:16:49.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.816+0000 7f6da8600700 1 -- start start 2024-05-03T22:16:49.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.817+0000 7f6da8600700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6da006b180 0x7f6da01a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.817+0000 7f6da8600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da006bb40 0x7f6da01a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.817+0000 7f6da8600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6da0109510 0x7f6da019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.817+0000 7f6da8600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0113540 con 0x7f6da0109510 2024-05-03T22:16:49.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.817+0000 7f6da8600700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01133c0 con 0x7f6da006b180 2024-05-03T22:16:49.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.817+0000 7f6da8600700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01136c0 con 0x7f6da006bb40 2024-05-03T22:16:49.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.817+0000 7f6da6600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6da0109510 0x7f6da019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.817+0000 7f6da6600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6da0109510 0x7f6da019bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46616/0 (socket says 172.21.15.82:46616) 2024-05-03T22:16:49.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.817+0000 7f6da6600700 1 -- 172.21.15.82:0/4069500813 learned_addr learned my addr 172.21.15.82:0/4069500813 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:49.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.817+0000 7f6da5200700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da006bb40 0x7f6da01a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.817+0000 7f6da5c00700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6da006b180 0x7f6da01a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.818+0000 7f6da6600700 1 -- 172.21.15.82:0/4069500813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da006bb40 msgr2=0x7f6da01a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:49.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.818+0000 7f6da6600700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da006bb40 0x7f6da01a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.818+0000 7f6da6600700 1 -- 172.21.15.82:0/4069500813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6da006b180 msgr2=0x7f6da01a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:49.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.818+0000 7f6da6600700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6da006b180 0x7f6da01a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.818+0000 7f6da6600700 1 -- 172.21.15.82:0/4069500813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da019c220 con 0x7f6da0109510 2024-05-03T22:16:49.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.818+0000 7f6da6600700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6da0109510 0x7f6da019bac0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800b070 tx=0x7f6d98004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:49.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.818+0000 7f6d9e000700 1 -- 172.21.15.82:0/4069500813 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98021070 con 0x7f6da0109510 2024-05-03T22:16:49.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.819+0000 7f6d9e000700 1 -- 172.21.15.82:0/4069500813 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d98007b80 con 0x7f6da0109510 2024-05-03T22:16:49.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.819+0000 7f6da8600700 1 -- 172.21.15.82:0/4069500813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da019c4b0 con 0x7f6da0109510 2024-05-03T22:16:49.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.819+0000 7f6d9e000700 1 -- 172.21.15.82:0/4069500813 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d980046e0 con 0x7f6da0109510 2024-05-03T22:16:49.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.819+0000 7f6da8600700 1 -- 172.21.15.82:0/4069500813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da01a87d0 con 0x7f6da0109510 2024-05-03T22:16:49.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.822+0000 7f6d9e000700 1 -- 172.21.15.82:0/4069500813 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6d98003a00 con 0x7f6da0109510 2024-05-03T22:16:49.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.824+0000 7f6db2fceb80 1 Processor -- start 2024-05-03T22:16:49.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.824+0000 7f6d9e000700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d880b2910 0x7f6d880b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.824+0000 7f6db2fceb80 1 -- start start 2024-05-03T22:16:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.824+0000 7f6d9e000700 1 -- 172.21.15.82:0/4069500813 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f6d980e3890 con 0x7f6da0109510 2024-05-03T22:16:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.824+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3a760 0x55a797e3ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.824+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e35f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.824+0000 7f6da5200700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d880b2910 0x7f6d880b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.824+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e36580 0x55a797e369e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.824+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a797d889d0 con 0x55a797e3b080 2024-05-03T22:16:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.824+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a797d26710 con 0x55a797e36580 2024-05-03T22:16:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.824+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a797d84990 con 0x55a797e3a760 2024-05-03T22:16:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.825+0000 7f6da5200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e35f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.825+0000 7f6da5200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e35f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46628/0 (socket says 172.21.15.82:46628) 2024-05-03T22:16:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.825+0000 7f6da5200700 1 -- 172.21.15.82:0/449425508 learned_addr learned my addr 172.21.15.82:0/449425508 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.825+0000 7f6da5c00700 1 --2- 172.21.15.82:0/449425508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3a760 0x55a797e3ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.825+0000 7f6da6600700 1 --2- 172.21.15.82:0/449425508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e36580 0x55a797e369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.825+0000 7f6da5200700 1 -- 172.21.15.82:0/449425508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3a760 msgr2=0x55a797e3ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:49.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.825+0000 7f6da5200700 1 --2- 172.21.15.82:0/449425508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3a760 0x55a797e3ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.825+0000 7f6da5200700 1 -- 172.21.15.82:0/449425508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e36580 msgr2=0x55a797e369e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:49.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.825+0000 7f6da5200700 1 --2- 172.21.15.82:0/449425508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e36580 0x55a797e369e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.825+0000 7f6da5200700 1 -- 172.21.15.82:0/449425508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a797cd5880 con 0x55a797e3b080 2024-05-03T22:16:49.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.825+0000 7f6da5200700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d880b2910 0x7f6d880b4dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0135f0 tx=0x7f6d8c0139b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:49.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.826+0000 7f6da5200700 1 --2- 172.21.15.82:0/449425508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e35f60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c013db0 tx=0x7f6d8c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd422e2312c05016 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:49.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.826+0000 7f6d92a00700 1 -- 172.21.15.82:0/449425508 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c023020 con 0x55a797e3b080 2024-05-03T22:16:49.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.826+0000 7f6d92a00700 1 -- 172.21.15.82:0/449425508 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d8c011e40 con 0x55a797e3b080 2024-05-03T22:16:49.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.826+0000 7f6d92a00700 1 -- 172.21.15.82:0/449425508 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c01e660 con 0x55a797e3b080 2024-05-03T22:16:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.827+0000 7f6db2fceb80 1 -- 172.21.15.82:0/449425508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 msgr2=0x55a797e35f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.827+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/449425508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e35f60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c013db0 tx=0x7f6d8c01d000 comp rx=0 tx=0).stop 2024-05-03T22:16:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.827+0000 7f6db2fceb80 1 -- 172.21.15.82:0/449425508 shutdown_connections 2024-05-03T22:16:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.827+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/449425508 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e36580 0x55a797e369e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.827+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/449425508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3a760 0x55a797e3ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.827+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/449425508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e35f60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.827+0000 7f6db2fceb80 1 -- 172.21.15.82:0/449425508 >> 172.21.15.82:0/449425508 conn(0x55a797d64b10 msgr2=0x55a797e307a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.827+0000 7f6db2fceb80 1 -- 172.21.15.82:0/449425508 shutdown_connections 2024-05-03T22:16:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.827+0000 7f6db2fceb80 1 -- 172.21.15.82:0/449425508 wait complete. 2024-05-03T22:16:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.828+0000 7f6db2fceb80 1 -- start start 2024-05-03T22:16:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.828+0000 7f6db2fceb80 1 Processor -- start 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e41e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3a760 0x55a797e3f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3b080 0x55a797e3f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a797e42c40 con 0x55a797e36580 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a797ceead0 con 0x55a797e3a760 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a797e42dc0 con 0x55a797e3b080 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6db2fceb80 10 client.0 _ll_register_callbacks cb 0x55a797d2fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6da5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e41e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6da5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e41e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46644/0 (socket says 172.21.15.82:46644) 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6da5c00700 1 -- 172.21.15.82:0/4277891342 learned_addr learned my addr 172.21.15.82:0/4277891342 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6da5200700 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3a760 0x55a797e3f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6da6600700 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3b080 0x55a797e3f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6da5c00700 1 -- 172.21.15.82:0/4277891342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3b080 msgr2=0x55a797e3f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:49.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6da5c00700 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3b080 0x55a797e3f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6da5c00700 1 -- 172.21.15.82:0/4277891342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3a760 msgr2=0x55a797e3f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:49.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.829+0000 7f6da5c00700 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3a760 0x55a797e3f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.830+0000 7f6da5c00700 1 -- 172.21.15.82:0/4277891342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a797d4e3d0 con 0x55a797e36580 2024-05-03T22:16:49.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.830+0000 7f6da5200700 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3a760 0x55a797e3f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:16:49.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.830+0000 7f6da5c00700 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e41e70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6d94007ea0 tx=0x7f6d94012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ab3eccbaa6894e server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:49.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.830+0000 7f6d87400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:16:49.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.830+0000 7f6d87400700 1 -- 172.21.15.82:0/4277891342 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94010870 con 0x55a797e36580 2024-05-03T22:16:49.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.830+0000 7f6d87400700 1 -- 172.21.15.82:0/4277891342 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f6d94010a10 con 0x55a797e36580 2024-05-03T22:16:49.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.830+0000 7f6db2fceb80 1 -- 172.21.15.82:0/4277891342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d8c011e40 con 0x55a797e36580 2024-05-03T22:16:49.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.831+0000 7f6d87400700 1 -- 172.21.15.82:0/4277891342 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6d94010c10 con 0x55a797e36580 2024-05-03T22:16:49.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.831+0000 7f6db2fceb80 10 client.15051 fetch_fsmap learned FSMap version 29 2024-05-03T22:16:49.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.831+0000 7f6db2fceb80 1 -- 172.21.15.82:0/4277891342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a797e4d4f0 con 0x55a797e36580 2024-05-03T22:16:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.831+0000 7f6d87400700 1 -- 172.21.15.82:0/4277891342 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d8c011e40 con 0x55a797e36580 2024-05-03T22:16:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.831+0000 7f6d87400700 1 -- 172.21.15.82:0/4277891342 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6d94019070 con 0x55a797e36580 2024-05-03T22:16:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.831+0000 7f6db2fceb80 10 client.15051 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:16:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.831+0000 7f6db2fceb80 10 client.15051 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T22:16:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.831+0000 7f6db2fceb80 20 client.15051 populate_metadata read hostname 'smithi082' 2024-05-03T22:16:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.831+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x55a797e4fbd0 0x55a797e51040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.831+0000 7f6db2fceb80 4 client.15051 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:16:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.831+0000 7f6db2fceb80 1 -- 172.21.15.82:0/4277891342 --> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a797e03180 con 0x55a797e4fbd0 2024-05-03T22:16:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.833+0000 7f6da5200700 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x55a797e4fbd0 0x55a797e51040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.834+0000 7f6d87400700 10 client.15051 ms_handle_connect on v2:172.21.15.130:6838/944732551 2024-05-03T22:16:49.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.834+0000 7f6da5200700 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x55a797e4fbd0 0x55a797e51040 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=41596047a01bb4cc server_cookie=34c003c1016d9232 in_seq=0 out_seq=0 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6d87400700 1 -- 172.21.15.82:0/4277891342 <== mds.4 v2:172.21.15.130:6838/944732551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a797e03180 con 0x55a797e4fbd0 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6d87400700 10 client.15051 handle_command_reply: tid=0 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6db2fceb80 1 client.15051 shutdown 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6db2fceb80 1 -- 172.21.15.82:0/4277891342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 msgr2=0x55a797e41e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e41e70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6d94007ea0 tx=0x7f6d94012730 comp rx=0 tx=0).stop 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6db2fceb80 1 -- 172.21.15.82:0/4277891342 shutdown_connections 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x55a797e4fbd0 0x55a797e51040 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e41e70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3b080 0x55a797e3f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6d87400700 0 client.15051 ms_handle_reset on v2:172.21.15.130:6838/944732551 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/4277891342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3a760 0x55a797e3f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.836+0000 7f6db2fceb80 1 -- 172.21.15.82:0/4277891342 >> 172.21.15.82:0/4277891342 conn(0x55a797d64b10 msgr2=0x55a797e3bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:49.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.837+0000 7f6db2fceb80 1 -- 172.21.15.82:0/4277891342 shutdown_connections 2024-05-03T22:16:49.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.837+0000 7f6db2fceb80 1 -- 172.21.15.82:0/4277891342 wait complete. 2024-05-03T22:16:49.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.837+0000 7f6db2fceb80 20 client.15051 trim_cache size 0 max 16384 2024-05-03T22:16:49.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.860+0000 7f6db2fceb80 1 Processor -- start 2024-05-03T22:16:49.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.861+0000 7f6db2fceb80 1 -- start start 2024-05-03T22:16:49.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.861+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e324a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.861+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3a760 0x55a797e393a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.861+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3b080 0x55a797e398e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.861+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a797e4f380 con 0x55a797e36580 2024-05-03T22:16:49.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.861+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a797e4fa50 con 0x55a797e3b080 2024-05-03T22:16:49.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.861+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a797e50120 con 0x55a797e3a760 2024-05-03T22:16:49.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.861+0000 7f6da5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.861+0000 7f6da5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e324a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46650/0 (socket says 172.21.15.82:46650) 2024-05-03T22:16:49.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.861+0000 7f6da5c00700 1 -- 172.21.15.82:0/3120665792 learned_addr learned my addr 172.21.15.82:0/3120665792 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.862+0000 7f6da5200700 1 --2- 172.21.15.82:0/3120665792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3a760 0x55a797e393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.862+0000 7f6da6600700 1 --2- 172.21.15.82:0/3120665792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3b080 0x55a797e398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.862+0000 7f6da5c00700 1 -- 172.21.15.82:0/3120665792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3a760 msgr2=0x55a797e393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.862+0000 7f6da5c00700 1 --2- 172.21.15.82:0/3120665792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3a760 0x55a797e393a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.862+0000 7f6da5c00700 1 -- 172.21.15.82:0/3120665792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3b080 msgr2=0x55a797e398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.862+0000 7f6da5c00700 1 --2- 172.21.15.82:0/3120665792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3b080 0x55a797e398e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.862+0000 7f6da5c00700 1 -- 172.21.15.82:0/3120665792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a797e4f870 con 0x55a797e36580 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.862+0000 7f6da5200700 1 --2- 172.21.15.82:0/3120665792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3a760 0x55a797e393a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.862+0000 7f6da5c00700 1 --2- 172.21.15.82:0/3120665792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e324a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6d94007bc0 tx=0x7f6d94005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c459cab4b4c7152 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.863+0000 7f6d92000700 1 -- 172.21.15.82:0/3120665792 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94010db0 con 0x55a797e36580 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.863+0000 7f6d92000700 1 -- 172.21.15.82:0/3120665792 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d9401b610 con 0x55a797e36580 2024-05-03T22:16:49.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.863+0000 7f6d92000700 1 -- 172.21.15.82:0/3120665792 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d940296c0 con 0x55a797e36580 2024-05-03T22:16:49.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.863+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3120665792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 msgr2=0x55a797e324a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:49.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.863+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/3120665792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e324a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6d94007bc0 tx=0x7f6d94005a00 comp rx=0 tx=0).stop 2024-05-03T22:16:49.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.864+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3120665792 shutdown_connections 2024-05-03T22:16:49.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.864+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/3120665792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e36580 0x55a797e324a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.864+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/3120665792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3b080 0x55a797e398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.864+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/3120665792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e3a760 0x55a797e393a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.864+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3120665792 >> 172.21.15.82:0/3120665792 conn(0x55a797d64b10 msgr2=0x55a797e30720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:49.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.864+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3120665792 shutdown_connections 2024-05-03T22:16:49.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.864+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3120665792 wait complete. 2024-05-03T22:16:49.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.864+0000 7f6db2fceb80 1 -- start start 2024-05-03T22:16:49.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.865+0000 7f6db2fceb80 1 Processor -- start 2024-05-03T22:16:49.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.865+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e36580 0x55a797e5a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.865+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3a760 0x55a797e5aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.865+0000 7f6db2fceb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e53460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.865+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a797e50ec0 con 0x55a797e3b080 2024-05-03T22:16:49.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.865+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a797e507f0 con 0x55a797e3a760 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.865+0000 7f6db2fceb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a797e51590 con 0x55a797e36580 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.865+0000 7f6db2fceb80 10 client.0 _ll_register_callbacks cb 0x55a797d2fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.865+0000 7f6da6600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e53460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.865+0000 7f6da6600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e53460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46654/0 (socket says 172.21.15.82:46654) 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.865+0000 7f6da6600700 1 -- 172.21.15.82:0/3215410617 learned_addr learned my addr 172.21.15.82:0/3215410617 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6da5c00700 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e36580 0x55a797e5a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6da5200700 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3a760 0x55a797e5aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6da6600700 1 -- 172.21.15.82:0/3215410617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e36580 msgr2=0x55a797e5a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6da6600700 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e36580 0x55a797e5a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6da6600700 1 -- 172.21.15.82:0/3215410617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3a760 msgr2=0x55a797e5aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6da6600700 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3a760 0x55a797e5aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6da6600700 1 -- 172.21.15.82:0/3215410617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a797e53a20 con 0x55a797e3b080 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6da6600700 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e53460 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6d980a6a40 tx=0x7f6d980099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b69b9eca6b57a49 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6d87400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:16:49.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6d87400700 1 -- 172.21.15.82:0/3215410617 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9802a040 con 0x55a797e3b080 2024-05-03T22:16:49.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6d87400700 1 -- 172.21.15.82:0/3215410617 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f6d98007d30 con 0x55a797e3b080 2024-05-03T22:16:49.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.866+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3215410617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d9401b610 con 0x55a797e3b080 2024-05-03T22:16:49.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.867+0000 7f6d87400700 1 -- 172.21.15.82:0/3215410617 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6d98004880 con 0x55a797e3b080 2024-05-03T22:16:49.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.867+0000 7f6db2fceb80 10 client.15057 fetch_fsmap learned FSMap version 29 2024-05-03T22:16:49.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.867+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3215410617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a797ebb870 con 0x55a797e3b080 2024-05-03T22:16:49.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.867+0000 7f6d87400700 1 -- 172.21.15.82:0/3215410617 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d9401b610 con 0x55a797e3b080 2024-05-03T22:16:49.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.867+0000 7f6d87400700 1 -- 172.21.15.82:0/3215410617 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6d98011070 con 0x55a797e3b080 2024-05-03T22:16:49.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.867+0000 7f6db2fceb80 10 client.15057 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:16:49.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.867+0000 7f6db2fceb80 10 client.15057 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T22:16:49.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.867+0000 7f6db2fceb80 20 client.15057 populate_metadata read hostname 'smithi082' 2024-05-03T22:16:49.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.867+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x55a797ec04d0 0x55a797ebf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:49.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.867+0000 7f6db2fceb80 4 client.15057 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:16:49.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.867+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3215410617 --> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] -- command(tid 0: {"prefix": "status"}) -- 0x55a797d963b0 con 0x55a797ec04d0 2024-05-03T22:16:49.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.868+0000 7f6da5c00700 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x55a797ec04d0 0x55a797ebf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:49.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.869+0000 7f6da5c00700 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x55a797ec04d0 0x55a797ebf1e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=12057eb3856cce86 server_cookie=a86e159f84e59890 in_seq=0 out_seq=0 2024-05-03T22:16:49.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.869+0000 7f6d87400700 10 client.15057 ms_handle_connect on v2:172.21.15.130:6838/944732551 2024-05-03T22:16:49.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.870+0000 7f6d87400700 1 -- 172.21.15.82:0/3215410617 <== mds.4 v2:172.21.15.130:6838/944732551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a797d963b0 con 0x55a797ec04d0 2024-05-03T22:16:49.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.870+0000 7f6d87400700 10 client.15057 handle_command_reply: tid=0 2024-05-03T22:16:49.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.870+0000 7f6db2fceb80 1 client.15057 shutdown 2024-05-03T22:16:49.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.870+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3215410617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 msgr2=0x55a797e53460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:49.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.870+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e53460 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6d980a6a40 tx=0x7f6d980099e0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.870+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3215410617 shutdown_connections 2024-05-03T22:16:49.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.870+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x55a797ec04d0 0x55a797ebf1e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.870+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a797e3b080 0x55a797e53460 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.870+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a797e36580 0x55a797e5a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.870+0000 7f6db2fceb80 1 --2- 172.21.15.82:0/3215410617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a797e3a760 0x55a797e5aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.870+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3215410617 >> 172.21.15.82:0/3215410617 conn(0x55a797d64b10 msgr2=0x55a797e35310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:49.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.871+0000 7f6d87400700 0 client.15057 ms_handle_reset on v2:172.21.15.130:6838/944732551 2024-05-03T22:16:49.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.871+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3215410617 shutdown_connections 2024-05-03T22:16:49.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.871+0000 7f6db2fceb80 1 -- 172.21.15.82:0/3215410617 wait complete. 2024-05-03T22:16:49.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.871+0000 7f6db2fceb80 20 client.15057 trim_cache size 0 max 16384 2024-05-03T22:16:49.874 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:16:49.874 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:16:49.874 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 4, 2024-05-03T22:16:49.874 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24469, 2024-05-03T22:16:49.874 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-03T22:16:49.874 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-03T22:16:49.875 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-03T22:16:49.875 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 164.75998857900001, 2024-05-03T22:16:49.875 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 29, 2024-05-03T22:16:49.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-05-03T22:16:49.875 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-05-03T22:16:49.875 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 287.44275373099998 2024-05-03T22:16:49.875 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 -- 172.21.15.82:0/4069500813 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d880b2910 msgr2=0x7f6d880b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d880b2910 0x7f6d880b4dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0135f0 tx=0x7f6d8c0139b0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 -- 172.21.15.82:0/4069500813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6da0109510 msgr2=0x7f6da019bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6da0109510 0x7f6da019bac0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800b070 tx=0x7f6d98004d50 comp rx=0 tx=0).stop 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 -- 172.21.15.82:0/4069500813 shutdown_connections 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f6d880b2910 0x7f6d880b4dd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6da0109510 0x7f6da019bac0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6da006b180 0x7f6da01a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 --2- 172.21.15.82:0/4069500813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6da006bb40 0x7f6da01a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 -- 172.21.15.82:0/4069500813 >> 172.21.15.82:0/4069500813 conn(0x7f6da0079350 msgr2=0x7f6da010e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 -- 172.21.15.82:0/4069500813 shutdown_connections 2024-05-03T22:16:49.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:49.872+0000 7f6da8600700 1 -- 172.21.15.82:0/4069500813 wait complete. 2024-05-03T22:16:50.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:50 smithi082 ceph-mon[28404]: pgmap v508: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:50 smithi130 ceph-mon[32417]: pgmap v508: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:50 smithi116 ceph-mon[31828]: pgmap v508: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:16:50.753 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell mds.k status 2024-05-03T22:16:51.168 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:16:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:52 smithi082 ceph-mon[28404]: pgmap v509: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:52 smithi130 ceph-mon[32417]: pgmap v509: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:52.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:52 smithi116 ceph-mon[31828]: pgmap v509: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:16:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.653+0000 7fd11b200700 1 -- 172.21.15.82:0/999399076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c1099e0 msgr2=0x7fd11c109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.653+0000 7fd11b200700 1 --2- 172.21.15.82:0/999399076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c1099e0 0x7fd11c109e60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd108009990 tx=0x7fd108009ca0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.653+0000 7fd11b200700 1 -- 172.21.15.82:0/999399076 shutdown_connections 2024-05-03T22:16:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.653+0000 7fd11b200700 1 --2- 172.21.15.82:0/999399076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd11c10a3a0 0x7fd11c1168a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.653+0000 7fd11b200700 1 --2- 172.21.15.82:0/999399076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd11c10f9d0 0x7fd11c10fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.653+0000 7fd11b200700 1 --2- 172.21.15.82:0/999399076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c1099e0 0x7fd11c109e60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.653+0000 7fd11b200700 1 -- 172.21.15.82:0/999399076 >> 172.21.15.82:0/999399076 conn(0x7fd11c079200 msgr2=0x7fd11c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.654+0000 7fd11b200700 1 -- 172.21.15.82:0/999399076 shutdown_connections 2024-05-03T22:16:53.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.654+0000 7fd11b200700 1 -- 172.21.15.82:0/999399076 wait complete. 2024-05-03T22:16:53.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.655+0000 7fd11b200700 1 Processor -- start 2024-05-03T22:16:53.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.655+0000 7fd11b200700 1 -- start start 2024-05-03T22:16:53.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.655+0000 7fd11b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c1099e0 0x7fd11c19ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.655+0000 7fd11b200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd11c10a3a0 0x7fd11c1a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.655+0000 7fd11b200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd11c10f9d0 0x7fd11c1a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.655+0000 7fd11b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c119b10 con 0x7fd11c1099e0 2024-05-03T22:16:53.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.655+0000 7fd11b200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c119990 con 0x7fd11c10a3a0 2024-05-03T22:16:53.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.655+0000 7fd11b200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c119c90 con 0x7fd11c10f9d0 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.655+0000 7fd119e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c1099e0 0x7fd11c19ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.656+0000 7fd119e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c1099e0 0x7fd11c19ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46672/0 (socket says 172.21.15.82:46672) 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.656+0000 7fd119e00700 1 -- 172.21.15.82:0/2767605135 learned_addr learned my addr 172.21.15.82:0/2767605135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.656+0000 7fd119400700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd11c10a3a0 0x7fd11c1a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.656+0000 7fd11a800700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd11c10f9d0 0x7fd11c1a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.656+0000 7fd119e00700 1 -- 172.21.15.82:0/2767605135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd11c10f9d0 msgr2=0x7fd11c1a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.656+0000 7fd119e00700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd11c10f9d0 0x7fd11c1a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.656+0000 7fd119e00700 1 -- 172.21.15.82:0/2767605135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd11c10a3a0 msgr2=0x7fd11c1a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.656+0000 7fd119e00700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd11c10a3a0 0x7fd11c1a04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.656+0000 7fd119e00700 1 -- 172.21.15.82:0/2767605135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c1a4f90 con 0x7fd11c1099e0 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.656+0000 7fd119400700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd11c10a3a0 0x7fd11c1a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:16:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.656+0000 7fd119e00700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c1099e0 0x7fd11c19ff80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00c9b0 tx=0x7fd10c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:53.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.657+0000 7fd112a00700 1 -- 172.21.15.82:0/2767605135 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c007b00 con 0x7fd11c1099e0 2024-05-03T22:16:53.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.657+0000 7fd112a00700 1 -- 172.21.15.82:0/2767605135 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd10c007ca0 con 0x7fd11c1099e0 2024-05-03T22:16:53.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.657+0000 7fd112a00700 1 -- 172.21.15.82:0/2767605135 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c018660 con 0x7fd11c1099e0 2024-05-03T22:16:53.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.657+0000 7fd11b200700 1 -- 172.21.15.82:0/2767605135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11c1a5280 con 0x7fd11c1099e0 2024-05-03T22:16:53.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.657+0000 7fd11b200700 1 -- 172.21.15.82:0/2767605135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11c1acb00 con 0x7fd11c1099e0 2024-05-03T22:16:53.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.661+0000 7fd112a00700 1 -- 172.21.15.82:0/2767605135 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd10c00f450 con 0x7fd11c1099e0 2024-05-03T22:16:53.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.662+0000 7fd12b495b80 1 Processor -- start 2024-05-03T22:16:53.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.662+0000 7fd12b495b80 1 -- start start 2024-05-03T22:16:53.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55922661eb80 0x55922661ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559226618ee0 0x559226619360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x559226625940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd12b495b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55922656b9d0 con 0x55922661eb80 2024-05-03T22:16:53.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd12b495b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559226509710 con 0x559226618ee0 2024-05-03T22:16:53.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd12b495b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559226567990 con 0x5592266198a0 2024-05-03T22:16:53.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd112a00700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd1000b2990 0x7fd1000b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd11a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55922661eb80 0x55922661ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd112a00700 1 -- 172.21.15.82:0/2767605135 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fd10c0e2800 con 0x7fd11c1099e0 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd11a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55922661eb80 0x55922661ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46682/0 (socket says 172.21.15.82:46682) 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd11a800700 1 -- 172.21.15.82:0/1260117611 learned_addr learned my addr 172.21.15.82:0/1260117611 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.663+0000 7fd11a800700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd1000b2990 0x7fd1000b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.664+0000 7fd119400700 1 --2- 172.21.15.82:0/1260117611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x559226625940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.664+0000 7fd119e00700 1 --2- 172.21.15.82:0/1260117611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559226618ee0 0x559226619360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.664+0000 7fd11a800700 1 -- 172.21.15.82:0/1260117611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 msgr2=0x559226625940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.664+0000 7fd11a800700 1 --2- 172.21.15.82:0/1260117611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x559226625940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.664+0000 7fd11a800700 1 -- 172.21.15.82:0/1260117611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559226618ee0 msgr2=0x559226619360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.664+0000 7fd11a800700 1 --2- 172.21.15.82:0/1260117611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559226618ee0 0x559226619360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.664+0000 7fd11a800700 1 -- 172.21.15.82:0/1260117611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592264b8880 con 0x55922661eb80 2024-05-03T22:16:53.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.664+0000 7fd119400700 1 --2- 172.21.15.82:0/1260117611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x559226625940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:16:53.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.664+0000 7fd11a800700 1 --2- 172.21.15.82:0/1260117611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55922661eb80 0x55922661ef60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd11400af30 tx=0x7fd114016550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef3f5d6a9532b16 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.665+0000 7fd11a800700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd1000b2990 0x7fd1000b4e50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd114009fd0 tx=0x7fd11401a000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.665+0000 7fd107400700 1 -- 172.21.15.82:0/1260117611 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114026070 con 0x55922661eb80 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.665+0000 7fd107400700 1 -- 172.21.15.82:0/1260117611 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd114009d30 con 0x55922661eb80 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.665+0000 7fd107400700 1 -- 172.21.15.82:0/1260117611 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114013040 con 0x55922661eb80 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.666+0000 7fd12b495b80 1 -- 172.21.15.82:0/1260117611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55922661eb80 msgr2=0x55922661ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.666+0000 7fd12b495b80 1 --2- 172.21.15.82:0/1260117611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55922661eb80 0x55922661ef60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd11400af30 tx=0x7fd114016550 comp rx=0 tx=0).stop 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.666+0000 7fd12b495b80 1 -- 172.21.15.82:0/1260117611 shutdown_connections 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.666+0000 7fd12b495b80 1 --2- 172.21.15.82:0/1260117611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55922661eb80 0x55922661ef60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.666+0000 7fd12b495b80 1 --2- 172.21.15.82:0/1260117611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x559226625940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.666+0000 7fd12b495b80 1 --2- 172.21.15.82:0/1260117611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559226618ee0 0x559226619360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.666+0000 7fd12b495b80 1 -- 172.21.15.82:0/1260117611 >> 172.21.15.82:0/1260117611 conn(0x559226591680 msgr2=0x559226613b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.666+0000 7fd12b495b80 1 -- 172.21.15.82:0/1260117611 shutdown_connections 2024-05-03T22:16:53.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.666+0000 7fd12b495b80 1 -- 172.21.15.82:0/1260117611 wait complete. 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.667+0000 7fd12b495b80 1 -- start start 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.667+0000 7fd12b495b80 1 Processor -- start 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.667+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x559226625540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.667+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x5592266228e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.667+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55922661eb80 0x559226622e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.667+0000 7fd12b495b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559226625e80 con 0x559226618ee0 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.667+0000 7fd12b495b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5592264d1ad0 con 0x55922661eb80 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.667+0000 7fd12b495b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559226626000 con 0x5592266198a0 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.667+0000 7fd12b495b80 10 client.0 _ll_register_callbacks cb 0x559226512c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd119e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x559226625540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd119e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x559226625540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46694/0 (socket says 172.21.15.82:46694) 2024-05-03T22:16:53.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd119e00700 1 -- 172.21.15.82:0/2473110907 learned_addr learned my addr 172.21.15.82:0/2473110907 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:53.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd119400700 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x5592266228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd11a800700 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55922661eb80 0x559226622e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd119e00700 1 -- 172.21.15.82:0/2473110907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 msgr2=0x5592266228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:53.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd119e00700 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x5592266228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd119e00700 1 -- 172.21.15.82:0/2473110907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55922661eb80 msgr2=0x559226622e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:53.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd119e00700 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55922661eb80 0x559226622e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd119e00700 1 -- 172.21.15.82:0/2473110907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592265313d0 con 0x559226618ee0 2024-05-03T22:16:53.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd119400700 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x5592266228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd119e00700 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x559226625540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0a95a0 tx=0x7fd10c0773b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e205781e2228ac9 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.668+0000 7fd0fbe00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:16:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.669+0000 7fd0fbe00700 1 -- 172.21.15.82:0/2473110907 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c0a98a0 con 0x559226618ee0 2024-05-03T22:16:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.669+0000 7fd0fbe00700 1 -- 172.21.15.82:0/2473110907 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fd10c0dffe0 con 0x559226618ee0 2024-05-03T22:16:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.669+0000 7fd12b495b80 1 -- 172.21.15.82:0/2473110907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd114009d30 con 0x559226618ee0 2024-05-03T22:16:53.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.670+0000 7fd0fbe00700 1 -- 172.21.15.82:0/2473110907 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd10c0adc50 con 0x559226618ee0 2024-05-03T22:16:53.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.670+0000 7fd12b495b80 10 client.15069 fetch_fsmap learned FSMap version 29 2024-05-03T22:16:53.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.670+0000 7fd12b495b80 1 -- 172.21.15.82:0/2473110907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592266306a0 con 0x559226618ee0 2024-05-03T22:16:53.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.670+0000 7fd0fbe00700 1 -- 172.21.15.82:0/2473110907 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd114009d30 con 0x559226618ee0 2024-05-03T22:16:53.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.670+0000 7fd0fbe00700 1 -- 172.21.15.82:0/2473110907 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd10c0aabd0 con 0x559226618ee0 2024-05-03T22:16:53.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.670+0000 7fd12b495b80 10 client.15069 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:16:53.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.670+0000 7fd12b495b80 10 client.15069 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T22:16:53.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.670+0000 7fd12b495b80 20 client.15069 populate_metadata read hostname 'smithi082' 2024-05-03T22:16:53.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.670+0000 7fd12b495b80 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x559226632c90 0x559226634100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.670+0000 7fd12b495b80 4 client.15069 mds_command: new command op to 34403 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:16:53.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.670+0000 7fd12b495b80 1 -- 172.21.15.82:0/2473110907 --> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592265e5fa0 con 0x559226632c90 2024-05-03T22:16:53.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.671+0000 7fd119400700 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x559226632c90 0x559226634100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.672+0000 7fd119400700 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x559226632c90 0x559226634100 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=83b7db29a84de926 server_cookie=676ba8297c2d8ad3 in_seq=0 out_seq=0 2024-05-03T22:16:53.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.672+0000 7fd0fbe00700 10 client.15069 ms_handle_connect on v2:172.21.15.116:6832/1484646572 2024-05-03T22:16:53.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd0fbe00700 1 -- 172.21.15.82:0/2473110907 <== mds.3 v2:172.21.15.116:6832/1484646572 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5592265e5fa0 con 0x559226632c90 2024-05-03T22:16:53.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd0fbe00700 10 client.15069 handle_command_reply: tid=0 2024-05-03T22:16:53.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 1 client.15069 shutdown 2024-05-03T22:16:53.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 1 -- 172.21.15.82:0/2473110907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 msgr2=0x559226625540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:53.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x559226625540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0a95a0 tx=0x7fd10c0773b0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 1 -- 172.21.15.82:0/2473110907 shutdown_connections 2024-05-03T22:16:53.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x559226632c90 0x559226634100 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x559226625540 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55922661eb80 0x559226622e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 1 --2- 172.21.15.82:0/2473110907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x5592266228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 1 -- 172.21.15.82:0/2473110907 >> 172.21.15.82:0/2473110907 conn(0x559226591680 msgr2=0x559226617ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:53.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd0fbe00700 0 client.15069 ms_handle_reset on v2:172.21.15.116:6832/1484646572 2024-05-03T22:16:53.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 1 -- 172.21.15.82:0/2473110907 shutdown_connections 2024-05-03T22:16:53.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 1 -- 172.21.15.82:0/2473110907 wait complete. 2024-05-03T22:16:53.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.675+0000 7fd12b495b80 20 client.15069 trim_cache size 0 max 16384 2024-05-03T22:16:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.698+0000 7fd12b495b80 1 Processor -- start 2024-05-03T22:16:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.698+0000 7fd12b495b80 1 -- start start 2024-05-03T22:16:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.698+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x5592266211d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.698+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x559226621710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.698+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55922661eb80 0x55922663d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.698+0000 7fd12b495b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559226632440 con 0x559226618ee0 2024-05-03T22:16:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.698+0000 7fd12b495b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559226632b10 con 0x55922661eb80 2024-05-03T22:16:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.698+0000 7fd12b495b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5592266331e0 con 0x5592266198a0 2024-05-03T22:16:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.698+0000 7fd119e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x5592266211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.699+0000 7fd119e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x5592266211d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46700/0 (socket says 172.21.15.82:46700) 2024-05-03T22:16:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.699+0000 7fd119e00700 1 -- 172.21.15.82:0/802527587 learned_addr learned my addr 172.21.15.82:0/802527587 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.699+0000 7fd11a800700 1 --2- 172.21.15.82:0/802527587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55922661eb80 0x55922663d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.699+0000 7fd119400700 1 --2- 172.21.15.82:0/802527587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x559226621710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.699+0000 7fd119e00700 1 -- 172.21.15.82:0/802527587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 msgr2=0x559226621710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:53.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.699+0000 7fd119e00700 1 --2- 172.21.15.82:0/802527587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x559226621710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.699+0000 7fd119e00700 1 -- 172.21.15.82:0/802527587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55922661eb80 msgr2=0x55922663d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:53.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.699+0000 7fd119e00700 1 --2- 172.21.15.82:0/802527587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55922661eb80 0x55922663d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.699+0000 7fd119e00700 1 -- 172.21.15.82:0/802527587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592265e5f80 con 0x559226618ee0 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.699+0000 7fd119e00700 1 --2- 172.21.15.82:0/802527587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x5592266211d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd10c000c00 tx=0x7fd10c0a90e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe73c7324c6a433d server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.700+0000 7fd106a00700 1 -- 172.21.15.82:0/802527587 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c0b2700 con 0x559226618ee0 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.700+0000 7fd106a00700 1 -- 172.21.15.82:0/802527587 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd10c073070 con 0x559226618ee0 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.700+0000 7fd106a00700 1 -- 172.21.15.82:0/802527587 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c0a8b00 con 0x559226618ee0 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.700+0000 7fd12b495b80 1 -- 172.21.15.82:0/802527587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 msgr2=0x5592266211d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.700+0000 7fd12b495b80 1 --2- 172.21.15.82:0/802527587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x5592266211d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd10c000c00 tx=0x7fd10c0a90e0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.701+0000 7fd12b495b80 1 -- 172.21.15.82:0/802527587 shutdown_connections 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.701+0000 7fd12b495b80 1 --2- 172.21.15.82:0/802527587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559226618ee0 0x5592266211d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.701+0000 7fd12b495b80 1 --2- 172.21.15.82:0/802527587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55922661eb80 0x55922663d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.701+0000 7fd12b495b80 1 --2- 172.21.15.82:0/802527587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592266198a0 0x559226621710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.701+0000 7fd12b495b80 1 -- 172.21.15.82:0/802527587 >> 172.21.15.82:0/802527587 conn(0x559226591680 msgr2=0x559226613660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.701+0000 7fd12b495b80 1 -- 172.21.15.82:0/802527587 shutdown_connections 2024-05-03T22:16:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.701+0000 7fd12b495b80 1 -- 172.21.15.82:0/802527587 wait complete. 2024-05-03T22:16:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.701+0000 7fd12b495b80 1 -- start start 2024-05-03T22:16:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.701+0000 7fd12b495b80 1 Processor -- start 2024-05-03T22:16:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559226618ee0 0x559226624300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592266198a0 0x559226624840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd12b495b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55922661eb80 0x559226624d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd12b495b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559226633f80 con 0x5592266198a0 2024-05-03T22:16:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd12b495b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5592266338b0 con 0x559226618ee0 2024-05-03T22:16:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd12b495b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559226634650 con 0x55922661eb80 2024-05-03T22:16:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd12b495b80 10 client.0 _ll_register_callbacks cb 0x559226512c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:16:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd119400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592266198a0 0x559226624840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd119400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592266198a0 0x559226624840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46714/0 (socket says 172.21.15.82:46714) 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd119400700 1 -- 172.21.15.82:0/1313095478 learned_addr learned my addr 172.21.15.82:0/1313095478 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd119e00700 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559226618ee0 0x559226624300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd11a800700 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55922661eb80 0x559226624d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd119400700 1 -- 172.21.15.82:0/1313095478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55922661eb80 msgr2=0x559226624d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd119400700 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55922661eb80 0x559226624d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd119400700 1 -- 172.21.15.82:0/1313095478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559226618ee0 msgr2=0x559226624300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.702+0000 7fd119400700 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559226618ee0 0x559226624300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.703+0000 7fd119400700 1 -- 172.21.15.82:0/1313095478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559226610450 con 0x5592266198a0 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.703+0000 7fd11a800700 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55922661eb80 0x559226624d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.703+0000 7fd119e00700 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559226618ee0 0x559226624300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.703+0000 7fd119400700 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592266198a0 0x559226624840 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd108006010 tx=0x7fd1080096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba0f725db0040fa server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.703+0000 7fd0fbe00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.703+0000 7fd0fbe00700 1 -- 172.21.15.82:0/1313095478 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1080039c0 con 0x5592266198a0 2024-05-03T22:16:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.703+0000 7fd12b495b80 1 -- 172.21.15.82:0/1313095478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd10c073070 con 0x5592266198a0 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.703+0000 7fd0fbe00700 1 -- 172.21.15.82:0/1313095478 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fd108003b60 con 0x5592266198a0 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.704+0000 7fd0fbe00700 1 -- 172.21.15.82:0/1313095478 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd108038050 con 0x5592266198a0 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.704+0000 7fd12b495b80 10 client.15075 fetch_fsmap learned FSMap version 29 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.704+0000 7fd12b495b80 1 -- 172.21.15.82:0/1313095478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55922669e580 con 0x5592266198a0 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.704+0000 7fd0fbe00700 1 -- 172.21.15.82:0/1313095478 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd10c073070 con 0x5592266198a0 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.704+0000 7fd0fbe00700 1 -- 172.21.15.82:0/1313095478 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd10800f460 con 0x5592266198a0 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.704+0000 7fd12b495b80 10 client.15075 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.704+0000 7fd12b495b80 10 client.15075 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.704+0000 7fd12b495b80 20 client.15075 populate_metadata read hostname 'smithi082' 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.704+0000 7fd12b495b80 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x5592266a3190 0x5592266a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.704+0000 7fd12b495b80 4 client.15075 mds_command: new command op to 34403 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:16:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.704+0000 7fd12b495b80 1 -- 172.21.15.82:0/1313095478 --> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] -- command(tid 0: {"prefix": "status"}) -- 0x5592265793b0 con 0x5592266a3190 2024-05-03T22:16:53.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.705+0000 7fd119e00700 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x5592266a3190 0x5592266a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.706+0000 7fd119e00700 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x5592266a3190 0x5592266a1ea0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e34974fe4a1d86b2 server_cookie=84d842fb90cc6302 in_seq=0 out_seq=0 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.706+0000 7fd0fbe00700 10 client.15075 ms_handle_connect on v2:172.21.15.116:6832/1484646572 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.706+0000 7fd0fbe00700 1 -- 172.21.15.82:0/1313095478 <== mds.3 v2:172.21.15.116:6832/1484646572 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5592265793b0 con 0x5592266a3190 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.706+0000 7fd0fbe00700 10 client.15075 handle_command_reply: tid=0 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.706+0000 7fd12b495b80 1 client.15075 shutdown 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd12b495b80 1 -- 172.21.15.82:0/1313095478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592266198a0 msgr2=0x559226624840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd12b495b80 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592266198a0 0x559226624840 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd108006010 tx=0x7fd1080096a0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd12b495b80 1 -- 172.21.15.82:0/1313095478 shutdown_connections 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd12b495b80 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x5592266a3190 0x5592266a1ea0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd12b495b80 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55922661eb80 0x559226624d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd12b495b80 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559226618ee0 0x559226624300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd12b495b80 1 --2- 172.21.15.82:0/1313095478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592266198a0 0x559226624840 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd12b495b80 1 -- 172.21.15.82:0/1313095478 >> 172.21.15.82:0/1313095478 conn(0x559226591680 msgr2=0x559226617ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:53.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd0fbe00700 0 client.15075 ms_handle_reset on v2:172.21.15.116:6832/1484646572 2024-05-03T22:16:53.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd12b495b80 1 -- 172.21.15.82:0/1313095478 shutdown_connections 2024-05-03T22:16:53.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd12b495b80 1 -- 172.21.15.82:0/1313095478 wait complete. 2024-05-03T22:16:53.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.707+0000 7fd12b495b80 20 client.15075 trim_cache size 0 max 16384 2024-05-03T22:16:53.711 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:16:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:16:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 3, 2024-05-03T22:16:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 34403, 2024-05-03T22:16:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-03T22:16:53.711 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-03T22:16:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-03T22:16:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 169.61428124099999, 2024-05-03T22:16:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 29, 2024-05-03T22:16:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-05-03T22:16:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-05-03T22:16:53.712 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 322.58456757599998 2024-05-03T22:16:53.712 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 -- 172.21.15.82:0/2767605135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd1000b2990 msgr2=0x7fd1000b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd1000b2990 0x7fd1000b4e50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd114009fd0 tx=0x7fd11401a000 comp rx=0 tx=0).stop 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 -- 172.21.15.82:0/2767605135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c1099e0 msgr2=0x7fd11c19ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c1099e0 0x7fd11c19ff80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00c9b0 tx=0x7fd10c00cd70 comp rx=0 tx=0).stop 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 -- 172.21.15.82:0/2767605135 shutdown_connections 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd1000b2990 0x7fd1000b4e50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c1099e0 0x7fd11c19ff80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd11c10f9d0 0x7fd11c1a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 --2- 172.21.15.82:0/2767605135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd11c10a3a0 0x7fd11c1a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 -- 172.21.15.82:0/2767605135 >> 172.21.15.82:0/2767605135 conn(0x7fd11c079200 msgr2=0x7fd11c079740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 -- 172.21.15.82:0/2767605135 shutdown_connections 2024-05-03T22:16:53.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:53.708+0000 7fd11b200700 1 -- 172.21.15.82:0/2767605135 wait complete. 2024-05-03T22:16:54.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:54 smithi082 ceph-mon[28404]: pgmap v510: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:54.614 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:54 smithi130 ceph-mon[32417]: pgmap v510: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:54.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:54 smithi116 ceph-mon[31828]: pgmap v510: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:16:54.826 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell mds.e status 2024-05-03T22:16:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:16:56.475 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:56 smithi082 ceph-mon[28404]: pgmap v511: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:56 smithi130 ceph-mon[32417]: pgmap v511: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:56 smithi116 ceph-mon[31828]: pgmap v511: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:16:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.865+0000 7f9d04000700 1 -- 172.21.15.82:0/3754213387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc06b180 msgr2=0x7f9cfc06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.865+0000 7f9d04000700 1 --2- 172.21.15.82:0/3754213387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc06b180 0x7f9cfc06b600 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009990 tx=0x7f9ce8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.865+0000 7f9d04000700 1 -- 172.21.15.82:0/3754213387 shutdown_connections 2024-05-03T22:16:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.865+0000 7f9d04000700 1 --2- 172.21.15.82:0/3754213387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cfc06bb40 0x7f9cfc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.865+0000 7f9d04000700 1 --2- 172.21.15.82:0/3754213387 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9cfc109510 0x7f9cfc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.865+0000 7f9d04000700 1 --2- 172.21.15.82:0/3754213387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc06b180 0x7f9cfc06b600 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.865+0000 7f9d04000700 1 -- 172.21.15.82:0/3754213387 >> 172.21.15.82:0/3754213387 conn(0x7f9cfc079350 msgr2=0x7f9cfc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.865+0000 7f9d04000700 1 -- 172.21.15.82:0/3754213387 shutdown_connections 2024-05-03T22:16:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.865+0000 7f9d04000700 1 -- 172.21.15.82:0/3754213387 wait complete. 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.867+0000 7f9d04000700 1 Processor -- start 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.867+0000 7f9d04000700 1 -- start start 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.867+0000 7f9d04000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cfc06b180 0x7f9cfc1a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.867+0000 7f9d04000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc06bb40 0x7f9cfc1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.867+0000 7f9d04000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9cfc109510 0x7f9cfc19bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.867+0000 7f9d04000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc113520 con 0x7f9cfc06bb40 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.867+0000 7f9d04000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc1133a0 con 0x7f9cfc109510 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.867+0000 7f9d04000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc1136a0 con 0x7f9cfc06b180 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.868+0000 7f9d00c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc06bb40 0x7f9cfc1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.868+0000 7f9d00c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc06bb40 0x7f9cfc1a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38574/0 (socket says 172.21.15.82:38574) 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.868+0000 7f9d00c00700 1 -- 172.21.15.82:0/1682245948 learned_addr learned my addr 172.21.15.82:0/1682245948 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.868+0000 7f9d02000700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9cfc109510 0x7f9cfc19bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.868+0000 7f9d01600700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cfc06b180 0x7f9cfc1a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.868+0000 7f9d00c00700 1 -- 172.21.15.82:0/1682245948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cfc06b180 msgr2=0x7f9cfc1a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:57.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.868+0000 7f9d00c00700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cfc06b180 0x7f9cfc1a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.868+0000 7f9d00c00700 1 -- 172.21.15.82:0/1682245948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9cfc109510 msgr2=0x7f9cfc19bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:57.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.868+0000 7f9d00c00700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9cfc109510 0x7f9cfc19bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.868+0000 7f9d00c00700 1 -- 172.21.15.82:0/1682245948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cfc19c400 con 0x7f9cfc06bb40 2024-05-03T22:16:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.868+0000 7f9d00c00700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc06bb40 0x7f9cfc1a1f90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8000c00 tx=0x7f9ce80036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.869+0000 7f9cfa000700 1 -- 172.21.15.82:0/1682245948 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8027070 con 0x7f9cfc06bb40 2024-05-03T22:16:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.869+0000 7f9d04000700 1 -- 172.21.15.82:0/1682245948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cfc19c690 con 0x7f9cfc06bb40 2024-05-03T22:16:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.869+0000 7f9cfa000700 1 -- 172.21.15.82:0/1682245948 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ce800fc80 con 0x7f9cfc06bb40 2024-05-03T22:16:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.869+0000 7f9cfa000700 1 -- 172.21.15.82:0/1682245948 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8022d60 con 0x7f9cfc06bb40 2024-05-03T22:16:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.869+0000 7f9d04000700 1 -- 172.21.15.82:0/1682245948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cfc1a89d0 con 0x7f9cfc06bb40 2024-05-03T22:16:57.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.872+0000 7f9cfa000700 1 -- 172.21.15.82:0/1682245948 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9ce802a070 con 0x7f9cfc06bb40 2024-05-03T22:16:57.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.874+0000 7f9d0e900b80 1 Processor -- start 2024-05-03T22:16:57.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.874+0000 7f9cfa000700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f9ce40b2990 0x7f9ce40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.874+0000 7f9d0e900b80 1 -- start start 2024-05-03T22:16:57.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.874+0000 7f9cfa000700 1 -- 172.21.15.82:0/1682245948 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f9ce80e3690 con 0x7f9cfc06bb40 2024-05-03T22:16:57.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.874+0000 7f9d02000700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f9ce40b2990 0x7f9ce40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.874+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be7760 0x55ee53be7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.874+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be8080 0x55ee53be2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.874+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53be39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.874+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ee53b359d0 con 0x55ee53be3580 2024-05-03T22:16:57.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.874+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ee53ad3710 con 0x55ee53be8080 2024-05-03T22:16:57.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.874+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee53b31990 con 0x55ee53be7760 2024-05-03T22:16:57.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.875+0000 7f9d02000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53be39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.875+0000 7f9d02000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53be39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38578/0 (socket says 172.21.15.82:38578) 2024-05-03T22:16:57.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.875+0000 7f9d02000700 1 -- 172.21.15.82:0/402934945 learned_addr learned my addr 172.21.15.82:0/402934945 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:57.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.875+0000 7f9d01600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be7760 0x55ee53be7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.875+0000 7f9d00c00700 1 --2- 172.21.15.82:0/402934945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be8080 0x55ee53be2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.875+0000 7f9d02000700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f9ce40b2990 0x7f9ce40b4e50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4008500 tx=0x7f9cf40088c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:57.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.875+0000 7f9d02000700 1 -- 172.21.15.82:0/402934945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be7760 msgr2=0x55ee53be7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:57.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.875+0000 7f9d02000700 1 --2- 172.21.15.82:0/402934945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be7760 0x55ee53be7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.875+0000 7f9d02000700 1 -- 172.21.15.82:0/402934945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be8080 msgr2=0x55ee53be2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:57.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.875+0000 7f9d02000700 1 --2- 172.21.15.82:0/402934945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be8080 0x55ee53be2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.876+0000 7f9d02000700 1 -- 172.21.15.82:0/402934945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee53a82880 con 0x55ee53be3580 2024-05-03T22:16:57.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.876+0000 7f9d01600700 1 --2- 172.21.15.82:0/402934945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be7760 0x55ee53be7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:16:57.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.876+0000 7f9d02000700 1 --2- 172.21.15.82:0/402934945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53be39e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4019670 tx=0x7f9cf4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db37154c8dd5bef6 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:57.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.876+0000 7f9ceea00700 1 -- 172.21.15.82:0/402934945 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4026070 con 0x55ee53be3580 2024-05-03T22:16:57.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.876+0000 7f9ceea00700 1 -- 172.21.15.82:0/402934945 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cf4019e10 con 0x55ee53be3580 2024-05-03T22:16:57.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.876+0000 7f9ceea00700 1 -- 172.21.15.82:0/402934945 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4021980 con 0x55ee53be3580 2024-05-03T22:16:57.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.877+0000 7f9d0e900b80 1 -- 172.21.15.82:0/402934945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 msgr2=0x55ee53be39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:57.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.877+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/402934945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53be39e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4019670 tx=0x7f9cf4019000 comp rx=0 tx=0).stop 2024-05-03T22:16:57.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.877+0000 7f9d0e900b80 1 -- 172.21.15.82:0/402934945 shutdown_connections 2024-05-03T22:16:57.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.877+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/402934945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53be39e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.877+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/402934945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be7760 0x55ee53be7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.877+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/402934945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be8080 0x55ee53be2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.877+0000 7f9d0e900b80 1 -- 172.21.15.82:0/402934945 >> 172.21.15.82:0/402934945 conn(0x55ee53b11b10 msgr2=0x55ee53bdd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:57.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.877+0000 7f9d0e900b80 1 -- 172.21.15.82:0/402934945 shutdown_connections 2024-05-03T22:16:57.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.877+0000 7f9d0e900b80 1 -- 172.21.15.82:0/402934945 wait complete. 2024-05-03T22:16:57.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.878+0000 7f9d0e900b80 1 -- start start 2024-05-03T22:16:57.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.878+0000 7f9d0e900b80 1 Processor -- start 2024-05-03T22:16:57.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53beeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be7760 0x55ee53bec260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be8080 0x55ee53bec7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ee53befc50 con 0x55ee53be3580 2024-05-03T22:16:57.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ee53a9bad0 con 0x55ee53be7760 2024-05-03T22:16:57.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee53befdd0 con 0x55ee53be8080 2024-05-03T22:16:57.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d0e900b80 10 client.0 _ll_register_callbacks cb 0x55ee53adcc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:16:57.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d01600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53beeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d01600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53beeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38586/0 (socket says 172.21.15.82:38586) 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d01600700 1 -- 172.21.15.82:0/921597659 learned_addr learned my addr 172.21.15.82:0/921597659 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d00c00700 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be7760 0x55ee53bec260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d02000700 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be8080 0x55ee53bec7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d01600700 1 -- 172.21.15.82:0/921597659 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be8080 msgr2=0x55ee53bec7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.879+0000 7f9d01600700 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be8080 0x55ee53bec7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.880+0000 7f9d01600700 1 -- 172.21.15.82:0/921597659 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be7760 msgr2=0x55ee53bec260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.880+0000 7f9d01600700 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be7760 0x55ee53bec260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.880+0000 7f9d01600700 1 -- 172.21.15.82:0/921597659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee53afb3d0 con 0x55ee53be3580 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.880+0000 7f9d00c00700 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be7760 0x55ee53bec260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.880+0000 7f9d01600700 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53beeec0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0010820 tx=0x7f9cf0010be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5701f421292b86 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.880+0000 7f9ce3400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.880+0000 7f9ce3400700 1 -- 172.21.15.82:0/921597659 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000ca90 con 0x55ee53be3580 2024-05-03T22:16:57.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.880+0000 7f9ce3400700 1 -- 172.21.15.82:0/921597659 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f9cf000cc30 con 0x55ee53be3580 2024-05-03T22:16:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.880+0000 7f9d0e900b80 1 -- 172.21.15.82:0/921597659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cf4019e10 con 0x55ee53be3580 2024-05-03T22:16:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.881+0000 7f9ce3400700 1 -- 172.21.15.82:0/921597659 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9cf0025050 con 0x55ee53be3580 2024-05-03T22:16:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.881+0000 7f9d0e900b80 10 client.15087 fetch_fsmap learned FSMap version 29 2024-05-03T22:16:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.881+0000 7f9d0e900b80 1 -- 172.21.15.82:0/921597659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ee53bfa5a0 con 0x55ee53be3580 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.881+0000 7f9ce3400700 1 -- 172.21.15.82:0/921597659 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cf4019e10 con 0x55ee53be3580 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.881+0000 7f9ce3400700 1 -- 172.21.15.82:0/921597659 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9cf0011440 con 0x55ee53be3580 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.881+0000 7f9d0e900b80 10 client.15087 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.881+0000 7f9d0e900b80 10 client.15087 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.881+0000 7f9d0e900b80 20 client.15087 populate_metadata read hostname 'smithi082' 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.881+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x55ee53bfcbd0 0x55ee53bfe040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.881+0000 7f9d0e900b80 4 client.15087 mds_command: new command op to 34412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.881+0000 7f9d0e900b80 1 -- 172.21.15.82:0/921597659 --> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee53bb0180 con 0x55ee53bfcbd0 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.882+0000 7f9d00c00700 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x55ee53bfcbd0 0x55ee53bfe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.883+0000 7f9d00c00700 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x55ee53bfcbd0 0x55ee53bfe040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b16a1de395fad16f server_cookie=77a9c771f824bff1 in_seq=0 out_seq=0 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.883+0000 7f9ce3400700 10 client.15087 ms_handle_connect on v2:172.21.15.116:6834/1544765094 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.885+0000 7f9ce3400700 1 -- 172.21.15.82:0/921597659 <== mds.2 v2:172.21.15.116:6834/1544765094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ee53bb0180 con 0x55ee53bfcbd0 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.885+0000 7f9ce3400700 10 client.15087 handle_command_reply: tid=0 2024-05-03T22:16:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 1 client.15087 shutdown 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 1 -- 172.21.15.82:0/921597659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 msgr2=0x55ee53beeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53beeec0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0010820 tx=0x7f9cf0010be0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 1 -- 172.21.15.82:0/921597659 shutdown_connections 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x55ee53bfcbd0 0x55ee53bfe040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53beeec0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be8080 0x55ee53bec7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/921597659 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be7760 0x55ee53bec260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9ce3400700 0 client.15087 ms_handle_reset on v2:172.21.15.116:6834/1544765094 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 1 -- 172.21.15.82:0/921597659 >> 172.21.15.82:0/921597659 conn(0x55ee53b11b10 msgr2=0x55ee53be8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 1 -- 172.21.15.82:0/921597659 shutdown_connections 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 1 -- 172.21.15.82:0/921597659 wait complete. 2024-05-03T22:16:57.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.886+0000 7f9d0e900b80 20 client.15087 trim_cache size 0 max 16384 2024-05-03T22:16:57.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.909+0000 7f9d0e900b80 1 Processor -- start 2024-05-03T22:16:57.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.909+0000 7f9d0e900b80 1 -- start start 2024-05-03T22:16:57.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.909+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53bfc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.909+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be7760 0x55ee53bdd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.909+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be8080 0x55ee53be0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.909+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ee53bfc380 con 0x55ee53be3580 2024-05-03T22:16:57.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.909+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ee53bfca50 con 0x55ee53be7760 2024-05-03T22:16:57.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.909+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee53bfd120 con 0x55ee53be8080 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.909+0000 7f9d01600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53bfc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.910+0000 7f9d01600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53bfc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38588/0 (socket says 172.21.15.82:38588) 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.910+0000 7f9d01600700 1 -- 172.21.15.82:0/563575882 learned_addr learned my addr 172.21.15.82:0/563575882 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.910+0000 7f9d00c00700 1 --2- 172.21.15.82:0/563575882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be7760 0x55ee53bdd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.910+0000 7f9d02000700 1 --2- 172.21.15.82:0/563575882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be8080 0x55ee53be0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.910+0000 7f9d01600700 1 -- 172.21.15.82:0/563575882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be8080 msgr2=0x55ee53be0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.910+0000 7f9d01600700 1 --2- 172.21.15.82:0/563575882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be8080 0x55ee53be0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.910+0000 7f9d01600700 1 -- 172.21.15.82:0/563575882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be7760 msgr2=0x55ee53bdd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.910+0000 7f9d01600700 1 --2- 172.21.15.82:0/563575882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be7760 0x55ee53bdd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.910+0000 7f9d01600700 1 -- 172.21.15.82:0/563575882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee53be73b0 con 0x55ee53be3580 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.910+0000 7f9d02000700 1 --2- 172.21.15.82:0/563575882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be8080 0x55ee53be0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.910+0000 7f9d01600700 1 --2- 172.21.15.82:0/563575882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53bfc500 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0011890 tx=0x7f9cf0013e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556b0a86f7557e3d server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:57.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.911+0000 7f9cee000700 1 -- 172.21.15.82:0/563575882 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf002d070 con 0x55ee53be3580 2024-05-03T22:16:57.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.911+0000 7f9cee000700 1 -- 172.21.15.82:0/563575882 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cf0011e50 con 0x55ee53be3580 2024-05-03T22:16:57.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.911+0000 7f9cee000700 1 -- 172.21.15.82:0/563575882 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf00050c0 con 0x55ee53be3580 2024-05-03T22:16:57.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.911+0000 7f9d0e900b80 1 -- 172.21.15.82:0/563575882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 msgr2=0x55ee53bfc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:57.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.911+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/563575882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53bfc500 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0011890 tx=0x7f9cf0013e70 comp rx=0 tx=0).stop 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.912+0000 7f9d0e900b80 1 -- 172.21.15.82:0/563575882 shutdown_connections 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.912+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/563575882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be3580 0x55ee53bfc500 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.912+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/563575882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be8080 0x55ee53be0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.912+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/563575882 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be7760 0x55ee53bdd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.912+0000 7f9d0e900b80 1 -- 172.21.15.82:0/563575882 >> 172.21.15.82:0/563575882 conn(0x55ee53b11b10 msgr2=0x55ee53beab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.912+0000 7f9d0e900b80 1 -- 172.21.15.82:0/563575882 shutdown_connections 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.912+0000 7f9d0e900b80 1 -- 172.21.15.82:0/563575882 wait complete. 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.912+0000 7f9d0e900b80 1 -- start start 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.912+0000 7f9d0e900b80 1 Processor -- start 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.913+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be3580 0x55ee53be0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.913+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be7760 0x55ee53be1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.913+0000 7f9d0e900b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be8080 0x55ee53c03b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.913+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ee53bfdec0 con 0x55ee53be8080 2024-05-03T22:16:57.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.913+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ee53bfd7f0 con 0x55ee53be3580 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.913+0000 7f9d0e900b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee53bfe590 con 0x55ee53be7760 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.913+0000 7f9d0e900b80 10 client.0 _ll_register_callbacks cb 0x55ee53adcc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.913+0000 7f9d02000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be8080 0x55ee53c03b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.913+0000 7f9d02000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be8080 0x55ee53c03b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38600/0 (socket says 172.21.15.82:38600) 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.913+0000 7f9d02000700 1 -- 172.21.15.82:0/1215218469 learned_addr learned my addr 172.21.15.82:0/1215218469 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.913+0000 7f9d00c00700 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be7760 0x55ee53be1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9d01600700 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be3580 0x55ee53be0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9d02000700 1 -- 172.21.15.82:0/1215218469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be7760 msgr2=0x55ee53be1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9d02000700 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be7760 0x55ee53be1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9d02000700 1 -- 172.21.15.82:0/1215218469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be3580 msgr2=0x55ee53be0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9d02000700 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be3580 0x55ee53be0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9d02000700 1 -- 172.21.15.82:0/1215218469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee53c04090 con 0x55ee53be8080 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9d01600700 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be3580 0x55ee53be0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9d02000700 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be8080 0x55ee53c03b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4019670 tx=0x7f9cf4004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8518d897300634b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:16:57.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9ce3400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9ce3400700 1 -- 172.21.15.82:0/1215218469 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf402f020 con 0x55ee53be8080 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9ce3400700 1 -- 172.21.15.82:0/1215218469 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f9cf40175b0 con 0x55ee53be8080 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9d0e900b80 1 -- 172.21.15.82:0/1215218469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cf0011e50 con 0x55ee53be8080 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9ce3400700 1 -- 172.21.15.82:0/1215218469 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9cf403a050 con 0x55ee53be8080 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9d0e900b80 10 client.15093 fetch_fsmap learned FSMap version 29 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.914+0000 7f9d0e900b80 1 -- 172.21.15.82:0/1215218469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ee53c68670 con 0x55ee53be8080 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.915+0000 7f9ce3400700 1 -- 172.21.15.82:0/1215218469 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cf0011e50 con 0x55ee53be8080 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.915+0000 7f9ce3400700 1 -- 172.21.15.82:0/1215218469 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9cf40215f0 con 0x55ee53be8080 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.915+0000 7f9d0e900b80 10 client.15093 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.915+0000 7f9d0e900b80 10 client.15093 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.915+0000 7f9d0e900b80 20 client.15093 populate_metadata read hostname 'smithi082' 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.915+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x55ee53c6d040 0x55ee53c6bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.915+0000 7f9d0e900b80 4 client.15093 mds_command: new command op to 34412 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:16:57.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.915+0000 7f9d0e900b80 1 -- 172.21.15.82:0/1215218469 --> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] -- command(tid 0: {"prefix": "status"}) -- 0x55ee53b433b0 con 0x55ee53c6d040 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.916+0000 7f9d01600700 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x55ee53c6d040 0x55ee53c6bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.916+0000 7f9d01600700 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x55ee53c6d040 0x55ee53c6bd50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7b49d4666b099fd6 server_cookie=df9ee3a3f26e2f46 in_seq=0 out_seq=0 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.916+0000 7f9ce3400700 10 client.15093 ms_handle_connect on v2:172.21.15.116:6834/1544765094 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9ce3400700 1 -- 172.21.15.82:0/1215218469 <== mds.2 v2:172.21.15.116:6834/1544765094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ee53b433b0 con 0x55ee53c6d040 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9ce3400700 10 client.15093 handle_command_reply: tid=0 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9d0e900b80 1 client.15093 shutdown 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9d0e900b80 1 -- 172.21.15.82:0/1215218469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be8080 msgr2=0x55ee53c03b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be8080 0x55ee53c03b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4019670 tx=0x7f9cf4004d70 comp rx=0 tx=0).stop 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9d0e900b80 1 -- 172.21.15.82:0/1215218469 shutdown_connections 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x55ee53c6d040 0x55ee53c6bd50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ee53be8080 0x55ee53c03b50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee53be3580 0x55ee53be0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9d0e900b80 1 --2- 172.21.15.82:0/1215218469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee53be7760 0x55ee53be1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9d0e900b80 1 -- 172.21.15.82:0/1215218469 >> 172.21.15.82:0/1215218469 conn(0x55ee53b11b10 msgr2=0x55ee53beb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:57.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.917+0000 7f9ce3400700 0 client.15093 ms_handle_reset on v2:172.21.15.116:6834/1544765094 2024-05-03T22:16:57.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.918+0000 7f9d0e900b80 1 -- 172.21.15.82:0/1215218469 shutdown_connections 2024-05-03T22:16:57.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.918+0000 7f9d0e900b80 1 -- 172.21.15.82:0/1215218469 wait complete. 2024-05-03T22:16:57.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.918+0000 7f9d0e900b80 20 client.15093 trim_cache size 0 max 16384 2024-05-03T22:16:57.921 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:16:57.921 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:16:57.921 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-05-03T22:16:57.921 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 34412, 2024-05-03T22:16:57.921 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-03T22:16:57.921 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-03T22:16:57.922 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-03T22:16:57.922 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 174.832433807, 2024-05-03T22:16:57.922 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 29, 2024-05-03T22:16:57.922 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-05-03T22:16:57.922 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-05-03T22:16:57.922 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 311.59868081600001 2024-05-03T22:16:57.922 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.918+0000 7f9d04000700 1 -- 172.21.15.82:0/1682245948 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f9ce40b2990 msgr2=0x7f9ce40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.918+0000 7f9d04000700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f9ce40b2990 0x7f9ce40b4e50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4008500 tx=0x7f9cf40088c0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.918+0000 7f9d04000700 1 -- 172.21.15.82:0/1682245948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc06bb40 msgr2=0x7f9cfc1a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.918+0000 7f9d04000700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc06bb40 0x7f9cfc1a1f90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8000c00 tx=0x7f9ce80036f0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.919+0000 7f9d04000700 1 -- 172.21.15.82:0/1682245948 shutdown_connections 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.919+0000 7f9d04000700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f9ce40b2990 0x7f9ce40b4e50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.919+0000 7f9d04000700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9cfc109510 0x7f9cfc19bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.919+0000 7f9d04000700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cfc06b180 0x7f9cfc1a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.919+0000 7f9d04000700 1 --2- 172.21.15.82:0/1682245948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cfc06bb40 0x7f9cfc1a1f90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.919+0000 7f9d04000700 1 -- 172.21.15.82:0/1682245948 >> 172.21.15.82:0/1682245948 conn(0x7f9cfc079350 msgr2=0x7f9cfc10e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.919+0000 7f9d04000700 1 -- 172.21.15.82:0/1682245948 shutdown_connections 2024-05-03T22:16:57.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:16:57.919+0000 7f9d04000700 1 -- 172.21.15.82:0/1682245948 wait complete. 2024-05-03T22:16:58.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:16:58 smithi082 ceph-mon[28404]: pgmap v512: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:58.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:16:58 smithi130 ceph-mon[32417]: pgmap v512: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:58.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:16:58 smithi116 ceph-mon[31828]: pgmap v512: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:16:59.060 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-03T22:16:59.508 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:00.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:00 smithi082 ceph-mon[28404]: pgmap v513: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:00 smithi130 ceph-mon[32417]: pgmap v513: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:00.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:00 smithi116 ceph-mon[31828]: pgmap v513: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:02.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.106+0000 7ff872a00700 1 -- 172.21.15.82:0/1868544717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86c10a490 msgr2=0x7ff86c1169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.106+0000 7ff872a00700 1 --2- 172.21.15.82:0/1868544717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86c10a490 0x7ff86c1169a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff86400b0a0 tx=0x7ff86400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.106+0000 7ff872a00700 1 -- 172.21.15.82:0/1868544717 shutdown_connections 2024-05-03T22:17:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.106+0000 7ff872a00700 1 --2- 172.21.15.82:0/1868544717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86c10a490 0x7ff86c1169a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.106+0000 7ff872a00700 1 --2- 172.21.15.82:0/1868544717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff86c10fb60 0x7ff86c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.106+0000 7ff872a00700 1 --2- 172.21.15.82:0/1868544717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff86c109ad0 0x7ff86c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.106+0000 7ff872a00700 1 -- 172.21.15.82:0/1868544717 >> 172.21.15.82:0/1868544717 conn(0x7ff86c076c70 msgr2=0x7ff86c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.107+0000 7ff872a00700 1 -- 172.21.15.82:0/1868544717 shutdown_connections 2024-05-03T22:17:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.107+0000 7ff872a00700 1 -- 172.21.15.82:0/1868544717 wait complete. 2024-05-03T22:17:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.108+0000 7ff872a00700 1 Processor -- start 2024-05-03T22:17:02.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.108+0000 7ff872a00700 1 -- start start 2024-05-03T22:17:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.109+0000 7ff872a00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff86c109ad0 0x7ff86c1a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.109+0000 7ff872a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86c10a490 0x7ff86c1a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.109+0000 7ff872a00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff86c10fb60 0x7ff86c1a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.109+0000 7ff872a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c119c10 con 0x7ff86c10a490 2024-05-03T22:17:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.109+0000 7ff872a00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c119a90 con 0x7ff86c109ad0 2024-05-03T22:17:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.109+0000 7ff872a00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c119d90 con 0x7ff86c10fb60 2024-05-03T22:17:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.109+0000 7ff86b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86c10a490 0x7ff86c1a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.109+0000 7ff86b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86c10a490 0x7ff86c1a05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38604/0 (socket says 172.21.15.82:38604) 2024-05-03T22:17:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.109+0000 7ff86b400700 1 -- 172.21.15.82:0/855669642 learned_addr learned my addr 172.21.15.82:0/855669642 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.109+0000 7ff870a00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff86c10fb60 0x7ff86c1a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.109+0000 7ff86be00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff86c109ad0 0x7ff86c1a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.110+0000 7ff86b400700 1 -- 172.21.15.82:0/855669642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff86c10fb60 msgr2=0x7ff86c1a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.110+0000 7ff86b400700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff86c10fb60 0x7ff86c1a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.110+0000 7ff86b400700 1 -- 172.21.15.82:0/855669642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff86c109ad0 msgr2=0x7ff86c1a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.110+0000 7ff86b400700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff86c109ad0 0x7ff86c1a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.110+0000 7ff86b400700 1 -- 172.21.15.82:0/855669642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c1a5070 con 0x7ff86c10a490 2024-05-03T22:17:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.110+0000 7ff86be00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff86c109ad0 0x7ff86c1a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:17:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.110+0000 7ff86b400700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86c10a490 0x7ff86c1a05a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff85800b530 tx=0x7ff85800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.110+0000 7ff868c00700 1 -- 172.21.15.82:0/855669642 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858015020 con 0x7ff86c10a490 2024-05-03T22:17:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.110+0000 7ff868c00700 1 -- 172.21.15.82:0/855669642 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff858011cc0 con 0x7ff86c10a490 2024-05-03T22:17:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.110+0000 7ff872a00700 1 -- 172.21.15.82:0/855669642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86c1a5300 con 0x7ff86c10a490 2024-05-03T22:17:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.110+0000 7ff868c00700 1 -- 172.21.15.82:0/855669642 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858010dc0 con 0x7ff86c10a490 2024-05-03T22:17:02.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.111+0000 7ff872a00700 1 -- 172.21.15.82:0/855669642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff86c1acbe0 con 0x7ff86c10a490 2024-05-03T22:17:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.115+0000 7ff87d38cb80 1 Processor -- start 2024-05-03T22:17:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.115+0000 7ff868c00700 1 -- 172.21.15.82:0/855669642 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff858018020 con 0x7ff86c10a490 2024-05-03T22:17:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.116+0000 7ff87d38cb80 1 -- start start 2024-05-03T22:17:02.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.116+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ce760 0x5605fc6ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.116+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6cf080 0x5605fc6c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.116+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ca580 0x5605fc6ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.116+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5605fc61c9d0 con 0x5605fc6ce760 2024-05-03T22:17:02.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.116+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5605fc5ba710 con 0x5605fc6cf080 2024-05-03T22:17:02.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.116+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5605fc618990 con 0x5605fc6ca580 2024-05-03T22:17:02.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.116+0000 7ff870a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ce760 0x5605fc6ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.116+0000 7ff870a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ce760 0x5605fc6ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38618/0 (socket says 172.21.15.82:38618) 2024-05-03T22:17:02.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.116+0000 7ff870a00700 1 -- 172.21.15.82:0/2322518494 learned_addr learned my addr 172.21.15.82:0/2322518494 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:02.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.117+0000 7ff86b400700 1 --2- 172.21.15.82:0/2322518494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ca580 0x5605fc6ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.117+0000 7ff870a00700 1 -- 172.21.15.82:0/2322518494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ca580 msgr2=0x5605fc6ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.117+0000 7ff86be00700 1 --2- 172.21.15.82:0/2322518494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6cf080 0x5605fc6c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.117+0000 7ff870a00700 1 --2- 172.21.15.82:0/2322518494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ca580 0x5605fc6ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.117+0000 7ff870a00700 1 -- 172.21.15.82:0/2322518494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6cf080 msgr2=0x5605fc6c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.117+0000 7ff870a00700 1 --2- 172.21.15.82:0/2322518494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6cf080 0x5605fc6c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.117+0000 7ff870a00700 1 -- 172.21.15.82:0/2322518494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605fc569880 con 0x5605fc6ce760 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.117+0000 7ff868c00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff8500b2990 0x7ff8500b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.117+0000 7ff870a00700 1 --2- 172.21.15.82:0/2322518494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ce760 0x5605fc6ceb40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff86400b0a0 tx=0x7ff864009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575540f15ee1ba7d server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.117+0000 7ff868c00700 1 -- 172.21.15.82:0/855669642 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7ff8580e1e80 con 0x7ff86c10a490 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.118+0000 7ff86be00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff8500b2990 0x7ff8500b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.118+0000 7ff861600700 1 -- 172.21.15.82:0/2322518494 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864020070 con 0x5605fc6ce760 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.118+0000 7ff861600700 1 -- 172.21.15.82:0/2322518494 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff864003c00 con 0x5605fc6ce760 2024-05-03T22:17:02.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.118+0000 7ff861600700 1 -- 172.21.15.82:0/2322518494 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8640052a0 con 0x5605fc6ce760 2024-05-03T22:17:02.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.119+0000 7ff87d38cb80 1 -- 172.21.15.82:0/2322518494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ce760 msgr2=0x5605fc6ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.119+0000 7ff86be00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff8500b2990 0x7ff8500b4e50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00ad00 tx=0x7ff85c00a6e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.119+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/2322518494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ce760 0x5605fc6ceb40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff86400b0a0 tx=0x7ff864009310 comp rx=0 tx=0).stop 2024-05-03T22:17:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.119+0000 7ff87d38cb80 1 -- 172.21.15.82:0/2322518494 shutdown_connections 2024-05-03T22:17:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.119+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/2322518494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ce760 0x5605fc6ceb40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.119+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/2322518494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ca580 0x5605fc6ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.119+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/2322518494 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6cf080 0x5605fc6c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.119+0000 7ff87d38cb80 1 -- 172.21.15.82:0/2322518494 >> 172.21.15.82:0/2322518494 conn(0x5605fc5f8b10 msgr2=0x5605fc6c47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.119+0000 7ff87d38cb80 1 -- 172.21.15.82:0/2322518494 shutdown_connections 2024-05-03T22:17:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.119+0000 7ff87d38cb80 1 -- 172.21.15.82:0/2322518494 wait complete. 2024-05-03T22:17:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.120+0000 7ff87d38cb80 1 -- start start 2024-05-03T22:17:02.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.120+0000 7ff87d38cb80 1 Processor -- start 2024-05-03T22:17:02.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.120+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ca580 0x5605fc6d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.120+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ce760 0x5605fc6d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.120+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6d3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.120+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5605fc6d6bf0 con 0x5605fc6cf080 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.120+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5605fc582ad0 con 0x5605fc6ce760 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.120+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5605fc6d6d70 con 0x5605fc6ca580 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.121+0000 7ff87d38cb80 10 client.0 _ll_register_callbacks cb 0x5605fc5c3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.121+0000 7ff870a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6d3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.121+0000 7ff870a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6d3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38622/0 (socket says 172.21.15.82:38622) 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.121+0000 7ff870a00700 1 -- 172.21.15.82:0/3208007437 learned_addr learned my addr 172.21.15.82:0/3208007437 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.121+0000 7ff86b400700 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ce760 0x5605fc6d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.121+0000 7ff86be00700 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ca580 0x5605fc6d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.121+0000 7ff870a00700 1 -- 172.21.15.82:0/3208007437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ca580 msgr2=0x5605fc6d5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.121+0000 7ff870a00700 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ca580 0x5605fc6d5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.121+0000 7ff870a00700 1 -- 172.21.15.82:0/3208007437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ce760 msgr2=0x5605fc6d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.121+0000 7ff870a00700 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ce760 0x5605fc6d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.121+0000 7ff870a00700 1 -- 172.21.15.82:0/3208007437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605fc5e23d0 con 0x5605fc6cf080 2024-05-03T22:17:02.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.122+0000 7ff870a00700 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6d3780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff86400d010 tx=0x7ff864003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebe6cb3b4ac9dc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:02.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.122+0000 7ff856000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:17:02.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.122+0000 7ff856000700 1 -- 172.21.15.82:0/3208007437 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864020040 con 0x5605fc6cf080 2024-05-03T22:17:02.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.122+0000 7ff856000700 1 -- 172.21.15.82:0/3208007437 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7ff864005240 con 0x5605fc6cf080 2024-05-03T22:17:02.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.122+0000 7ff87d38cb80 1 -- 172.21.15.82:0/3208007437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff864003c00 con 0x5605fc6cf080 2024-05-03T22:17:02.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.122+0000 7ff856000700 1 -- 172.21.15.82:0/3208007437 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff864036050 con 0x5605fc6cf080 2024-05-03T22:17:02.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.122+0000 7ff87d38cb80 10 client.15105 fetch_fsmap learned FSMap version 29 2024-05-03T22:17:02.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.122+0000 7ff87d38cb80 1 -- 172.21.15.82:0/3208007437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605fc6e1440 con 0x5605fc6cf080 2024-05-03T22:17:02.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.123+0000 7ff856000700 1 -- 172.21.15.82:0/3208007437 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff864003c00 con 0x5605fc6cf080 2024-05-03T22:17:02.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.123+0000 7ff856000700 1 -- 172.21.15.82:0/3208007437 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff86402d070 con 0x5605fc6cf080 2024-05-03T22:17:02.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.123+0000 7ff87d38cb80 10 client.15105 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:17:02.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.123+0000 7ff87d38cb80 10 client.15105 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T22:17:02.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.123+0000 7ff87d38cb80 20 client.15105 populate_metadata read hostname 'smithi082' 2024-05-03T22:17:02.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.123+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x5605fc6e2790 0x5605fc6e4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.123+0000 7ff87d38cb80 4 client.15105 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:17:02.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.123+0000 7ff87d38cb80 1 -- 172.21.15.82:0/3208007437 --> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605fc697180 con 0x5605fc6e2790 2024-05-03T22:17:02.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.124+0000 7ff86be00700 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x5605fc6e2790 0x5605fc6e4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.125+0000 7ff86be00700 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x5605fc6e2790 0x5605fc6e4880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=264c9437c1fbe920 server_cookie=614a8f5946e9a6c4 in_seq=0 out_seq=0 2024-05-03T22:17:02.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.125+0000 7ff856000700 10 client.15105 ms_handle_connect on v2:172.21.15.116:6836/2428901446 2024-05-03T22:17:02.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.127+0000 7ff856000700 1 -- 172.21.15.82:0/3208007437 <== mds.1 v2:172.21.15.116:6836/2428901446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5605fc697180 con 0x5605fc6e2790 2024-05-03T22:17:02.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.127+0000 7ff856000700 10 client.15105 handle_command_reply: tid=0 2024-05-03T22:17:02.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.127+0000 7ff87d38cb80 1 client.15105 shutdown 2024-05-03T22:17:02.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff87d38cb80 1 -- 172.21.15.82:0/3208007437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 msgr2=0x5605fc6d3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:02.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6d3780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff86400d010 tx=0x7ff864003ab0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff87d38cb80 1 -- 172.21.15.82:0/3208007437 shutdown_connections 2024-05-03T22:17:02.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x5605fc6e2790 0x5605fc6e4880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6d3780 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ca580 0x5605fc6d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/3208007437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ce760 0x5605fc6d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff856000700 0 client.15105 ms_handle_reset on v2:172.21.15.116:6836/2428901446 2024-05-03T22:17:02.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff87d38cb80 1 -- 172.21.15.82:0/3208007437 >> 172.21.15.82:0/3208007437 conn(0x5605fc5f8b10 msgr2=0x5605fc6cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:02.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff87d38cb80 1 -- 172.21.15.82:0/3208007437 shutdown_connections 2024-05-03T22:17:02.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff87d38cb80 1 -- 172.21.15.82:0/3208007437 wait complete. 2024-05-03T22:17:02.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.128+0000 7ff87d38cb80 20 client.15105 trim_cache size 0 max 16384 2024-05-03T22:17:02.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.151+0000 7ff87d38cb80 1 Processor -- start 2024-05-03T22:17:02.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.151+0000 7ff87d38cb80 1 -- start start 2024-05-03T22:17:02.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.151+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ca580 0x5605fc6d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.151+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ce760 0x5605fc6c4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.151+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6cf080 0x5605fc6cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.151+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5605fc6e2bc0 con 0x5605fc6ca580 2024-05-03T22:17:02.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.151+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5605fc6e3290 con 0x5605fc6ce760 2024-05-03T22:17:02.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.151+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5605fc6e3960 con 0x5605fc6cf080 2024-05-03T22:17:02.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.152+0000 7ff86be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ca580 0x5605fc6d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.152+0000 7ff86be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ca580 0x5605fc6d37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38632/0 (socket says 172.21.15.82:38632) 2024-05-03T22:17:02.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.152+0000 7ff86be00700 1 -- 172.21.15.82:0/1512618614 learned_addr learned my addr 172.21.15.82:0/1512618614 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:02.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.152+0000 7ff86b400700 1 --2- 172.21.15.82:0/1512618614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ce760 0x5605fc6c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.152+0000 7ff870a00700 1 --2- 172.21.15.82:0/1512618614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6cf080 0x5605fc6cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.152+0000 7ff86be00700 1 -- 172.21.15.82:0/1512618614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6cf080 msgr2=0x5605fc6cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:02.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.152+0000 7ff86be00700 1 --2- 172.21.15.82:0/1512618614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6cf080 0x5605fc6cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.152+0000 7ff86be00700 1 -- 172.21.15.82:0/1512618614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ce760 msgr2=0x5605fc6c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:02.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.152+0000 7ff86be00700 1 --2- 172.21.15.82:0/1512618614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ce760 0x5605fc6c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.152+0000 7ff86be00700 1 -- 172.21.15.82:0/1512618614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605fc6cee80 con 0x5605fc6ca580 2024-05-03T22:17:02.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.152+0000 7ff86b400700 1 --2- 172.21.15.82:0/1512618614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ce760 0x5605fc6c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:17:02.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.153+0000 7ff86be00700 1 --2- 172.21.15.82:0/1512618614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ca580 0x5605fc6d37b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00afd0 tx=0x7ff85c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c1b698c2717448 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:02.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.153+0000 7ff860c00700 1 -- 172.21.15.82:0/1512618614 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c020b30 con 0x5605fc6ca580 2024-05-03T22:17:02.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.153+0000 7ff860c00700 1 -- 172.21.15.82:0/1512618614 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff85c0044b0 con 0x5605fc6ca580 2024-05-03T22:17:02.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.153+0000 7ff860c00700 1 -- 172.21.15.82:0/1512618614 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c003e40 con 0x5605fc6ca580 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.154+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1512618614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ca580 msgr2=0x5605fc6d37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.154+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/1512618614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ca580 0x5605fc6d37b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00afd0 tx=0x7ff85c015000 comp rx=0 tx=0).stop 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.154+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1512618614 shutdown_connections 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.154+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/1512618614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6ca580 0x5605fc6d37b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.154+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/1512618614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6cf080 0x5605fc6cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.154+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/1512618614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ce760 0x5605fc6c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.154+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1512618614 >> 172.21.15.82:0/1512618614 conn(0x5605fc5f8b10 msgr2=0x5605fc6cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.154+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1512618614 shutdown_connections 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.154+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1512618614 wait complete. 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.154+0000 7ff87d38cb80 1 -- start start 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.155+0000 7ff87d38cb80 1 Processor -- start 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.155+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ca580 0x5605fc6e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.155+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ce760 0x5605fc6e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.155+0000 7ff87d38cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.155+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5605fc6e4700 con 0x5605fc6cf080 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.155+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5605fc6e4030 con 0x5605fc6ca580 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.155+0000 7ff87d38cb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5605fc6e4dd0 con 0x5605fc6ce760 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.155+0000 7ff87d38cb80 10 client.0 _ll_register_callbacks cb 0x5605fc5c3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.155+0000 7ff870a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff870a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6ebcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38634/0 (socket says 172.21.15.82:38634) 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff870a00700 1 -- 172.21.15.82:0/1837375775 learned_addr learned my addr 172.21.15.82:0/1837375775 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff86be00700 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ca580 0x5605fc6e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff870a00700 1 -- 172.21.15.82:0/1837375775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ce760 msgr2=0x5605fc6e73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff870a00700 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ce760 0x5605fc6e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff870a00700 1 -- 172.21.15.82:0/1837375775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ca580 msgr2=0x5605fc6e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff870a00700 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ca580 0x5605fc6e6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff870a00700 1 -- 172.21.15.82:0/1837375775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605fc6ec2e0 con 0x5605fc6cf080 2024-05-03T22:17:02.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff870a00700 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6ebcf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff864000f80 tx=0x7ff864009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d65c1757170cbb server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:02.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff856000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:17:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff856000700 1 -- 172.21.15.82:0/1837375775 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864020040 con 0x5605fc6cf080 2024-05-03T22:17:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff856000700 1 -- 172.21.15.82:0/1837375775 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7ff864002030 con 0x5605fc6cf080 2024-05-03T22:17:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.156+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1837375775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff85c0044b0 con 0x5605fc6cf080 2024-05-03T22:17:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.157+0000 7ff856000700 1 -- 172.21.15.82:0/1837375775 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff864003de0 con 0x5605fc6cf080 2024-05-03T22:17:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.157+0000 7ff87d38cb80 10 client.15111 fetch_fsmap learned FSMap version 29 2024-05-03T22:17:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.157+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1837375775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605fc6ed610 con 0x5605fc6cf080 2024-05-03T22:17:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.157+0000 7ff856000700 1 -- 172.21.15.82:0/1837375775 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff85c0044b0 con 0x5605fc6cf080 2024-05-03T22:17:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.157+0000 7ff856000700 1 -- 172.21.15.82:0/1837375775 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff86402d040 con 0x5605fc6cf080 2024-05-03T22:17:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.157+0000 7ff87d38cb80 10 client.15111 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:17:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.157+0000 7ff87d38cb80 10 client.15111 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T22:17:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.157+0000 7ff87d38cb80 20 client.15111 populate_metadata read hostname 'smithi082' 2024-05-03T22:17:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.157+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x5605fc754170 0x5605fc752e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.157+0000 7ff87d38cb80 4 client.15111 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:17:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.157+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1837375775 --> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] -- command(tid 0: {"prefix": "status"}) -- 0x5605fc62a3b0 con 0x5605fc754170 2024-05-03T22:17:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.158+0000 7ff86be00700 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x5605fc754170 0x5605fc752e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.159+0000 7ff86be00700 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x5605fc754170 0x5605fc752e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9be6e1603613f2db server_cookie=6471060bdec55118 in_seq=0 out_seq=0 2024-05-03T22:17:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.159+0000 7ff856000700 10 client.15111 ms_handle_connect on v2:172.21.15.116:6836/2428901446 2024-05-03T22:17:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff856000700 1 -- 172.21.15.82:0/1837375775 <== mds.1 v2:172.21.15.116:6836/2428901446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5605fc62a3b0 con 0x5605fc754170 2024-05-03T22:17:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff856000700 10 client.15111 handle_command_reply: tid=0 2024-05-03T22:17:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 1 client.15111 shutdown 2024-05-03T22:17:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1837375775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 msgr2=0x5605fc6ebcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6ebcf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff864000f80 tx=0x7ff864009c30 comp rx=0 tx=0).stop 2024-05-03T22:17:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1837375775 shutdown_connections 2024-05-03T22:17:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x5605fc754170 0x5605fc752e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605fc6cf080 0x5605fc6ebcf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5605fc6ca580 0x5605fc6e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 1 --2- 172.21.15.82:0/1837375775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5605fc6ce760 0x5605fc6e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff856000700 0 client.15111 ms_handle_reset on v2:172.21.15.116:6836/2428901446 2024-05-03T22:17:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1837375775 >> 172.21.15.82:0/1837375775 conn(0x5605fc5f8b10 msgr2=0x5605fc6cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1837375775 shutdown_connections 2024-05-03T22:17:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 1 -- 172.21.15.82:0/1837375775 wait complete. 2024-05-03T22:17:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.160+0000 7ff87d38cb80 20 client.15111 trim_cache size 0 max 16384 2024-05-03T22:17:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:17:02.164 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:17:02.165 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-05-03T22:17:02.165 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 34433, 2024-05-03T22:17:02.165 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-03T22:17:02.165 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-03T22:17:02.165 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-03T22:17:02.165 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 180.09779254, 2024-05-03T22:17:02.165 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 29, 2024-05-03T22:17:02.165 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-05-03T22:17:02.165 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-05-03T22:17:02.165 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 303.75599389000001 2024-05-03T22:17:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:17:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.161+0000 7ff872a00700 1 -- 172.21.15.82:0/855669642 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff8500b2990 msgr2=0x7ff8500b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.161+0000 7ff872a00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff8500b2990 0x7ff8500b4e50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00ad00 tx=0x7ff85c00a6e0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.161+0000 7ff872a00700 1 -- 172.21.15.82:0/855669642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86c10a490 msgr2=0x7ff86c1a05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.161+0000 7ff872a00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86c10a490 0x7ff86c1a05a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff85800b530 tx=0x7ff85800b840 comp rx=0 tx=0).stop 2024-05-03T22:17:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.161+0000 7ff872a00700 1 -- 172.21.15.82:0/855669642 shutdown_connections 2024-05-03T22:17:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.161+0000 7ff872a00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff8500b2990 0x7ff8500b4e50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.161+0000 7ff872a00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff86c10fb60 0x7ff86c1a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.161+0000 7ff872a00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff86c109ad0 0x7ff86c1a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.161+0000 7ff872a00700 1 --2- 172.21.15.82:0/855669642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff86c10a490 0x7ff86c1a05a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:02.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.161+0000 7ff872a00700 1 -- 172.21.15.82:0/855669642 >> 172.21.15.82:0/855669642 conn(0x7ff86c076c70 msgr2=0x7ff86c0771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:02.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.162+0000 7ff872a00700 1 -- 172.21.15.82:0/855669642 shutdown_connections 2024-05-03T22:17:02.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:02.162+0000 7ff872a00700 1 -- 172.21.15.82:0/855669642 wait complete. 2024-05-03T22:17:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:02 smithi082 ceph-mon[28404]: pgmap v514: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:02 smithi130 ceph-mon[32417]: pgmap v514: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:02.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:02 smithi116 ceph-mon[31828]: pgmap v514: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:03.167 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-03T22:17:03.614 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:04.316 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:04 smithi082 ceph-mon[28404]: pgmap v515: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:17:04.488 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:04 smithi116 ceph-mon[31828]: pgmap v515: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:17:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:04 smithi130 ceph-mon[32417]: pgmap v515: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:17:06.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.251+0000 7fb0c9000700 1 -- 172.21.15.82:0/791073765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c410fc90 msgr2=0x7fb0c4112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:06.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.251+0000 7fb0c9000700 1 --2- 172.21.15.82:0/791073765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c410fc90 0x7fb0c4112080 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00b0a0 tx=0x7fb0bc00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.251+0000 7fb0c9000700 1 -- 172.21.15.82:0/791073765 shutdown_connections 2024-05-03T22:17:06.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.251+0000 7fb0c9000700 1 --2- 172.21.15.82:0/791073765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c410fc90 0x7fb0c4112080 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.251+0000 7fb0c9000700 1 --2- 172.21.15.82:0/791073765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0c40757c0 0x7fb0c4075ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.251+0000 7fb0c9000700 1 --2- 172.21.15.82:0/791073765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0c40760e0 0x7fb0c410f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.251+0000 7fb0c9000700 1 -- 172.21.15.82:0/791073765 >> 172.21.15.82:0/791073765 conn(0x7fb0c40fef20 msgr2=0x7fb0c4101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:06.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.251+0000 7fb0c9000700 1 -- 172.21.15.82:0/791073765 shutdown_connections 2024-05-03T22:17:06.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.252+0000 7fb0c9000700 1 -- 172.21.15.82:0/791073765 wait complete. 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.253+0000 7fb0c9000700 1 Processor -- start 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.253+0000 7fb0c9000700 1 -- start start 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.253+0000 7fb0c9000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0c40757c0 0x7fb0c41a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.253+0000 7fb0c9000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c40760e0 0x7fb0c41a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.253+0000 7fb0c9000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0c410fc90 0x7fb0c419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.253+0000 7fb0c9000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c4115660 con 0x7fb0c40760e0 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.253+0000 7fb0c9000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c41154e0 con 0x7fb0c410fc90 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.253+0000 7fb0c9000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c41157e0 con 0x7fb0c40757c0 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.254+0000 7fb0c2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c40760e0 0x7fb0c41a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.254+0000 7fb0c2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c40760e0 0x7fb0c41a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46798/0 (socket says 172.21.15.82:46798) 2024-05-03T22:17:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.254+0000 7fb0c2a00700 1 -- 172.21.15.82:0/2705816107 learned_addr learned my addr 172.21.15.82:0/2705816107 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.254+0000 7fb0c3400700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0c40757c0 0x7fb0c41a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.254+0000 7fb0c3e00700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0c410fc90 0x7fb0c419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.254+0000 7fb0c2a00700 1 -- 172.21.15.82:0/2705816107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0c40757c0 msgr2=0x7fb0c41a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.254+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0c40757c0 0x7fb0c41a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.254+0000 7fb0c2a00700 1 -- 172.21.15.82:0/2705816107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0c410fc90 msgr2=0x7fb0c419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.254+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0c410fc90 0x7fb0c419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.254+0000 7fb0c2a00700 1 -- 172.21.15.82:0/2705816107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c419c120 con 0x7fb0c40760e0 2024-05-03T22:17:06.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.255+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c40760e0 0x7fb0c41a1cf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000d950 tx=0x7fb0b000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:06.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.255+0000 7fb0bbe00700 1 -- 172.21.15.82:0/2705816107 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0016070 con 0x7fb0c40760e0 2024-05-03T22:17:06.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.255+0000 7fb0bbe00700 1 -- 172.21.15.82:0/2705816107 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0b0009dd0 con 0x7fb0c40760e0 2024-05-03T22:17:06.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.255+0000 7fb0bbe00700 1 -- 172.21.15.82:0/2705816107 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b000f3c0 con 0x7fb0c40760e0 2024-05-03T22:17:06.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.255+0000 7fb0c9000700 1 -- 172.21.15.82:0/2705816107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c419c3b0 con 0x7fb0c40760e0 2024-05-03T22:17:06.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.255+0000 7fb0c9000700 1 -- 172.21.15.82:0/2705816107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c41a8680 con 0x7fb0c40760e0 2024-05-03T22:17:06.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.261+0000 7fb0d4fe9b80 1 Processor -- start 2024-05-03T22:17:06.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.261+0000 7fb0bbe00700 1 -- 172.21.15.82:0/2705816107 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb0b0019070 con 0x7fb0c40760e0 2024-05-03T22:17:06.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.261+0000 7fb0d4fe9b80 1 -- start start 2024-05-03T22:17:06.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.262+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13be9f0 0x5585c13bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.262+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13bf310 0x5585c13b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.262+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.262+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5585c130b9d0 con 0x5585c13b9580 2024-05-03T22:17:06.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.262+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5585c12a9710 con 0x5585c13bf310 2024-05-03T22:17:06.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.262+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585c1307990 con 0x5585c13be9f0 2024-05-03T22:17:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.262+0000 7fb0c2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.262+0000 7fb0c2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46810/0 (socket says 172.21.15.82:46810) 2024-05-03T22:17:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.262+0000 7fb0c2a00700 1 -- 172.21.15.82:0/1414543713 learned_addr learned my addr 172.21.15.82:0/1414543713 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.263+0000 7fb0c3e00700 1 --2- 172.21.15.82:0/1414543713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13be9f0 0x5585c13bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.263+0000 7fb0c3400700 1 --2- 172.21.15.82:0/1414543713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13bf310 0x5585c13b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.263+0000 7fb0c2a00700 1 -- 172.21.15.82:0/1414543713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13be9f0 msgr2=0x5585c13bedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.263+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/1414543713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13be9f0 0x5585c13bedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.263+0000 7fb0c2a00700 1 -- 172.21.15.82:0/1414543713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13bf310 msgr2=0x5585c13b8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:06.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.263+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/1414543713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13bf310 0x5585c13b8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.263+0000 7fb0c2a00700 1 -- 172.21.15.82:0/1414543713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c1258880 con 0x5585c13b9580 2024-05-03T22:17:06.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.263+0000 7fb0c3400700 1 --2- 172.21.15.82:0/1414543713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13bf310 0x5585c13b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:17:06.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.263+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/1414543713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b99e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00ea500 tx=0x7fb0b00ea810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1aa122f627b5a41 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:06.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.263+0000 7fb0bbe00700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb0a80b2990 0x7fb0a80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.264+0000 7fb0bbe00700 1 -- 172.21.15.82:0/2705816107 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fb0b00e2340 con 0x7fb0c40760e0 2024-05-03T22:17:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.264+0000 7fb0b8c00700 1 -- 172.21.15.82:0/1414543713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00a52a0 con 0x5585c13b9580 2024-05-03T22:17:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.264+0000 7fb0b8c00700 1 -- 172.21.15.82:0/1414543713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0b00a8ef0 con 0x5585c13b9580 2024-05-03T22:17:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.264+0000 7fb0b8c00700 1 -- 172.21.15.82:0/1414543713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00a8b50 con 0x5585c13b9580 2024-05-03T22:17:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.264+0000 7fb0c3e00700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb0a80b2990 0x7fb0a80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.264+0000 7fb0c3e00700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb0a80b2990 0x7fb0a80b4e50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009fd0 tx=0x7fb0bc00b720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:06.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.264+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1414543713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 msgr2=0x5585c13b99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:06.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.264+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/1414543713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b99e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00ea500 tx=0x7fb0b00ea810 comp rx=0 tx=0).stop 2024-05-03T22:17:06.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.265+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1414543713 shutdown_connections 2024-05-03T22:17:06.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.265+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/1414543713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b99e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.265+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/1414543713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13be9f0 0x5585c13bedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.265+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/1414543713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13bf310 0x5585c13b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.265+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1414543713 >> 172.21.15.82:0/1414543713 conn(0x5585c12e7b10 msgr2=0x5585c13b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:06.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.265+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1414543713 shutdown_connections 2024-05-03T22:17:06.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.265+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1414543713 wait complete. 2024-05-03T22:17:06.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.265+0000 7fb0d4fe9b80 1 -- start start 2024-05-03T22:17:06.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.265+0000 7fb0d4fe9b80 1 Processor -- start 2024-05-03T22:17:06.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.266+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13b9580 0x5585c13c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.266+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13be9f0 0x5585c13c2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.266+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13bf310 0x5585c13c2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.266+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5585c13c5d80 con 0x5585c13bf310 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.266+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5585c1271ad0 con 0x5585c13b9580 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.266+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585c13c5f00 con 0x5585c13be9f0 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.266+0000 7fb0d4fe9b80 10 client.0 _ll_register_callbacks cb 0x5585c12b2c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.266+0000 7fb0c3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13bf310 0x5585c13c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.266+0000 7fb0c3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13bf310 0x5585c13c2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46824/0 (socket says 172.21.15.82:46824) 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.267+0000 7fb0c3e00700 1 -- 172.21.15.82:0/1045162430 learned_addr learned my addr 172.21.15.82:0/1045162430 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.267+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13be9f0 0x5585c13c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.267+0000 7fb0c3400700 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13b9580 0x5585c13c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.267+0000 7fb0c3e00700 1 -- 172.21.15.82:0/1045162430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13be9f0 msgr2=0x5585c13c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.267+0000 7fb0c3e00700 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13be9f0 0x5585c13c2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.267+0000 7fb0c3e00700 1 -- 172.21.15.82:0/1045162430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13b9580 msgr2=0x5585c13c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.267+0000 7fb0c3e00700 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13b9580 0x5585c13c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.267+0000 7fb0c3e00700 1 -- 172.21.15.82:0/1045162430 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c12d13d0 con 0x5585c13bf310 2024-05-03T22:17:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.267+0000 7fb0c3400700 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13b9580 0x5585c13c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:17:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.267+0000 7fb0c3e00700 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13bf310 0x5585c13c2940 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00bfd0 tx=0x7fb0bc0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495e8df117f8ac85 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.267+0000 7fb0ad600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:17:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.268+0000 7fb0ad600700 1 -- 172.21.15.82:0/1045162430 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc02d070 con 0x5585c13bf310 2024-05-03T22:17:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.268+0000 7fb0ad600700 1 -- 172.21.15.82:0/1045162430 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fb0bc029440 con 0x5585c13bf310 2024-05-03T22:17:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.268+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1045162430 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0b00a8ef0 con 0x5585c13bf310 2024-05-03T22:17:06.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.268+0000 7fb0ad600700 1 -- 172.21.15.82:0/1045162430 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb0bc037050 con 0x5585c13bf310 2024-05-03T22:17:06.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.268+0000 7fb0d4fe9b80 10 client.15123 fetch_fsmap learned FSMap version 29 2024-05-03T22:17:06.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.268+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1045162430 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5585c13d0640 con 0x5585c13bf310 2024-05-03T22:17:06.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.268+0000 7fb0ad600700 1 -- 172.21.15.82:0/1045162430 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0b00a8ef0 con 0x5585c13bf310 2024-05-03T22:17:06.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.268+0000 7fb0ad600700 1 -- 172.21.15.82:0/1045162430 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb0bc011070 con 0x5585c13bf310 2024-05-03T22:17:06.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.269+0000 7fb0d4fe9b80 10 client.15123 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:17:06.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.269+0000 7fb0d4fe9b80 10 client.15123 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.269+0000 7fb0d4fe9b80 20 client.15123 populate_metadata read hostname 'smithi082' 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.269+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x5585c13d2c50 0x5585c13d40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.269+0000 7fb0d4fe9b80 4 client.15123 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.269+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1045162430 --> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585c1386180 con 0x5585c13d2c50 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.269+0000 7fb0c3400700 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x5585c13d2c50 0x5585c13d40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.270+0000 7fb0c3400700 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x5585c13d2c50 0x5585c13d40c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1771518a437bcb3c server_cookie=62e3e345332daea0 in_seq=0 out_seq=0 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.270+0000 7fb0ad600700 10 client.15123 ms_handle_connect on v2:172.21.15.116:6838/3254019270 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.272+0000 7fb0ad600700 1 -- 172.21.15.82:0/1045162430 <== mds.0 v2:172.21.15.116:6838/3254019270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5585c1386180 con 0x5585c13d2c50 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.272+0000 7fb0ad600700 10 client.15123 handle_command_reply: tid=0 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 1 client.15123 shutdown 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1045162430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13bf310 msgr2=0x5585c13c2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13bf310 0x5585c13c2940 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00bfd0 tx=0x7fb0bc0099e0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1045162430 shutdown_connections 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x5585c13d2c50 0x5585c13d40c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13bf310 0x5585c13c2940 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13b9580 0x5585c13c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/1045162430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13be9f0 0x5585c13c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1045162430 >> 172.21.15.82:0/1045162430 conn(0x5585c12e7b10 msgr2=0x5585c13b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:06.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0ad600700 0 client.15123 ms_handle_reset on v2:172.21.15.116:6838/3254019270 2024-05-03T22:17:06.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1045162430 shutdown_connections 2024-05-03T22:17:06.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/1045162430 wait complete. 2024-05-03T22:17:06.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.273+0000 7fb0d4fe9b80 20 client.15123 trim_cache size 0 max 16384 2024-05-03T22:17:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.295+0000 7fb0d4fe9b80 1 Processor -- start 2024-05-03T22:17:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.295+0000 7fb0d4fe9b80 1 -- start start 2024-05-03T22:17:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.295+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.295+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13be9f0 0x5585c13c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.295+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13bf310 0x5585c13c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.295+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5585c13d2400 con 0x5585c13b9580 2024-05-03T22:17:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.295+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5585c13d2ad0 con 0x5585c13be9f0 2024-05-03T22:17:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.295+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585c13d31a0 con 0x5585c13bf310 2024-05-03T22:17:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.296+0000 7fb0c3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.296+0000 7fb0c3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46828/0 (socket says 172.21.15.82:46828) 2024-05-03T22:17:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.296+0000 7fb0c3400700 1 -- 172.21.15.82:0/323018748 learned_addr learned my addr 172.21.15.82:0/323018748 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.296+0000 7fb0c3e00700 1 --2- 172.21.15.82:0/323018748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13bf310 0x5585c13c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.296+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/323018748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13be9f0 0x5585c13c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.296+0000 7fb0c3400700 1 -- 172.21.15.82:0/323018748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13bf310 msgr2=0x5585c13c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.296+0000 7fb0c3400700 1 --2- 172.21.15.82:0/323018748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13bf310 0x5585c13c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.296+0000 7fb0c3400700 1 -- 172.21.15.82:0/323018748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13be9f0 msgr2=0x5585c13c23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.296+0000 7fb0c3400700 1 --2- 172.21.15.82:0/323018748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13be9f0 0x5585c13c23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.296+0000 7fb0c3400700 1 -- 172.21.15.82:0/323018748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c13b5480 con 0x5585c13b9580 2024-05-03T22:17:06.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.296+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/323018748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13be9f0 0x5585c13c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:17:06.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.297+0000 7fb0c3400700 1 --2- 172.21.15.82:0/323018748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b8f60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009ae0 tx=0x7fb0b4014750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425116962a0093fb server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:06.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.297+0000 7fb0afe00700 1 -- 172.21.15.82:0/323018748 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4014bb0 con 0x5585c13b9580 2024-05-03T22:17:06.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.297+0000 7fb0afe00700 1 -- 172.21.15.82:0/323018748 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0b40044e0 con 0x5585c13b9580 2024-05-03T22:17:06.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.297+0000 7fb0afe00700 1 -- 172.21.15.82:0/323018748 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4003d90 con 0x5585c13b9580 2024-05-03T22:17:06.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.298+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/323018748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 msgr2=0x5585c13b8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.298+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/323018748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b8f60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009ae0 tx=0x7fb0b4014750 comp rx=0 tx=0).stop 2024-05-03T22:17:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.298+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/323018748 shutdown_connections 2024-05-03T22:17:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.298+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/323018748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b8f60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.298+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/323018748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13bf310 0x5585c13c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.298+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/323018748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13be9f0 0x5585c13c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.298+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/323018748 >> 172.21.15.82:0/323018748 conn(0x5585c12e7b10 msgr2=0x5585c13b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.298+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/323018748 shutdown_connections 2024-05-03T22:17:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.298+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/323018748 wait complete. 2024-05-03T22:17:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.299+0000 7fb0d4fe9b80 1 -- start start 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.299+0000 7fb0d4fe9b80 1 Processor -- start 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.299+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.299+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13be9f0 0x5585c13b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.299+0000 7fb0d4fe9b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13bf310 0x5585c13b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.299+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5585c13d3f40 con 0x5585c13b9580 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.299+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5585c13d3870 con 0x5585c13be9f0 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.299+0000 7fb0d4fe9b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5585c13d4610 con 0x5585c13bf310 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.299+0000 7fb0d4fe9b80 10 client.0 _ll_register_callbacks cb 0x5585c12b2c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0c3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0c3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46844/0 (socket says 172.21.15.82:46844) 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0c3400700 1 -- 172.21.15.82:0/718777941 learned_addr learned my addr 172.21.15.82:0/718777941 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13be9f0 0x5585c13b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0c3e00700 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13bf310 0x5585c13b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0c3400700 1 -- 172.21.15.82:0/718777941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13bf310 msgr2=0x5585c13b8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:06.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0c3400700 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13bf310 0x5585c13b8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0c3400700 1 -- 172.21.15.82:0/718777941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13be9f0 msgr2=0x5585c13b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:06.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0c3400700 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13be9f0 0x5585c13b87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0c3400700 1 -- 172.21.15.82:0/718777941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c13dbc60 con 0x5585c13b9580 2024-05-03T22:17:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0c3400700 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b82b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40039b0 tx=0x7fb0b4014280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61a88d277b2b074 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.300+0000 7fb0ad600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:17:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.301+0000 7fb0ad600700 1 -- 172.21.15.82:0/718777941 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4003780 con 0x5585c13b9580 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.301+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/718777941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0b40044e0 con 0x5585c13b9580 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.301+0000 7fb0ad600700 1 -- 172.21.15.82:0/718777941 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fb0b4014dc0 con 0x5585c13b9580 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.301+0000 7fb0ad600700 1 -- 172.21.15.82:0/718777941 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb0b4038050 con 0x5585c13b9580 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.301+0000 7fb0d4fe9b80 10 client.15129 fetch_fsmap learned FSMap version 29 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.301+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/718777941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5585c143e530 con 0x5585c13b9580 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.301+0000 7fb0ad600700 1 -- 172.21.15.82:0/718777941 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0b40044e0 con 0x5585c13b9580 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.301+0000 7fb0ad600700 1 -- 172.21.15.82:0/718777941 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb0b402a770 con 0x5585c13b9580 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.302+0000 7fb0d4fe9b80 10 client.15129 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.302+0000 7fb0d4fe9b80 10 client.15129 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.302+0000 7fb0d4fe9b80 20 client.15129 populate_metadata read hostname 'smithi082' 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.302+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x5585c1442e20 0x5585c1441b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.302+0000 7fb0d4fe9b80 4 client.15129 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.302+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/718777941 --> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] -- command(tid 0: {"prefix": "status"}) -- 0x5585c13193b0 con 0x5585c1442e20 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.302+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x5585c1442e20 0x5585c1441b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.303+0000 7fb0c2a00700 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x5585c1442e20 0x5585c1441b30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7e2600afe993495 server_cookie=7a65e73a86c98c34 in_seq=0 out_seq=0 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.303+0000 7fb0ad600700 10 client.15129 ms_handle_connect on v2:172.21.15.116:6838/3254019270 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0ad600700 1 -- 172.21.15.82:0/718777941 <== mds.0 v2:172.21.15.116:6838/3254019270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5585c13193b0 con 0x5585c1442e20 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0ad600700 10 client.15129 handle_command_reply: tid=0 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 1 client.15129 shutdown 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/718777941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 msgr2=0x5585c13b82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b82b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40039b0 tx=0x7fb0b4014280 comp rx=0 tx=0).stop 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/718777941 shutdown_connections 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x5585c1442e20 0x5585c1441b30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5585c13b9580 0x5585c13b82b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5585c13bf310 0x5585c13b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 1 --2- 172.21.15.82:0/718777941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5585c13be9f0 0x5585c13b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/718777941 >> 172.21.15.82:0/718777941 conn(0x5585c12e7b10 msgr2=0x5585c13c23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0ad600700 0 client.15129 ms_handle_reset on v2:172.21.15.116:6838/3254019270 2024-05-03T22:17:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/718777941 shutdown_connections 2024-05-03T22:17:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 1 -- 172.21.15.82:0/718777941 wait complete. 2024-05-03T22:17:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.304+0000 7fb0d4fe9b80 20 client.15129 trim_cache size 0 max 16384 2024-05-03T22:17:06.309 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:17:06.309 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:17:06.309 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-05-03T22:17:06.309 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 34460, 2024-05-03T22:17:06.309 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-03T22:17:06.309 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-03T22:17:06.309 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-03T22:17:06.309 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 266.26607425600002, 2024-05-03T22:17:06.310 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 29, 2024-05-03T22:17:06.310 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-05-03T22:17:06.310 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-05-03T22:17:06.310 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 289.58128385499998 2024-05-03T22:17:06.310 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:17:06.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 -- 172.21.15.82:0/2705816107 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb0a80b2990 msgr2=0x7fb0a80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb0a80b2990 0x7fb0a80b4e50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009fd0 tx=0x7fb0bc00b720 comp rx=0 tx=0).stop 2024-05-03T22:17:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 -- 172.21.15.82:0/2705816107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c40760e0 msgr2=0x7fb0c41a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c40760e0 0x7fb0c41a1cf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000d950 tx=0x7fb0b000dc60 comp rx=0 tx=0).stop 2024-05-03T22:17:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 -- 172.21.15.82:0/2705816107 shutdown_connections 2024-05-03T22:17:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb0a80b2990 0x7fb0a80b4e50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0c410fc90 0x7fb0c419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0c40757c0 0x7fb0c41a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 --2- 172.21.15.82:0/2705816107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c40760e0 0x7fb0c41a1cf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 -- 172.21.15.82:0/2705816107 >> 172.21.15.82:0/2705816107 conn(0x7fb0c40fef20 msgr2=0x7fb0c40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 -- 172.21.15.82:0/2705816107 shutdown_connections 2024-05-03T22:17:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:06.305+0000 7fb0c9000700 1 -- 172.21.15.82:0/2705816107 wait complete. 2024-05-03T22:17:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:06 smithi082 ceph-mon[28404]: pgmap v516: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:17:06.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:06 smithi130 ceph-mon[32417]: pgmap v516: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:17:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:06 smithi116 ceph-mon[31828]: pgmap v516: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:17:07.475 INFO:tasks.cephadm:Setup complete, yielding 2024-05-03T22:17:07.476 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-03T22:17:07.491 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-05-03T22:17:07.491 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-03T22:17:07.942 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:08.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:08 smithi082 ceph-mon[28404]: pgmap v517: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:17:08.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:08 smithi130 ceph-mon[32417]: pgmap v517: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:17:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:08 smithi116 ceph-mon[31828]: pgmap v517: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:17:10.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.472+0000 7f3233000700 1 -- 172.21.15.82:0/2573325698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f322c1071e0 msgr2=0x7f322c10da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:10.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.472+0000 7f3233000700 1 --2- 172.21.15.82:0/2573325698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f322c1071e0 0x7f322c10da90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f322400b0d0 tx=0x7f322400b3e0 comp rx=0 tx=0).stop 2024-05-03T22:17:10.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.472+0000 7f3233000700 1 -- 172.21.15.82:0/2573325698 shutdown_connections 2024-05-03T22:17:10.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.472+0000 7f3233000700 1 --2- 172.21.15.82:0/2573325698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f322c1071e0 0x7f322c10da90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:10.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.472+0000 7f3233000700 1 --2- 172.21.15.82:0/2573325698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c105640 0x7f322c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:10.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.472+0000 7f3233000700 1 --2- 172.21.15.82:0/2573325698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f322c106840 0x7f322c106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:10.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.472+0000 7f3233000700 1 -- 172.21.15.82:0/2573325698 >> 172.21.15.82:0/2573325698 conn(0x7f322c100be0 msgr2=0x7f322c103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:10.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.472+0000 7f3233000700 1 -- 172.21.15.82:0/2573325698 shutdown_connections 2024-05-03T22:17:10.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.472+0000 7f3233000700 1 -- 172.21.15.82:0/2573325698 wait complete. 2024-05-03T22:17:10.475 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:10 smithi082 ceph-mon[28404]: pgmap v518: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:17:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.473+0000 7f3233000700 1 Processor -- start 2024-05-03T22:17:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.474+0000 7f3233000700 1 -- start start 2024-05-03T22:17:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.474+0000 7f3233000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f322c105640 0x7f322c19b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.474+0000 7f3233000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f322c106840 0x7f322c19bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.474+0000 7f3233000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c1071e0 0x7f322c1a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.474+0000 7f3233000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f322c110fc0 con 0x7f322c106840 2024-05-03T22:17:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.474+0000 7f3233000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f322c110e40 con 0x7f322c1071e0 2024-05-03T22:17:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.474+0000 7f3233000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f322c111140 con 0x7f322c105640 2024-05-03T22:17:10.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.474+0000 7f3231200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f322c106840 0x7f322c19bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:10.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.474+0000 7f3231200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f322c106840 0x7f322c19bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46854/0 (socket says 172.21.15.82:46854) 2024-05-03T22:17:10.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.474+0000 7f3231200700 1 -- 172.21.15.82:0/3774266303 learned_addr learned my addr 172.21.15.82:0/3774266303 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:10.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.475+0000 7f3231c00700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f322c105640 0x7f322c19b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:10.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.475+0000 7f3232600700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c1071e0 0x7f322c1a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:10.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.475+0000 7f3231200700 1 -- 172.21.15.82:0/3774266303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f322c105640 msgr2=0x7f322c19b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:10.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.475+0000 7f3231200700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f322c105640 0x7f322c19b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:10.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.475+0000 7f3231200700 1 -- 172.21.15.82:0/3774266303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c1071e0 msgr2=0x7f322c1a2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:10.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.475+0000 7f3231200700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c1071e0 0x7f322c1a2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:10.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.475+0000 7f3231200700 1 -- 172.21.15.82:0/3774266303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c1a3260 con 0x7f322c106840 2024-05-03T22:17:10.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.475+0000 7f3231c00700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f322c105640 0x7f322c19b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:17:10.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.475+0000 7f3231200700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f322c106840 0x7f322c19bb40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f321800d980 tx=0x7f321800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.476+0000 7f322a000700 1 -- 172.21.15.82:0/3774266303 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3218016070 con 0x7f322c106840 2024-05-03T22:17:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.476+0000 7f322a000700 1 -- 172.21.15.82:0/3774266303 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3218010460 con 0x7f322c106840 2024-05-03T22:17:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.476+0000 7f3233000700 1 -- 172.21.15.82:0/3774266303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322c1a3550 con 0x7f322c106840 2024-05-03T22:17:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.476+0000 7f322a000700 1 -- 172.21.15.82:0/3774266303 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321800f620 con 0x7f322c106840 2024-05-03T22:17:10.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.476+0000 7f3233000700 1 -- 172.21.15.82:0/3774266303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322c1a3a90 con 0x7f322c106840 2024-05-03T22:17:10.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.478+0000 7f3233000700 1 -- 172.21.15.82:0/3774266303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f322c06a190 con 0x7f322c106840 2024-05-03T22:17:10.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.480+0000 7f322a000700 1 -- 172.21.15.82:0/3774266303 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3218019070 con 0x7f322c106840 2024-05-03T22:17:10.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.482+0000 7f322a000700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f32140b2990 0x7f32140b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:10.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.482+0000 7f322a000700 1 -- 172.21.15.82:0/3774266303 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f32180e1e20 con 0x7f322c106840 2024-05-03T22:17:10.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.482+0000 7f3231c00700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f32140b2990 0x7f32140b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:10.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.483+0000 7f3231c00700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f32140b2990 0x7f32140b4e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3220005950 tx=0x7f32200058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.486+0000 7f322a000700 1 -- 172.21.15.82:0/3774266303 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f32180a95c0 con 0x7f322c106840 2024-05-03T22:17:10.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:10 smithi130 ceph-mon[32417]: pgmap v518: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:17:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:10 smithi116 ceph-mon[31828]: pgmap v518: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:17:10.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.739+0000 7f3233000700 1 -- 172.21.15.82:0/3774266303 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f322c0638e0 con 0x7f32140b2990 2024-05-03T22:17:10.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.741+0000 7f322a000700 1 -- 172.21.15.82:0/3774266303 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f322c0638e0 con 0x7f32140b2990 2024-05-03T22:17:10.743 INFO:teuthology.orchestra.run.smithi082.stdout:Backend: cephadm 2024-05-03T22:17:10.743 INFO:teuthology.orchestra.run.smithi082.stdout:Available: Yes 2024-05-03T22:17:10.743 INFO:teuthology.orchestra.run.smithi082.stdout:Paused: No 2024-05-03T22:17:10.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.744+0000 7f3233000700 1 -- 172.21.15.82:0/3774266303 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f32140b2990 msgr2=0x7f32140b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:10.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.744+0000 7f3233000700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f32140b2990 0x7f32140b4e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3220005950 tx=0x7f32200058e0 comp rx=0 tx=0).stop 2024-05-03T22:17:10.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.744+0000 7f3233000700 1 -- 172.21.15.82:0/3774266303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f322c106840 msgr2=0x7f322c19bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:10.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.744+0000 7f3233000700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f322c106840 0x7f322c19bb40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f321800d980 tx=0x7f321800dd40 comp rx=0 tx=0).stop 2024-05-03T22:17:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.744+0000 7f3233000700 1 -- 172.21.15.82:0/3774266303 shutdown_connections 2024-05-03T22:17:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.744+0000 7f3233000700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f32140b2990 0x7f32140b4e50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.744+0000 7f3233000700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f322c1071e0 0x7f322c1a2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.744+0000 7f3233000700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f322c105640 0x7f322c19b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.744+0000 7f3233000700 1 --2- 172.21.15.82:0/3774266303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f322c106840 0x7f322c19bb40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.744+0000 7f3233000700 1 -- 172.21.15.82:0/3774266303 >> 172.21.15.82:0/3774266303 conn(0x7f322c100be0 msgr2=0x7f322c109bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.745+0000 7f3233000700 1 -- 172.21.15.82:0/3774266303 shutdown_connections 2024-05-03T22:17:10.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:10.745+0000 7f3233000700 1 -- 172.21.15.82:0/3774266303 wait complete. 2024-05-03T22:17:11.829 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-03T22:17:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:12 smithi130 ceph-mon[32417]: pgmap v519: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:17:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:12 smithi130 ceph-mon[32417]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:12 smithi116 ceph-mon[31828]: pgmap v519: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:17:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:12 smithi116 ceph-mon[31828]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:12.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:12 smithi082 ceph-mon[28404]: pgmap v519: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:17:12.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:12 smithi082 ceph-mon[28404]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:14 smithi130 ceph-mon[32417]: pgmap v520: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:17:14.557 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:14 smithi082 ceph-mon[28404]: pgmap v520: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:17:14.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:14 smithi116 ceph-mon[31828]: pgmap v520: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:17:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.896+0000 7fd5dc600700 1 -- 172.21.15.82:0/1703708028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d4103f90 msgr2=0x7fd5d4106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.896+0000 7fd5dc600700 1 --2- 172.21.15.82:0/1703708028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d4103f90 0x7fd5d4106380 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009990 tx=0x7fd5c8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:17:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.896+0000 7fd5dc600700 1 -- 172.21.15.82:0/1703708028 shutdown_connections 2024-05-03T22:17:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.896+0000 7fd5dc600700 1 --2- 172.21.15.82:0/1703708028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d4103f90 0x7fd5d4106380 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.896+0000 7fd5dc600700 1 --2- 172.21.15.82:0/1703708028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5d41091f0 0x7fd5d410b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.896+0000 7fd5dc600700 1 --2- 172.21.15.82:0/1703708028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5d41068c0 0x7fd5d4108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.896+0000 7fd5dc600700 1 -- 172.21.15.82:0/1703708028 >> 172.21.15.82:0/1703708028 conn(0x7fd5d40fd9c0 msgr2=0x7fd5d40ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.896+0000 7fd5dc600700 1 -- 172.21.15.82:0/1703708028 shutdown_connections 2024-05-03T22:17:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.896+0000 7fd5dc600700 1 -- 172.21.15.82:0/1703708028 wait complete. 2024-05-03T22:17:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.897+0000 7fd5dc600700 1 Processor -- start 2024-05-03T22:17:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.897+0000 7fd5dc600700 1 -- start start 2024-05-03T22:17:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.897+0000 7fd5dc600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5d4103f90 0x7fd5d41995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.897+0000 7fd5dc600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d41068c0 0x7fd5d4199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.897+0000 7fd5dc600700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5d41091f0 0x7fd5d41a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.897+0000 7fd5dc600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d410eec0 con 0x7fd5d41068c0 2024-05-03T22:17:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.897+0000 7fd5dc600700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d410ed40 con 0x7fd5d41091f0 2024-05-03T22:17:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.897+0000 7fd5dc600700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d410f040 con 0x7fd5d4103f90 2024-05-03T22:17:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.898+0000 7fd5d9200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d41068c0 0x7fd5d4199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.898+0000 7fd5d9200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d41068c0 0x7fd5d4199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57134/0 (socket says 172.21.15.82:57134) 2024-05-03T22:17:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.898+0000 7fd5d9200700 1 -- 172.21.15.82:0/1862193614 learned_addr learned my addr 172.21.15.82:0/1862193614 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.898+0000 7fd5d9c00700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5d4103f90 0x7fd5d41995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.898+0000 7fd5da600700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5d41091f0 0x7fd5d41a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.898+0000 7fd5d9200700 1 -- 172.21.15.82:0/1862193614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5d4103f90 msgr2=0x7fd5d41995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.898+0000 7fd5d9200700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5d4103f90 0x7fd5d41995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.898+0000 7fd5d9200700 1 -- 172.21.15.82:0/1862193614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5d41091f0 msgr2=0x7fd5d41a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.898+0000 7fd5d9200700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5d41091f0 0x7fd5d41a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.898+0000 7fd5d9200700 1 -- 172.21.15.82:0/1862193614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d41a1200 con 0x7fd5d41068c0 2024-05-03T22:17:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.899+0000 7fd5d9200700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d41068c0 0x7fd5d4199ae0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000e9d0 tx=0x7fd5c000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.899+0000 7fd5d2000700 1 -- 172.21.15.82:0/1862193614 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000cbd0 con 0x7fd5d41068c0 2024-05-03T22:17:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.899+0000 7fd5d2000700 1 -- 172.21.15.82:0/1862193614 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5c000cd70 con 0x7fd5d41068c0 2024-05-03T22:17:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.899+0000 7fd5dc600700 1 -- 172.21.15.82:0/1862193614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d41a14f0 con 0x7fd5d41068c0 2024-05-03T22:17:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.899+0000 7fd5d2000700 1 -- 172.21.15.82:0/1862193614 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0018680 con 0x7fd5d41068c0 2024-05-03T22:17:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.899+0000 7fd5dc600700 1 -- 172.21.15.82:0/1862193614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d41a1a80 con 0x7fd5d41068c0 2024-05-03T22:17:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.900+0000 7fd5dc600700 1 -- 172.21.15.82:0/1862193614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b4005360 con 0x7fd5d41068c0 2024-05-03T22:17:14.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.903+0000 7fd5d2000700 1 -- 172.21.15.82:0/1862193614 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd5c0018820 con 0x7fd5d41068c0 2024-05-03T22:17:14.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.904+0000 7fd5d2000700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5bc0b2990 0x7fd5bc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:14.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.904+0000 7fd5d2000700 1 -- 172.21.15.82:0/1862193614 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fd5c00e2890 con 0x7fd5d41068c0 2024-05-03T22:17:14.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.904+0000 7fd5d9c00700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5bc0b2990 0x7fd5bc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:14.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.905+0000 7fd5d9c00700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5bc0b2990 0x7fd5bc0b4e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800b2e0 tx=0x7fd5c801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:14.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:14.909+0000 7fd5d2000700 1 -- 172.21.15.82:0/1862193614 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd5c00aa030 con 0x7fd5d41068c0 2024-05-03T22:17:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.153+0000 7fd5dc600700 1 -- 172.21.15.82:0/1862193614 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd5b4000bf0 con 0x7fd5bc0b2990 2024-05-03T22:17:15.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.170+0000 7fd5d2000700 1 -- 172.21.15.82:0/1862193614 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fd5b4000bf0 con 0x7fd5bc0b2990 2024-05-03T22:17:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-03T22:17:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:mds.a smithi082 running (5m) 2m ago 5m 14.9M - 19.0.0-3450-g9a047fe7 ee4d84620249 2a132cfa614b 2024-05-03T22:17:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:mds.b smithi116 running (4m) 2m ago 4m 25.0M - 19.0.0-3450-g9a047fe7 ee4d84620249 d5750506c7dd 2024-05-03T22:17:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:mds.c smithi130 running (5m) 2m ago 5m 16.1M - 19.0.0-3450-g9a047fe7 ee4d84620249 f877dd61c79c 2024-05-03T22:17:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:mds.d smithi082 running (5m) 2m ago 5m 13.1M - 19.0.0-3450-g9a047fe7 ee4d84620249 17942a4f5afb 2024-05-03T22:17:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:mds.e smithi116 running (5m) 2m ago 5m 16.6M - 19.0.0-3450-g9a047fe7 ee4d84620249 53f56e322049 2024-05-03T22:17:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:mds.f smithi130 running (5m) 2m ago 5m 15.0M - 19.0.0-3450-g9a047fe7 ee4d84620249 64a740293719 2024-05-03T22:17:15.174 INFO:teuthology.orchestra.run.smithi082.stdout:mds.g smithi082 running (5m) 2m ago 5m 14.9M - 19.0.0-3450-g9a047fe7 ee4d84620249 5eacb023eee3 2024-05-03T22:17:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:mds.h smithi116 running (5m) 2m ago 5m 16.9M - 19.0.0-3450-g9a047fe7 ee4d84620249 409af15ca2d5 2024-05-03T22:17:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:mds.i smithi130 running (5m) 2m ago 5m 16.4M - 19.0.0-3450-g9a047fe7 ee4d84620249 aba961ca1bdb 2024-05-03T22:17:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:mds.j smithi082 running (5m) 2m ago 5m 13.2M - 19.0.0-3450-g9a047fe7 ee4d84620249 a95ae38a883f 2024-05-03T22:17:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:mds.k smithi116 running (5m) 2m ago 5m 16.5M - 19.0.0-3450-g9a047fe7 ee4d84620249 dc40b64618d5 2024-05-03T22:17:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:mds.l smithi130 running (5m) 2m ago 5m 15.1M - 19.0.0-3450-g9a047fe7 ee4d84620249 31d8ffe47f9b 2024-05-03T22:17:15.175 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.x smithi082 *:9283,8765 running (15m) 2m ago 15m 529M - 19.0.0-3450-g9a047fe7 ee4d84620249 26e2b13a17ed 2024-05-03T22:17:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.y smithi116 *:8443,8765 running (13m) 2m ago 13m 466M - 19.0.0-3450-g9a047fe7 ee4d84620249 13c49b309a19 2024-05-03T22:17:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.z smithi130 *:8443,8765 running (13m) 2m ago 13m 465M - 19.0.0-3450-g9a047fe7 ee4d84620249 18724542bbbd 2024-05-03T22:17:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:mon.a smithi082 running (15m) 2m ago 15m 50.6M 2048M 19.0.0-3450-g9a047fe7 ee4d84620249 7441df8970a6 2024-05-03T22:17:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:mon.b smithi116 running (13m) 2m ago 13m 40.2M 2048M 19.0.0-3450-g9a047fe7 ee4d84620249 284277348d57 2024-05-03T22:17:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:mon.c smithi130 running (13m) 2m ago 13m 40.8M 2048M 19.0.0-3450-g9a047fe7 ee4d84620249 66ca09a37d54 2024-05-03T22:17:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (12m) 2m ago 12m 44.9M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 c1475ed3f020 2024-05-03T22:17:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi116 running (12m) 2m ago 12m 45.3M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 0b335bd86268 2024-05-03T22:17:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi130 running (11m) 2m ago 11m 52.3M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 b91dcd4de962 2024-05-03T22:17:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi082 running (10m) 2m ago 10m 44.2M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 51aa294b761d 2024-05-03T22:17:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi116 running (10m) 2m ago 10m 42.4M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 43c9d7adb933 2024-05-03T22:17:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi130 running (9m) 2m ago 9m 51.3M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 ee8559bbb7c2 2024-05-03T22:17:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 smithi082 running (9m) 2m ago 9m 50.4M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 bdb7c660b638 2024-05-03T22:17:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 smithi116 running (8m) 2m ago 8m 51.5M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 88f561a54965 2024-05-03T22:17:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 smithi130 running (8m) 2m ago 8m 43.3M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 4441f443ad32 2024-05-03T22:17:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 smithi082 running (7m) 2m ago 7m 42.1M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 59292543ea36 2024-05-03T22:17:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 smithi116 running (6m) 2m ago 6m 51.7M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 f41267355dc9 2024-05-03T22:17:15.177 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 smithi130 running (6m) 2m ago 6m 40.9M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 3a03bee4099b 2024-05-03T22:17:15.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 -- 172.21.15.82:0/1862193614 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5bc0b2990 msgr2=0x7fd5bc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:15.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5bc0b2990 0x7fd5bc0b4e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800b2e0 tx=0x7fd5c801a040 comp rx=0 tx=0).stop 2024-05-03T22:17:15.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 -- 172.21.15.82:0/1862193614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d41068c0 msgr2=0x7fd5d4199ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:15.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d41068c0 0x7fd5d4199ae0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000e9d0 tx=0x7fd5c000ece0 comp rx=0 tx=0).stop 2024-05-03T22:17:15.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 -- 172.21.15.82:0/1862193614 shutdown_connections 2024-05-03T22:17:15.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd5bc0b2990 0x7fd5bc0b4e50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:15.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5d41091f0 0x7fd5d41a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:15.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5d4103f90 0x7fd5d41995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:15.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 --2- 172.21.15.82:0/1862193614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5d41068c0 0x7fd5d4199ae0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:15.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 -- 172.21.15.82:0/1862193614 >> 172.21.15.82:0/1862193614 conn(0x7fd5d40fd9c0 msgr2=0x7fd5d4104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:15.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 -- 172.21.15.82:0/1862193614 shutdown_connections 2024-05-03T22:17:15.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:15.173+0000 7fd5dc600700 1 -- 172.21.15.82:0/1862193614 wait complete. 2024-05-03T22:17:16.285 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-03T22:17:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:16 smithi082 ceph-mon[28404]: pgmap v521: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:16.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:16 smithi082 ceph-mon[28404]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:16 smithi130 ceph-mon[32417]: pgmap v521: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:16 smithi130 ceph-mon[32417]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:16.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:16 smithi116 ceph-mon[31828]: pgmap v521: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:16.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:16 smithi116 ceph-mon[31828]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:16.730 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:18.598 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:18 smithi082 ceph-mon[28404]: pgmap v522: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:18 smithi116 ceph-mon[31828]: pgmap v522: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:18 smithi130 ceph-mon[32417]: pgmap v522: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.209+0000 7f977c200700 1 -- 172.21.15.82:0/2266941609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977410ad40 msgr2=0x7f977410b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.209+0000 7f977c200700 1 --2- 172.21.15.82:0/2266941609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977410ad40 0x7f977410b1a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f97600099c0 tx=0x7f9760009cd0 comp rx=0 tx=0).stop 2024-05-03T22:17:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.210+0000 7f977c200700 1 -- 172.21.15.82:0/2266941609 shutdown_connections 2024-05-03T22:17:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.210+0000 7f977c200700 1 --2- 172.21.15.82:0/2266941609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f977410b6e0 0x7f9774111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.210+0000 7f977c200700 1 --2- 172.21.15.82:0/2266941609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9774109b40 0x7f9774109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.210+0000 7f977c200700 1 --2- 172.21.15.82:0/2266941609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977410ad40 0x7f977410b1a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.210+0000 7f977c200700 1 -- 172.21.15.82:0/2266941609 >> 172.21.15.82:0/2266941609 conn(0x7f9774078b10 msgr2=0x7f977407af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.210+0000 7f977c200700 1 -- 172.21.15.82:0/2266941609 shutdown_connections 2024-05-03T22:17:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.210+0000 7f977c200700 1 -- 172.21.15.82:0/2266941609 wait complete. 2024-05-03T22:17:19.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.211+0000 7f977c200700 1 Processor -- start 2024-05-03T22:17:19.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.211+0000 7f977c200700 1 -- start start 2024-05-03T22:17:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.211+0000 7f977c200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9774109b40 0x7f977419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.211+0000 7f977c200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f977410ad40 0x7f977419ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.211+0000 7f977c200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977410b6e0 0x7f97741a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.211+0000 7f977c200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9774115460 con 0x7f977410b6e0 2024-05-03T22:17:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.211+0000 7f977c200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f97741152e0 con 0x7f977410ad40 2024-05-03T22:17:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.211+0000 7f977c200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97741155e0 con 0x7f9774109b40 2024-05-03T22:17:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.212+0000 7f977a200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977410b6e0 0x7f97741a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.212+0000 7f977a200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977410b6e0 0x7f97741a7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57150/0 (socket says 172.21.15.82:57150) 2024-05-03T22:17:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.212+0000 7f977a200700 1 -- 172.21.15.82:0/2306301909 learned_addr learned my addr 172.21.15.82:0/2306301909 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.212+0000 7f9778e00700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f977410ad40 0x7f977419ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.212+0000 7f9779800700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9774109b40 0x7f977419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.212+0000 7f977a200700 1 -- 172.21.15.82:0/2306301909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9774109b40 msgr2=0x7f977419fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.212+0000 7f977a200700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9774109b40 0x7f977419fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.212+0000 7f977a200700 1 -- 172.21.15.82:0/2306301909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f977410ad40 msgr2=0x7f977419ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.212+0000 7f977a200700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f977410ad40 0x7f977419ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.212+0000 7f977a200700 1 -- 172.21.15.82:0/2306301909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97741a76d0 con 0x7f977410b6e0 2024-05-03T22:17:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.212+0000 7f9778e00700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f977410ad40 0x7f977419ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:17:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.213+0000 7f977a200700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977410b6e0 0x7f97741a7030 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f976c007f10 tx=0x7f976c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.213+0000 7f9772000700 1 -- 172.21.15.82:0/2306301909 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c004bb0 con 0x7f977410b6e0 2024-05-03T22:17:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.213+0000 7f9772000700 1 -- 172.21.15.82:0/2306301909 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f976c004d50 con 0x7f977410b6e0 2024-05-03T22:17:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.213+0000 7f9772000700 1 -- 172.21.15.82:0/2306301909 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c005970 con 0x7f977410b6e0 2024-05-03T22:17:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.213+0000 7f977c200700 1 -- 172.21.15.82:0/2306301909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97741a79c0 con 0x7f977410b6e0 2024-05-03T22:17:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.213+0000 7f977c200700 1 -- 172.21.15.82:0/2306301909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97741a7eb0 con 0x7f977410b6e0 2024-05-03T22:17:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.214+0000 7f977c200700 1 -- 172.21.15.82:0/2306301909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f977406a190 con 0x7f977410b6e0 2024-05-03T22:17:19.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.218+0000 7f9772000700 1 -- 172.21.15.82:0/2306301909 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f976c01a020 con 0x7f977410b6e0 2024-05-03T22:17:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.220+0000 7f9772000700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f975c0b2910 0x7f975c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.220+0000 7f9772000700 1 -- 172.21.15.82:0/2306301909 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f976c0e2640 con 0x7f977410b6e0 2024-05-03T22:17:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.220+0000 7f9779800700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f975c0b2910 0x7f975c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.221+0000 7f9779800700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f975c0b2910 0x7f975c0b4dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9768005fd0 tx=0x7f9768005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.223+0000 7f9772000700 1 -- 172.21.15.82:0/2306301909 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f976c010070 con 0x7f977410b6e0 2024-05-03T22:17:19.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.465+0000 7f977c200700 1 -- 172.21.15.82:0/2306301909 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f97740638e0 con 0x7f975c0b2910 2024-05-03T22:17:19.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.482+0000 7f9772000700 1 -- 172.21.15.82:0/2306301909 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f97740638e0 con 0x7f975c0b2910 2024-05-03T22:17:19.484 INFO:teuthology.orchestra.run.smithi082.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-03T22:17:19.484 INFO:teuthology.orchestra.run.smithi082.stdout:mds.all 12/12 2m ago 5m smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi130=c;smithi130=f;smithi130=i;smithi130=l;count:12 2024-05-03T22:17:19.484 INFO:teuthology.orchestra.run.smithi082.stdout:mgr 3/3 2m ago 13m smithi082=x;smithi116=y;smithi130=z;count:3 2024-05-03T22:17:19.484 INFO:teuthology.orchestra.run.smithi082.stdout:mon 3/3 2m ago 13m smithi082:172.21.15.82=a;smithi116:172.21.15.116=b;smithi130:172.21.15.130=c;count:3 2024-05-03T22:17:19.485 INFO:teuthology.orchestra.run.smithi082.stdout:osd 12 2m ago - 2024-05-03T22:17:19.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.485+0000 7f977c200700 1 -- 172.21.15.82:0/2306301909 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f975c0b2910 msgr2=0x7f975c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.485+0000 7f977c200700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f975c0b2910 0x7f975c0b4dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9768005fd0 tx=0x7f9768005e50 comp rx=0 tx=0).stop 2024-05-03T22:17:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.485+0000 7f977c200700 1 -- 172.21.15.82:0/2306301909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977410b6e0 msgr2=0x7f97741a7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.485+0000 7f977c200700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977410b6e0 0x7f97741a7030 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f976c007f10 tx=0x7f976c00d3b0 comp rx=0 tx=0).stop 2024-05-03T22:17:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.486+0000 7f977c200700 1 -- 172.21.15.82:0/2306301909 shutdown_connections 2024-05-03T22:17:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.486+0000 7f977c200700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f975c0b2910 0x7f975c0b4dd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.486+0000 7f977c200700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977410b6e0 0x7f97741a7030 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.486+0000 7f977c200700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9774109b40 0x7f977419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.486+0000 7f977c200700 1 --2- 172.21.15.82:0/2306301909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f977410ad40 0x7f977419ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.486+0000 7f977c200700 1 -- 172.21.15.82:0/2306301909 >> 172.21.15.82:0/2306301909 conn(0x7f9774078b10 msgr2=0x7f977410e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.486+0000 7f977c200700 1 -- 172.21.15.82:0/2306301909 shutdown_connections 2024-05-03T22:17:19.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:19.486+0000 7f977c200700 1 -- 172.21.15.82:0/2306301909 wait complete. 2024-05-03T22:17:20.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:20 smithi082 ceph-mon[28404]: pgmap v523: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:20.505 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-03T22:17:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:20 smithi116 ceph-mon[31828]: pgmap v523: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:20 smithi130 ceph-mon[32417]: pgmap v523: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:20.952 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:21.366 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:21 smithi082 ceph-mon[28404]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:21.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:21 smithi116 ceph-mon[31828]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:21.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:21 smithi130 ceph-mon[32417]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:22 smithi082 ceph-mon[28404]: pgmap v524: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:22 smithi116 ceph-mon[31828]: pgmap v524: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:22 smithi130 ceph-mon[32417]: pgmap v524: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:23.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.590+0000 7fc677000700 1 -- 172.21.15.82:0/2883801340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc670106940 msgr2=0x7fc670106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:23.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.590+0000 7fc677000700 1 --2- 172.21.15.82:0/2883801340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc670106940 0x7fc670106da0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0099c0 tx=0x7fc65c009cd0 comp rx=0 tx=0).stop 2024-05-03T22:17:23.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.590+0000 7fc677000700 1 -- 172.21.15.82:0/2883801340 shutdown_connections 2024-05-03T22:17:23.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.590+0000 7fc677000700 1 --2- 172.21.15.82:0/2883801340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6701072e0 0x7fc67010db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:23.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.590+0000 7fc677000700 1 --2- 172.21.15.82:0/2883801340 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc670105740 0x7fc670105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:23.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.590+0000 7fc677000700 1 --2- 172.21.15.82:0/2883801340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc670106940 0x7fc670106da0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:23.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.590+0000 7fc677000700 1 -- 172.21.15.82:0/2883801340 >> 172.21.15.82:0/2883801340 conn(0x7fc670100d00 msgr2=0x7fc670103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:23.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.590+0000 7fc677000700 1 -- 172.21.15.82:0/2883801340 shutdown_connections 2024-05-03T22:17:23.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.590+0000 7fc677000700 1 -- 172.21.15.82:0/2883801340 wait complete. 2024-05-03T22:17:23.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.591+0000 7fc677000700 1 Processor -- start 2024-05-03T22:17:23.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.591+0000 7fc677000700 1 -- start start 2024-05-03T22:17:23.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.592+0000 7fc677000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc670105740 0x7fc67019b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:23.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.592+0000 7fc677000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc670106940 0x7fc67019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:23.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.592+0000 7fc677000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6701072e0 0x7fc6701a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:23.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.592+0000 7fc677000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc670111090 con 0x7fc6701072e0 2024-05-03T22:17:23.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.592+0000 7fc677000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc670110f10 con 0x7fc670106940 2024-05-03T22:17:23.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.592+0000 7fc677000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc670111210 con 0x7fc670105740 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.592+0000 7fc675000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6701072e0 0x7fc6701a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.592+0000 7fc675000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6701072e0 0x7fc6701a2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57174/0 (socket says 172.21.15.82:57174) 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.592+0000 7fc675000700 1 -- 172.21.15.82:0/2412776551 learned_addr learned my addr 172.21.15.82:0/2412776551 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.592+0000 7fc66fe00700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc670105740 0x7fc67019b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.592+0000 7fc66f400700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc670106940 0x7fc67019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc675000700 1 -- 172.21.15.82:0/2412776551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc670105740 msgr2=0x7fc67019b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc675000700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc670105740 0x7fc67019b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc675000700 1 -- 172.21.15.82:0/2412776551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc670106940 msgr2=0x7fc67019bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc675000700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc670106940 0x7fc67019bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc675000700 1 -- 172.21.15.82:0/2412776551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6701a3390 con 0x7fc6701072e0 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc66f400700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc670106940 0x7fc67019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc675000700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6701072e0 0x7fc6701a2cf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc66800ef60 tx=0x7fc66800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc66cc00700 1 -- 172.21.15.82:0/2412776551 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6680092e0 con 0x7fc6701072e0 2024-05-03T22:17:23.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc66cc00700 1 -- 172.21.15.82:0/2412776551 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc668004bb0 con 0x7fc6701072e0 2024-05-03T22:17:23.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc66cc00700 1 -- 172.21.15.82:0/2412776551 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668004020 con 0x7fc6701072e0 2024-05-03T22:17:23.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc677000700 1 -- 172.21.15.82:0/2412776551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6701a3620 con 0x7fc6701072e0 2024-05-03T22:17:23.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.593+0000 7fc677000700 1 -- 172.21.15.82:0/2412776551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6701a3bb0 con 0x7fc6701072e0 2024-05-03T22:17:23.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.595+0000 7fc677000700 1 -- 172.21.15.82:0/2412776551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc67006a190 con 0x7fc6701072e0 2024-05-03T22:17:23.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.597+0000 7fc66cc00700 1 -- 172.21.15.82:0/2412776551 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc66801b030 con 0x7fc6701072e0 2024-05-03T22:17:23.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.598+0000 7fc66cc00700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc6540b2990 0x7fc6540b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:23.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.599+0000 7fc66cc00700 1 -- 172.21.15.82:0/2412776551 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fc6680e2b10 con 0x7fc6701072e0 2024-05-03T22:17:23.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.599+0000 7fc66fe00700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc6540b2990 0x7fc6540b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:23.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.600+0000 7fc66fe00700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc6540b2990 0x7fc6540b4e50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc6701067a0 tx=0x7fc660007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:23.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.601+0000 7fc66cc00700 1 -- 172.21.15.82:0/2412776551 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc668022020 con 0x7fc6701072e0 2024-05-03T22:17:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.838+0000 7fc677000700 1 -- 172.21.15.82:0/2412776551 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fc6700639a0 con 0x7fc6540b2990 2024-05-03T22:17:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.842+0000 7fc66cc00700 1 -- 172.21.15.82:0/2412776551 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fc6700639a0 con 0x7fc6540b2990 2024-05-03T22:17:23.844 INFO:teuthology.orchestra.run.smithi082.stdout:HOST ADDR LABELS STATUS 2024-05-03T22:17:23.844 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 172.21.15.82 2024-05-03T22:17:23.844 INFO:teuthology.orchestra.run.smithi082.stdout:smithi116 172.21.15.116 2024-05-03T22:17:23.844 INFO:teuthology.orchestra.run.smithi082.stdout:smithi130 172.21.15.130 2024-05-03T22:17:23.844 INFO:teuthology.orchestra.run.smithi082.stdout:3 hosts in cluster 2024-05-03T22:17:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 -- 172.21.15.82:0/2412776551 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc6540b2990 msgr2=0x7fc6540b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc6540b2990 0x7fc6540b4e50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc6701067a0 tx=0x7fc660007400 comp rx=0 tx=0).stop 2024-05-03T22:17:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 -- 172.21.15.82:0/2412776551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6701072e0 msgr2=0x7fc6701a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6701072e0 0x7fc6701a2cf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc66800ef60 tx=0x7fc66800ef90 comp rx=0 tx=0).stop 2024-05-03T22:17:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 -- 172.21.15.82:0/2412776551 shutdown_connections 2024-05-03T22:17:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc6540b2990 0x7fc6540b4e50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6701072e0 0x7fc6701a2cf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc670105740 0x7fc67019b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 --2- 172.21.15.82:0/2412776551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc670106940 0x7fc67019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 -- 172.21.15.82:0/2412776551 >> 172.21.15.82:0/2412776551 conn(0x7fc670100d00 msgr2=0x7fc670109c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 -- 172.21.15.82:0/2412776551 shutdown_connections 2024-05-03T22:17:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:23.845+0000 7fc677000700 1 -- 172.21.15.82:0/2412776551 wait complete. 2024-05-03T22:17:24.580 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:24 smithi130 ceph-mon[32417]: pgmap v525: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:24 smithi116 ceph-mon[31828]: pgmap v525: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:24.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:24 smithi082 ceph-mon[28404]: pgmap v525: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:24.918 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-03T22:17:25.372 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:25.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:25 smithi116 ceph-mon[31828]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:25.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:25 smithi082 ceph-mon[28404]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:25.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:25 smithi130 ceph-mon[32417]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:26.586 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:26 smithi082 ceph-mon[28404]: pgmap v526: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:26.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:26 smithi116 ceph-mon[31828]: pgmap v526: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:26.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:26 smithi130 ceph-mon[32417]: pgmap v526: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:28.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.021+0000 7f6719e00700 1 -- 172.21.15.82:0/3544438973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6714105350 msgr2=0x7f67141057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:28.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.021+0000 7f6719e00700 1 --2- 172.21.15.82:0/3544438973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6714105350 0x7f67141057b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6700009990 tx=0x7f6700009ca0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.021+0000 7f6719e00700 1 -- 172.21.15.82:0/3544438973 shutdown_connections 2024-05-03T22:17:28.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.021+0000 7f6719e00700 1 --2- 172.21.15.82:0/3544438973 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6714105cf0 0x7f671410db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.021+0000 7f6719e00700 1 --2- 172.21.15.82:0/3544438973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6714106e10 0x7f6714107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.021+0000 7f6719e00700 1 --2- 172.21.15.82:0/3544438973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6714105350 0x7f67141057b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.021+0000 7f6719e00700 1 -- 172.21.15.82:0/3544438973 >> 172.21.15.82:0/3544438973 conn(0x7f6714100cf0 msgr2=0x7f6714103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:28.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.021+0000 7f6719e00700 1 -- 172.21.15.82:0/3544438973 shutdown_connections 2024-05-03T22:17:28.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.021+0000 7f6719e00700 1 -- 172.21.15.82:0/3544438973 wait complete. 2024-05-03T22:17:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.022+0000 7f6719e00700 1 Processor -- start 2024-05-03T22:17:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.022+0000 7f6719e00700 1 -- start start 2024-05-03T22:17:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.023+0000 7f6719e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6714105350 0x7f671419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.023+0000 7f6719e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6714105cf0 0x7f671419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.023+0000 7f6719e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6714106e10 0x7f67141a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.023+0000 7f6719e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f67141111d0 con 0x7f6714105cf0 2024-05-03T22:17:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.023+0000 7f6719e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6714111050 con 0x7f6714106e10 2024-05-03T22:17:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.023+0000 7f6719e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6714111350 con 0x7f6714105350 2024-05-03T22:17:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.023+0000 7f6712000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6714105cf0 0x7f671419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.023+0000 7f6712000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6714105cf0 0x7f671419bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52342/0 (socket says 172.21.15.82:52342) 2024-05-03T22:17:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.023+0000 7f6712000700 1 -- 172.21.15.82:0/4042936755 learned_addr learned my addr 172.21.15.82:0/4042936755 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:28.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.023+0000 7f6712a00700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6714105350 0x7f671419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:28.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.024+0000 7f6713400700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6714106e10 0x7f67141a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:28.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.024+0000 7f6712000700 1 -- 172.21.15.82:0/4042936755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6714105350 msgr2=0x7f671419b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:28.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.024+0000 7f6712000700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6714105350 0x7f671419b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.024+0000 7f6712000700 1 -- 172.21.15.82:0/4042936755 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6714106e10 msgr2=0x7f67141a2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:28.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.024+0000 7f6712000700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6714106e10 0x7f67141a2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.024+0000 7f6712000700 1 -- 172.21.15.82:0/4042936755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67141a34b0 con 0x7f6714105cf0 2024-05-03T22:17:28.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.024+0000 7f6712a00700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6714105350 0x7f671419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:17:28.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.024+0000 7f6712000700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6714105cf0 0x7f671419bd90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f67000057c0 tx=0x7f67000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:28.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.024+0000 7f6718a00700 1 -- 172.21.15.82:0/4042936755 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700027070 con 0x7f6714105cf0 2024-05-03T22:17:28.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.025+0000 7f6719e00700 1 -- 172.21.15.82:0/4042936755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67141a3740 con 0x7f6714105cf0 2024-05-03T22:17:28.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.025+0000 7f6718a00700 1 -- 172.21.15.82:0/4042936755 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67000040e0 con 0x7f6714105cf0 2024-05-03T22:17:28.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.025+0000 7f6718a00700 1 -- 172.21.15.82:0/4042936755 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700022e30 con 0x7f6714105cf0 2024-05-03T22:17:28.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.025+0000 7f6719e00700 1 -- 172.21.15.82:0/4042936755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67141a3b90 con 0x7f6714105cf0 2024-05-03T22:17:28.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.026+0000 7f6719e00700 1 -- 172.21.15.82:0/4042936755 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f671406a190 con 0x7f6714105cf0 2024-05-03T22:17:28.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.028+0000 7f6718a00700 1 -- 172.21.15.82:0/4042936755 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f670002a070 con 0x7f6714105cf0 2024-05-03T22:17:28.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.030+0000 7f6718a00700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f66f80b2910 0x7f66f80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:28.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.030+0000 7f6718a00700 1 -- 172.21.15.82:0/4042936755 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f67000e3a80 con 0x7f6714105cf0 2024-05-03T22:17:28.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.030+0000 7f6712a00700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f66f80b2910 0x7f66f80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:28.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.031+0000 7f6712a00700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f66f80b2910 0x7f66f80b4dd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6704005950 tx=0x7f67040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:28.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.035+0000 7f6718a00700 1 -- 172.21.15.82:0/4042936755 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f67000e5e20 con 0x7f6714105cf0 2024-05-03T22:17:28.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.280+0000 7f6719e00700 1 -- 172.21.15.82:0/4042936755 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f671402e8b0 con 0x7f66f80b2910 2024-05-03T22:17:28.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.284+0000 7f6718a00700 1 -- 172.21.15.82:0/4042936755 <== mgr.14152 v2:172.21.15.82:6800/3338115086 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f671402e8b0 con 0x7f66f80b2910 2024-05-03T22:17:28.286 INFO:teuthology.orchestra.run.smithi082.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-03T22:17:28.286 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 7m ago Has a FileSystem, LVM detected 2024-05-03T22:17:28.286 INFO:teuthology.orchestra.run.smithi082.stdout:smithi116 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VJ400BGN 372G No 6m ago Has a FileSystem, LVM detected 2024-05-03T22:17:28.286 INFO:teuthology.orchestra.run.smithi082.stdout:smithi130 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500Q1400BGN 372G No 6m ago Has a FileSystem, LVM detected 2024-05-03T22:17:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.287+0000 7f6719e00700 1 -- 172.21.15.82:0/4042936755 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f66f80b2910 msgr2=0x7f66f80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.287+0000 7f6719e00700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f66f80b2910 0x7f66f80b4dd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6704005950 tx=0x7f67040058e0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.287+0000 7f6719e00700 1 -- 172.21.15.82:0/4042936755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6714105cf0 msgr2=0x7f671419bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.287+0000 7f6719e00700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6714105cf0 0x7f671419bd90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f67000057c0 tx=0x7f67000057f0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.287+0000 7f6719e00700 1 -- 172.21.15.82:0/4042936755 shutdown_connections 2024-05-03T22:17:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.287+0000 7f6719e00700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f66f80b2910 0x7f66f80b4dd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.287+0000 7f6719e00700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6714106e10 0x7f67141a2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.287+0000 7f6719e00700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6714105350 0x7f671419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.287+0000 7f6719e00700 1 --2- 172.21.15.82:0/4042936755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6714105cf0 0x7f671419bd90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.287+0000 7f6719e00700 1 -- 172.21.15.82:0/4042936755 >> 172.21.15.82:0/4042936755 conn(0x7f6714100cf0 msgr2=0x7f6714109c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.287+0000 7f6719e00700 1 -- 172.21.15.82:0/4042936755 shutdown_connections 2024-05-03T22:17:28.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:28.288+0000 7f6719e00700 1 -- 172.21.15.82:0/4042936755 wait complete. 2024-05-03T22:17:28.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:28 smithi116 ceph-mon[31828]: pgmap v527: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:28.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:28 smithi082 ceph-mon[28404]: pgmap v527: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:28.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:28 smithi130 ceph-mon[32417]: pgmap v527: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:29.348 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-03T22:17:29.360 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-05-03T22:17:29.361 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-03T22:17:29.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:29 smithi116 ceph-mon[31828]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:29.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:29 smithi082 ceph-mon[28404]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:29.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:29 smithi130 ceph-mon[32417]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:17:29.806 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:30.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:30 smithi082 ceph-mon[28404]: pgmap v528: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:30.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:30 smithi116 ceph-mon[31828]: pgmap v528: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:30.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:30 smithi130 ceph-mon[32417]: pgmap v528: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:32.409 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:32 smithi082 ceph-mon[28404]: pgmap v529: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.431+0000 7fb681e00700 1 -- 172.21.15.82:0/3962876870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c106940 msgr2=0x7fb67c106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.431+0000 7fb681e00700 1 --2- 172.21.15.82:0/3962876870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c106940 0x7fb67c106da0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb6640099c0 tx=0x7fb664009cd0 comp rx=0 tx=0).stop 2024-05-03T22:17:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.431+0000 7fb681e00700 1 -- 172.21.15.82:0/3962876870 shutdown_connections 2024-05-03T22:17:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.431+0000 7fb681e00700 1 --2- 172.21.15.82:0/3962876870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb67c1072e0 0x7fb67c10db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.431+0000 7fb681e00700 1 --2- 172.21.15.82:0/3962876870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c105740 0x7fb67c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.431+0000 7fb681e00700 1 --2- 172.21.15.82:0/3962876870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c106940 0x7fb67c106da0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.431+0000 7fb681e00700 1 -- 172.21.15.82:0/3962876870 >> 172.21.15.82:0/3962876870 conn(0x7fb67c100d00 msgr2=0x7fb67c103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.431+0000 7fb681e00700 1 -- 172.21.15.82:0/3962876870 shutdown_connections 2024-05-03T22:17:32.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.431+0000 7fb681e00700 1 -- 172.21.15.82:0/3962876870 wait complete. 2024-05-03T22:17:32.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.432+0000 7fb681e00700 1 Processor -- start 2024-05-03T22:17:32.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.432+0000 7fb681e00700 1 -- start start 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.433+0000 7fb681e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c105740 0x7fb67c19b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.433+0000 7fb681e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb67c106940 0x7fb67c19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.433+0000 7fb681e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c1072e0 0x7fb67c1a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.433+0000 7fb681e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c1110b0 con 0x7fb67c1072e0 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.433+0000 7fb681e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c110f30 con 0x7fb67c105740 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.433+0000 7fb681e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c111230 con 0x7fb67c106940 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.433+0000 7fb67b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c1072e0 0x7fb67c1a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.433+0000 7fb67b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c1072e0 0x7fb67c1a2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52356/0 (socket says 172.21.15.82:52356) 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.433+0000 7fb67b400700 1 -- 172.21.15.82:0/3954623291 learned_addr learned my addr 172.21.15.82:0/3954623291 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.433+0000 7fb67aa00700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c105740 0x7fb67c19b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.433+0000 7fb673e00700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb67c106940 0x7fb67c19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.434+0000 7fb67b400700 1 -- 172.21.15.82:0/3954623291 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb67c106940 msgr2=0x7fb67c19bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.434+0000 7fb67b400700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb67c106940 0x7fb67c19bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.434+0000 7fb67b400700 1 -- 172.21.15.82:0/3954623291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c105740 msgr2=0x7fb67c19b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:32.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.434+0000 7fb67b400700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c105740 0x7fb67c19b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:32.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.434+0000 7fb67b400700 1 -- 172.21.15.82:0/3954623291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c1a3390 con 0x7fb67c1072e0 2024-05-03T22:17:32.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.434+0000 7fb67b400700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c1072e0 0x7fb67c1a2cf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb674007da0 tx=0x7fb67400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:32.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.434+0000 7fb680a00700 1 -- 172.21.15.82:0/3954623291 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674016020 con 0x7fb67c1072e0 2024-05-03T22:17:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.434+0000 7fb680a00700 1 -- 172.21.15.82:0/3954623291 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb67400ad00 con 0x7fb67c1072e0 2024-05-03T22:17:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.434+0000 7fb680a00700 1 -- 172.21.15.82:0/3954623291 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6740115e0 con 0x7fb67c1072e0 2024-05-03T22:17:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.434+0000 7fb681e00700 1 -- 172.21.15.82:0/3954623291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67c1a3680 con 0x7fb67c1072e0 2024-05-03T22:17:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.434+0000 7fb681e00700 1 -- 172.21.15.82:0/3954623291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67c1a3b70 con 0x7fb67c1072e0 2024-05-03T22:17:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.436+0000 7fb681e00700 1 -- 172.21.15.82:0/3954623291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67c06a190 con 0x7fb67c1072e0 2024-05-03T22:17:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.438+0000 7fb680a00700 1 -- 172.21.15.82:0/3954623291 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb674019020 con 0x7fb67c1072e0 2024-05-03T22:17:32.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.439+0000 7fb680a00700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb6600b2910 0x7fb6600b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:32.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.440+0000 7fb680a00700 1 -- 172.21.15.82:0/3954623291 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fb6740e2bf0 con 0x7fb67c1072e0 2024-05-03T22:17:32.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.440+0000 7fb67aa00700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb6600b2910 0x7fb6600b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:32.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.441+0000 7fb67aa00700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb6600b2910 0x7fb6600b4dd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb67c1067a0 tx=0x7fb66c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:32.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.442+0000 7fb680a00700 1 -- 172.21.15.82:0/3954623291 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb674020020 con 0x7fb67c1072e0 2024-05-03T22:17:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:32 smithi116 ceph-mon[31828]: pgmap v529: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.725+0000 7fb681e00700 1 -- 172.21.15.82:0/3954623291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb67c02e540 con 0x7fb67c1072e0 2024-05-03T22:17:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.725+0000 7fb680a00700 1 -- 172.21.15.82:0/3954623291 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+3098 (secure 0 0 0) 0x7fb674055e20 con 0x7fb67c1072e0 2024-05-03T22:17:32.728 INFO:teuthology.orchestra.run.smithi082.stdout:e29 2024-05-03T22:17:32.728 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T22:17:32.728 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T22:17:32.728 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-05-03T22:17:32.728 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:17:32.728 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-05-03T22:17:32.728 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-05-03T22:17:32.728 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 29 2024-05-03T22:17:32.728 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-05-03T22:12:39.270198+0000 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-05-03T22:14:10.244210+0000 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 300 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 5 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1,2,3,4 2024-05-03T22:17:32.729 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34460,1=34433,2=34412,3=34403,4=24469} 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3,4] 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data disabled 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 0 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34460 members: 24469,34403,34460,34433,34412 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b{0:34460} state up:active seq 7 addr [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c{0:24451} state up:standby-replay seq 1 addr [v2:172.21.15.130:6836/4246597354,v1:172.21.15.130:6837/4246597354] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.730 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.h{1:34433} state up:active seq 32 addr [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.f{1:24445} state up:standby-replay seq 1 addr [v2:172.21.15.130:6834/710741525,v1:172.21.15.130:6835/710741525] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.e{2:34412} state up:active seq 36 addr [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.l{2:24421} state up:standby-replay seq 1 addr [v2:172.21.15.130:6832/2041703143,v1:172.21.15.130:6833/2041703143] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.k{3:34403} state up:active seq 40 addr [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a{3:14595} state up:standby-replay seq 1 addr [v2:172.21.15.82:6840/1188447125,v1:172.21.15.82:6841/1188447125] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.i{4:24469} state up:active seq 32 addr [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.g{4:14583} state up:standby-replay seq 1 addr [v2:172.21.15.82:6838/4287485607,v1:172.21.15.82:6839/4287485607] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.82:6834/288630872,v1:172.21.15.82:6835/288630872] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.731 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d{-1:14535} state up:standby seq 1 addr [v2:172.21.15.82:6836/2933152339,v1:172.21.15.82:6837/2933152339] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:17:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.728+0000 7fb681e00700 1 -- 172.21.15.82:0/3954623291 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb6600b2910 msgr2=0x7fb6600b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.728+0000 7fb681e00700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb6600b2910 0x7fb6600b4dd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb67c1067a0 tx=0x7fb66c00b410 comp rx=0 tx=0).stop 2024-05-03T22:17:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.728+0000 7fb681e00700 1 -- 172.21.15.82:0/3954623291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c1072e0 msgr2=0x7fb67c1a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.728+0000 7fb681e00700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c1072e0 0x7fb67c1a2cf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb674007da0 tx=0x7fb67400a340 comp rx=0 tx=0).stop 2024-05-03T22:17:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.729+0000 7fb681e00700 1 -- 172.21.15.82:0/3954623291 shutdown_connections 2024-05-03T22:17:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.729+0000 7fb681e00700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fb6600b2910 0x7fb6600b4dd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.729+0000 7fb681e00700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb67c1072e0 0x7fb67c1a2cf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.729+0000 7fb681e00700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb67c105740 0x7fb67c19b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.729+0000 7fb681e00700 1 --2- 172.21.15.82:0/3954623291 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb67c106940 0x7fb67c19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.729+0000 7fb681e00700 1 -- 172.21.15.82:0/3954623291 >> 172.21.15.82:0/3954623291 conn(0x7fb67c100d00 msgr2=0x7fb67c109c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.729+0000 7fb681e00700 1 -- 172.21.15.82:0/3954623291 shutdown_connections 2024-05-03T22:17:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:32.729+0000 7fb681e00700 1 -- 172.21.15.82:0/3954623291 wait complete. 2024-05-03T22:17:32.733 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-05-03T22:17:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:32 smithi130 ceph-mon[32417]: pgmap v529: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:33.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:33 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3954623291' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-03T22:17:33.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:33 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3954623291' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-03T22:17:33.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:33 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3954623291' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-03T22:17:33.784 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-03T22:17:34.235 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:34.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:34 smithi082 ceph-mon[28404]: pgmap v530: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:34 smithi116 ceph-mon[31828]: pgmap v530: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:34.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:34 smithi130 ceph-mon[32417]: pgmap v530: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:36.423 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:36 smithi082 ceph-mon[28404]: pgmap v531: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:36 smithi116 ceph-mon[31828]: pgmap v531: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.763+0000 7faddb800700 1 -- 172.21.15.82:0/4230903485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd4103510 msgr2=0x7fadd4103930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.763+0000 7faddb800700 1 --2- 172.21.15.82:0/4230903485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd4103510 0x7fadd4103930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fadc80099c0 tx=0x7fadc8009cd0 comp rx=0 tx=0).stop 2024-05-03T22:17:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.763+0000 7faddb800700 1 -- 172.21.15.82:0/4230903485 shutdown_connections 2024-05-03T22:17:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.763+0000 7faddb800700 1 --2- 172.21.15.82:0/4230903485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd4103510 0x7fadd4103930 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.763+0000 7faddb800700 1 --2- 172.21.15.82:0/4230903485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd41050b0 0x7fadd410b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.763+0000 7faddb800700 1 --2- 172.21.15.82:0/4230903485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadd4104710 0x7fadd4104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.763+0000 7faddb800700 1 -- 172.21.15.82:0/4230903485 >> 172.21.15.82:0/4230903485 conn(0x7fadd40fea70 msgr2=0x7fadd4100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.763+0000 7faddb800700 1 -- 172.21.15.82:0/4230903485 shutdown_connections 2024-05-03T22:17:36.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.763+0000 7faddb800700 1 -- 172.21.15.82:0/4230903485 wait complete. 2024-05-03T22:17:36.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.765+0000 7faddb800700 1 Processor -- start 2024-05-03T22:17:36.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.765+0000 7faddb800700 1 -- start start 2024-05-03T22:17:36.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.765+0000 7faddb800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadd4103510 0x7fadd419b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:36.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.765+0000 7faddb800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd4104710 0x7fadd419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:36.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.765+0000 7faddb800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd41050b0 0x7fadd41a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:36.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.765+0000 7faddb800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fadd410eeb0 con 0x7fadd4104710 2024-05-03T22:17:36.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.765+0000 7faddb800700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fadd410ed30 con 0x7fadd4103510 2024-05-03T22:17:36.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.765+0000 7faddb800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fadd410f030 con 0x7fadd41050b0 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd4104710 0x7fadd419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd4104710 0x7fadd419bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39932/0 (socket says 172.21.15.82:39932) 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd3e00700 1 -- 172.21.15.82:0/3437110986 learned_addr learned my addr 172.21.15.82:0/3437110986 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd8e00700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadd4103510 0x7fadd419b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd9800700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd41050b0 0x7fadd41a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd3e00700 1 -- 172.21.15.82:0/3437110986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd41050b0 msgr2=0x7fadd41a2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd3e00700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd41050b0 0x7fadd41a2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd3e00700 1 -- 172.21.15.82:0/3437110986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadd4103510 msgr2=0x7fadd419b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd3e00700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadd4103510 0x7fadd419b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd3e00700 1 -- 172.21.15.82:0/3437110986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd41a33f0 con 0x7fadd4104710 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd9800700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd41050b0 0x7fadd41a2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:17:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.766+0000 7fadd3e00700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd4104710 0x7fadd419bcd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c9e0 tx=0x7fadc000cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.767+0000 7fadd1600700 1 -- 172.21.15.82:0/3437110986 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0007ac0 con 0x7fadd4104710 2024-05-03T22:17:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.767+0000 7faddb800700 1 -- 172.21.15.82:0/3437110986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd41a36e0 con 0x7fadd4104710 2024-05-03T22:17:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.767+0000 7fadd1600700 1 -- 172.21.15.82:0/3437110986 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadc0007c60 con 0x7fadd4104710 2024-05-03T22:17:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.767+0000 7fadd1600700 1 -- 172.21.15.82:0/3437110986 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0018660 con 0x7fadd4104710 2024-05-03T22:17:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.767+0000 7faddb800700 1 -- 172.21.15.82:0/3437110986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd41a3c70 con 0x7fadd4104710 2024-05-03T22:17:36.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.768+0000 7faddb800700 1 -- 172.21.15.82:0/3437110986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd406a190 con 0x7fadd4104710 2024-05-03T22:17:36.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.771+0000 7fadd1600700 1 -- 172.21.15.82:0/3437110986 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fadc000f450 con 0x7fadd4104710 2024-05-03T22:17:36.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.772+0000 7fadd1600700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fadbc0b2910 0x7fadbc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:36.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.772+0000 7fadd1600700 1 -- 172.21.15.82:0/3437110986 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fadc00e2780 con 0x7fadd4104710 2024-05-03T22:17:36.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.772+0000 7fadd8e00700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fadbc0b2910 0x7fadbc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:36.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.773+0000 7fadd8e00700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fadbc0b2910 0x7fadbc0b4dd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fadc80098e0 tx=0x7fadc801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:36.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:36 smithi130 ceph-mon[32417]: pgmap v531: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:36.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:36.777+0000 7fadd1600700 1 -- 172.21.15.82:0/3437110986 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fadc0014030 con 0x7fadd4104710 2024-05-03T22:17:37.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.008+0000 7faddb800700 1 -- 172.21.15.82:0/3437110986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fadd41a40a0 con 0x7fadd4104710 2024-05-03T22:17:37.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.010+0000 7fadd1600700 1 -- 172.21.15.82:0/3437110986 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v92) ==== 56+0+5681 (secure 0 0 0) 0x7fadc00a9f20 con 0x7fadd4104710 2024-05-03T22:17:37.013 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 92 2024-05-03T22:17:37.013 INFO:teuthology.orchestra.run.smithi082.stdout:fsid 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:17:37.013 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-05-03T22:01:26.555248+0000 2024-05-03T22:17:37.013 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-05-03T22:14:38.277415+0000 2024-05-03T22:17:37.013 INFO:teuthology.orchestra.run.smithi082.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:crush_version 27 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:full_ratio 0.95 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:backfillfull_ratio 0.9 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:nearfull_ratio 0.85 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:require_min_compat_client luminous 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:min_compat_client luminous 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:require_osd_release squid 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:stretch_mode_enabled false 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-05-03T22:17:37.014 INFO:teuthology.orchestra.run.smithi082.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:max_osd 12 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6802/1505062646,v1:172.21.15.82:6803/1505062646] [v2:172.21.15.82:6804/1505062646,v1:172.21.15.82:6805/1505062646] exists,up 636c5286-4826-4d3b-a79c-cf7abe97433f 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 up in weight 1 up_from 13 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/1867277608,v1:172.21.15.116:6801/1867277608] [v2:172.21.15.116:6802/1867277608,v1:172.21.15.116:6803/1867277608] exists,up 41174bd4-ab44-4c4d-9da9-bb2df85f6fd4 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 up in weight 1 up_from 18 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6800/2477946365,v1:172.21.15.130:6801/2477946365] [v2:172.21.15.130:6802/2477946365,v1:172.21.15.130:6803/2477946365] exists,up 5574fae9-c3b9-48ce-9707-77a85389fded 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6810/3661604809,v1:172.21.15.82:6811/3661604809] [v2:172.21.15.82:6812/3661604809,v1:172.21.15.82:6813/3661604809] exists,up 6729dc19-766c-480a-ac53-3bf94391fef1 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 up in weight 1 up_from 32 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6808/3493188667,v1:172.21.15.116:6809/3493188667] [v2:172.21.15.116:6810/3493188667,v1:172.21.15.116:6811/3493188667] exists,up 6f1a58f6-d55b-4ea5-895c-68109a8e02ca 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 up in weight 1 up_from 38 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6808/378786455,v1:172.21.15.130:6809/378786455] [v2:172.21.15.130:6810/378786455,v1:172.21.15.130:6811/378786455] exists,up 0445007b-3edb-4501-b9b6-9e6a5ccfc2fa 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 up in weight 1 up_from 44 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6818/426224315,v1:172.21.15.82:6819/426224315] [v2:172.21.15.82:6820/426224315,v1:172.21.15.82:6821/426224315] exists,up 7bc2258f-990b-485d-baef-9bd16b39d4ec 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 up in weight 1 up_from 49 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6816/918923056,v1:172.21.15.116:6817/918923056] [v2:172.21.15.116:6818/918923056,v1:172.21.15.116:6819/918923056] exists,up 06aedaa7-11ea-4bfc-b2b7-1897c26376fc 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 up in weight 1 up_from 55 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6816/135638581,v1:172.21.15.130:6817/135638581] [v2:172.21.15.130:6818/135638581,v1:172.21.15.130:6819/135638581] exists,up eb8716a6-18d0-4b0a-ba8f-0809254e8982 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 up in weight 1 up_from 61 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6826/3321139669,v1:172.21.15.82:6827/3321139669] [v2:172.21.15.82:6828/3321139669,v1:172.21.15.82:6829/3321139669] exists,up 63a902a4-e216-4a8e-b994-f328086a584d 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 up in weight 1 up_from 67 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6824/2019218329,v1:172.21.15.116:6825/2019218329] [v2:172.21.15.116:6826/2019218329,v1:172.21.15.116:6827/2019218329] exists,up 2c49c2ad-a223-4996-aa9b-c44f37a029b5 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 up in weight 1 up_from 73 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6824/2407047775,v1:172.21.15.130:6825/2407047775] [v2:172.21.15.130:6826/2407047775,v1:172.21.15.130:6827/2407047775] exists,up 43b98e6d-fba6-4cea-99fc-b3f0027fc693 2024-05-03T22:17:37.015 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.5 [8,11] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.a [2,11] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.e [2,4] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.1f [8,1] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.c [3,9] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.10 [5,9] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.14 [4,6] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.1b [4,8] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.21 [4,7] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.25 [5,9] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 4.13 [9,8] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 4.18 [9,10] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 4.1c [9,8,5,10] 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1970560625 expires 2024-05-04T22:02:36.416695+0000 2024-05-03T22:17:37.016 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/167294547 expires 2024-05-04T22:02:36.416695+0000 2024-05-03T22:17:37.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/2219604538 expires 2024-05-04T22:02:36.416695+0000 2024-05-03T22:17:37.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/2219604538 expires 2024-05-04T22:02:36.416695+0000 2024-05-03T22:17:37.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/3288839212 expires 2024-05-04T22:02:00.707069+0000 2024-05-03T22:17:37.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/1944232139 expires 2024-05-04T22:02:00.707069+0000 2024-05-03T22:17:37.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/484754820 expires 2024-05-04T22:02:00.707069+0000 2024-05-03T22:17:37.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1157601153 expires 2024-05-04T22:02:00.707069+0000 2024-05-03T22:17:37.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/1944232139 expires 2024-05-04T22:02:00.707069+0000 2024-05-03T22:17:37.017 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/2702343171 expires 2024-05-04T22:02:36.416695+0000 2024-05-03T22:17:37.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 -- 172.21.15.82:0/3437110986 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fadbc0b2910 msgr2=0x7fadbc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:37.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fadbc0b2910 0x7fadbc0b4dd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fadc80098e0 tx=0x7fadc801a040 comp rx=0 tx=0).stop 2024-05-03T22:17:37.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 -- 172.21.15.82:0/3437110986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd4104710 msgr2=0x7fadd419bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:37.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd4104710 0x7fadd419bcd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c9e0 tx=0x7fadc000cda0 comp rx=0 tx=0).stop 2024-05-03T22:17:37.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 -- 172.21.15.82:0/3437110986 shutdown_connections 2024-05-03T22:17:37.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fadbc0b2910 0x7fadbc0b4dd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:37.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadd41050b0 0x7fadd41a2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:37.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadd4103510 0x7fadd419b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:37.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 --2- 172.21.15.82:0/3437110986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadd4104710 0x7fadd419bcd0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:37.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 -- 172.21.15.82:0/3437110986 >> 172.21.15.82:0/3437110986 conn(0x7fadd40fea70 msgr2=0x7fadd40756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:37.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 -- 172.21.15.82:0/3437110986 shutdown_connections 2024-05-03T22:17:37.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:37.013+0000 7faddb800700 1 -- 172.21.15.82:0/3437110986 wait complete. 2024-05-03T22:17:37.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:37 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3437110986' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-03T22:17:37.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:37 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3437110986' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-03T22:17:37.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:37 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3437110986' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-03T22:17:38.139 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-03T22:17:38.152 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:17:38.608 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:38 smithi116 ceph-mon[31828]: pgmap v532: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:38.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:38 smithi082 ceph-mon[28404]: pgmap v532: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:38 smithi130 ceph-mon[32417]: pgmap v532: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:40.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:40 smithi116 ceph-mon[31828]: pgmap v533: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:40.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:40 smithi082 ceph-mon[28404]: pgmap v533: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:40.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:40 smithi130 ceph-mon[32417]: pgmap v533: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.885+0000 7ff7efa00700 1 -- 172.21.15.82:0/2043400136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7e806c360 msgr2=0x7ff7e810fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.885+0000 7ff7efa00700 1 --2- 172.21.15.82:0/2043400136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7e806c360 0x7ff7e810fa00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009990 tx=0x7ff7d0009ca0 comp rx=0 tx=0).stop 2024-05-03T22:17:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.885+0000 7ff7efa00700 1 -- 172.21.15.82:0/2043400136 shutdown_connections 2024-05-03T22:17:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.885+0000 7ff7efa00700 1 --2- 172.21.15.82:0/2043400136 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e810ff40 0x7ff7e8112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:40.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.885+0000 7ff7efa00700 1 --2- 172.21.15.82:0/2043400136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7e806ba40 0x7ff7e806be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:40.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.885+0000 7ff7efa00700 1 --2- 172.21.15.82:0/2043400136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7e806c360 0x7ff7e810fa00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:40.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.885+0000 7ff7efa00700 1 -- 172.21.15.82:0/2043400136 >> 172.21.15.82:0/2043400136 conn(0x7ff7e8079310 msgr2=0x7ff7e8079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:40.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.885+0000 7ff7efa00700 1 -- 172.21.15.82:0/2043400136 shutdown_connections 2024-05-03T22:17:40.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.885+0000 7ff7efa00700 1 -- 172.21.15.82:0/2043400136 wait complete. 2024-05-03T22:17:40.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.886+0000 7ff7efa00700 1 Processor -- start 2024-05-03T22:17:40.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.886+0000 7ff7efa00700 1 -- start start 2024-05-03T22:17:40.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.887+0000 7ff7efa00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7e806ba40 0x7ff7e819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:40.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.887+0000 7ff7efa00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e806c360 0x7ff7e819c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.887+0000 7ff7efa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7e810ff40 0x7ff7e81a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.887+0000 7ff7efa00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e8115730 con 0x7ff7e810ff40 2024-05-03T22:17:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.887+0000 7ff7efa00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e81155b0 con 0x7ff7e806ba40 2024-05-03T22:17:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.887+0000 7ff7efa00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e81158b0 con 0x7ff7e806c360 2024-05-03T22:17:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.887+0000 7ff7eda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7e810ff40 0x7ff7e81a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.887+0000 7ff7eda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7e810ff40 0x7ff7e81a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39942/0 (socket says 172.21.15.82:39942) 2024-05-03T22:17:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.887+0000 7ff7eda00700 1 -- 172.21.15.82:0/3965151311 learned_addr learned my addr 172.21.15.82:0/3965151311 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.887+0000 7ff7ed000700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7e806ba40 0x7ff7e819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.887+0000 7ff7dfe00700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e806c360 0x7ff7e819c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:40.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.888+0000 7ff7eda00700 1 -- 172.21.15.82:0/3965151311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e806c360 msgr2=0x7ff7e819c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.888+0000 7ff7eda00700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e806c360 0x7ff7e819c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.888+0000 7ff7eda00700 1 -- 172.21.15.82:0/3965151311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7e806ba40 msgr2=0x7ff7e819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.888+0000 7ff7eda00700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7e806ba40 0x7ff7e819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.888+0000 7ff7eda00700 1 -- 172.21.15.82:0/3965151311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e81a0d50 con 0x7ff7e810ff40 2024-05-03T22:17:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.888+0000 7ff7dfe00700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e806c360 0x7ff7e819c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:17:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.888+0000 7ff7eda00700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7e810ff40 0x7ff7e81a0610 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00094f0 tx=0x7ff7e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.888+0000 7ff7e6000700 1 -- 172.21.15.82:0/3965151311 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000ddd0 con 0x7ff7e810ff40 2024-05-03T22:17:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.888+0000 7ff7e6000700 1 -- 172.21.15.82:0/3965151311 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7e0009e20 con 0x7ff7e810ff40 2024-05-03T22:17:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.888+0000 7ff7e6000700 1 -- 172.21.15.82:0/3965151311 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0015400 con 0x7ff7e810ff40 2024-05-03T22:17:40.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.888+0000 7ff7efa00700 1 -- 172.21.15.82:0/3965151311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e81a1040 con 0x7ff7e810ff40 2024-05-03T22:17:40.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.889+0000 7ff7efa00700 1 -- 172.21.15.82:0/3965151311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e81a88c0 con 0x7ff7e810ff40 2024-05-03T22:17:40.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.890+0000 7ff7efa00700 1 -- 172.21.15.82:0/3965151311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e806a190 con 0x7ff7e810ff40 2024-05-03T22:17:40.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.892+0000 7ff7e6000700 1 -- 172.21.15.82:0/3965151311 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff7e0005020 con 0x7ff7e810ff40 2024-05-03T22:17:40.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.893+0000 7ff7e6000700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff7cc0b2990 0x7ff7cc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:40.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.894+0000 7ff7e6000700 1 -- 172.21.15.82:0/3965151311 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7ff7e00e2170 con 0x7ff7e810ff40 2024-05-03T22:17:40.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.894+0000 7ff7ed000700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff7cc0b2990 0x7ff7cc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:40.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.894+0000 7ff7ed000700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff7cc0b2990 0x7ff7cc0b4e50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8005950 tx=0x7ff7d800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:40.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:40.898+0000 7ff7e6000700 1 -- 172.21.15.82:0/3965151311 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff7e0010070 con 0x7ff7e810ff40 2024-05-03T22:17:41.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.178+0000 7ff7efa00700 1 -- 172.21.15.82:0/3965151311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7e802e510 con 0x7ff7e810ff40 2024-05-03T22:17:41.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.180+0000 7ff7e6000700 1 -- 172.21.15.82:0/3965151311 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7ff7e00a9910 con 0x7ff7e810ff40 2024-05-03T22:17:41.182 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:17:41.182 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:12:39.270198+0000","modified":"2024-05-03T22:14:10.244210+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34460,"mds_1":34433,"mds_2":34412,"mds_3":34403,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":40,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34412":{"gid":34412,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6839/3254019270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3254019270},{"type":"v1","addr":"172.21.15.116:6839","nonce":3254019270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34460,"qdb_cluster":[24469,34403,34460,34433,34412]},"id":1}]} 2024-05-03T22:17:41.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 -- 172.21.15.82:0/3965151311 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff7cc0b2990 msgr2=0x7ff7cc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:41.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff7cc0b2990 0x7ff7cc0b4e50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8005950 tx=0x7ff7d800b410 comp rx=0 tx=0).stop 2024-05-03T22:17:41.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 -- 172.21.15.82:0/3965151311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7e810ff40 msgr2=0x7ff7e81a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:41.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7e810ff40 0x7ff7e81a0610 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00094f0 tx=0x7ff7e000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:17:41.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 -- 172.21.15.82:0/3965151311 shutdown_connections 2024-05-03T22:17:41.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ff7cc0b2990 0x7ff7cc0b4e50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:41.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7e810ff40 0x7ff7e81a0610 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:41.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7e806ba40 0x7ff7e819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:41.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 --2- 172.21.15.82:0/3965151311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7e806c360 0x7ff7e819c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:41.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 -- 172.21.15.82:0/3965151311 >> 172.21.15.82:0/3965151311 conn(0x7ff7e8079310 msgr2=0x7ff7e8111510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:41.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 -- 172.21.15.82:0/3965151311 shutdown_connections 2024-05-03T22:17:41.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:41.183+0000 7ff7efa00700 1 -- 172.21.15.82:0/3965151311 wait complete. 2024-05-03T22:17:41.186 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-05-03T22:17:41.478 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:41 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3965151311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:17:41.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:41 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3965151311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:17:41.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:41 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3965151311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:17:42.242 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:17:42.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:42 smithi082 ceph-mon[28404]: pgmap v534: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:42 smithi116 ceph-mon[31828]: pgmap v534: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:42.695 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:42 smithi130 ceph-mon[32417]: pgmap v534: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:43.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:43 smithi116 ceph-mon[31828]: pgmap v535: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:43.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:43 smithi082 ceph-mon[28404]: pgmap v535: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:43.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:43 smithi130 ceph-mon[32417]: pgmap v535: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:45.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.344+0000 7fe13b800700 1 -- 172.21.15.82:0/3790666368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe13410a490 msgr2=0x7fe1341169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:45.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.344+0000 7fe13b800700 1 --2- 172.21.15.82:0/3790666368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe13410a490 0x7fe1341169a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00b0a0 tx=0x7fe12c00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:17:45.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.344+0000 7fe13b800700 1 -- 172.21.15.82:0/3790666368 shutdown_connections 2024-05-03T22:17:45.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.344+0000 7fe13b800700 1 --2- 172.21.15.82:0/3790666368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe13410a490 0x7fe1341169a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:45.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.344+0000 7fe13b800700 1 --2- 172.21.15.82:0/3790666368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe13410fb60 0x7fe13410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:45.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.344+0000 7fe13b800700 1 --2- 172.21.15.82:0/3790666368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe134109ad0 0x7fe134109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:45.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.344+0000 7fe13b800700 1 -- 172.21.15.82:0/3790666368 >> 172.21.15.82:0/3790666368 conn(0x7fe134076c70 msgr2=0x7fe1341082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:45.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.344+0000 7fe13b800700 1 -- 172.21.15.82:0/3790666368 shutdown_connections 2024-05-03T22:17:45.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.344+0000 7fe13b800700 1 -- 172.21.15.82:0/3790666368 wait complete. 2024-05-03T22:17:45.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.345+0000 7fe13b800700 1 Processor -- start 2024-05-03T22:17:45.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.346+0000 7fe13b800700 1 -- start start 2024-05-03T22:17:45.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.346+0000 7fe13b800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe134109ad0 0x7fe1341a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:45.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.346+0000 7fe13b800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe13410a490 0x7fe1341a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:45.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.346+0000 7fe13b800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13410fb60 0x7fe1341a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:45.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.346+0000 7fe13b800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe134119c10 con 0x7fe13410a490 2024-05-03T22:17:45.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.346+0000 7fe13b800700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe134119a90 con 0x7fe13410fb60 2024-05-03T22:17:45.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.346+0000 7fe13b800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe134119d90 con 0x7fe134109ad0 2024-05-03T22:17:45.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.346+0000 7fe133e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe13410a490 0x7fe1341a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:45.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.346+0000 7fe133e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe13410a490 0x7fe1341a05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54132/0 (socket says 172.21.15.82:54132) 2024-05-03T22:17:45.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.346+0000 7fe133e00700 1 -- 172.21.15.82:0/508591216 learned_addr learned my addr 172.21.15.82:0/508591216 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:45.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.347+0000 7fe139800700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13410fb60 0x7fe1341a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:45.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.347+0000 7fe133e00700 1 -- 172.21.15.82:0/508591216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe134109ad0 msgr2=0x7fe1341a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:45.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.347+0000 7fe138e00700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe134109ad0 0x7fe1341a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:45.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.347+0000 7fe133e00700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe134109ad0 0x7fe1341a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:45.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.347+0000 7fe133e00700 1 -- 172.21.15.82:0/508591216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13410fb60 msgr2=0x7fe1341a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:45.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.347+0000 7fe133e00700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13410fb60 0x7fe1341a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:45.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.347+0000 7fe133e00700 1 -- 172.21.15.82:0/508591216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1341a5090 con 0x7fe13410a490 2024-05-03T22:17:45.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.347+0000 7fe139800700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13410fb60 0x7fe1341a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:17:45.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.347+0000 7fe138e00700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe134109ad0 0x7fe1341a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:17:45.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.347+0000 7fe133e00700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe13410a490 0x7fe1341a05c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe12000d950 tx=0x7fe12000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:45.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.348+0000 7fe131600700 1 -- 172.21.15.82:0/508591216 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120016070 con 0x7fe13410a490 2024-05-03T22:17:45.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.348+0000 7fe13b800700 1 -- 172.21.15.82:0/508591216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1341a5320 con 0x7fe13410a490 2024-05-03T22:17:45.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.348+0000 7fe131600700 1 -- 172.21.15.82:0/508591216 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe120010460 con 0x7fe13410a490 2024-05-03T22:17:45.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.348+0000 7fe131600700 1 -- 172.21.15.82:0/508591216 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12000f620 con 0x7fe13410a490 2024-05-03T22:17:45.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.348+0000 7fe13b800700 1 -- 172.21.15.82:0/508591216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1341acc00 con 0x7fe13410a490 2024-05-03T22:17:45.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.349+0000 7fe13b800700 1 -- 172.21.15.82:0/508591216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13406a190 con 0x7fe13410a490 2024-05-03T22:17:45.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.351+0000 7fe131600700 1 -- 172.21.15.82:0/508591216 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe120019070 con 0x7fe13410a490 2024-05-03T22:17:45.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.352+0000 7fe131600700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe11c0b2990 0x7fe11c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:45.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.353+0000 7fe131600700 1 -- 172.21.15.82:0/508591216 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fe1200e2700 con 0x7fe13410a490 2024-05-03T22:17:45.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.353+0000 7fe138e00700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe11c0b2990 0x7fe11c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:45.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.354+0000 7fe138e00700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe11c0b2990 0x7fe11c0b4e50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe128009b50 tx=0x7fe128009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:45.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.355+0000 7fe131600700 1 -- 172.21.15.82:0/508591216 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe1200a9ea0 con 0x7fe13410a490 2024-05-03T22:17:45.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.639+0000 7fe13b800700 1 -- 172.21.15.82:0/508591216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe13402e510 con 0x7fe13410a490 2024-05-03T22:17:45.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.640+0000 7fe131600700 1 -- 172.21.15.82:0/508591216 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fe1200a97a0 con 0x7fe13410a490 2024-05-03T22:17:45.642 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:17:45.642 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:12:39.270198+0000","modified":"2024-05-03T22:14:10.244210+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34460,"mds_1":34433,"mds_2":34412,"mds_3":34403,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":40,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34412":{"gid":34412,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6839/3254019270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3254019270},{"type":"v1","addr":"172.21.15.116:6839","nonce":3254019270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34460,"qdb_cluster":[24469,34403,34460,34433,34412]},"id":1}]} 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.643+0000 7fe13b800700 1 -- 172.21.15.82:0/508591216 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe11c0b2990 msgr2=0x7fe11c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.643+0000 7fe13b800700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe11c0b2990 0x7fe11c0b4e50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe128009b50 tx=0x7fe128009550 comp rx=0 tx=0).stop 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.643+0000 7fe13b800700 1 -- 172.21.15.82:0/508591216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe13410a490 msgr2=0x7fe1341a05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.643+0000 7fe13b800700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe13410a490 0x7fe1341a05c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe12000d950 tx=0x7fe12000dd10 comp rx=0 tx=0).stop 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.644+0000 7fe13b800700 1 -- 172.21.15.82:0/508591216 shutdown_connections 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.644+0000 7fe13b800700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe11c0b2990 0x7fe11c0b4e50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.644+0000 7fe13b800700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe13410fb60 0x7fe1341a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.644+0000 7fe13b800700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe134109ad0 0x7fe1341a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.644+0000 7fe13b800700 1 --2- 172.21.15.82:0/508591216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe13410a490 0x7fe1341a05c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.644+0000 7fe13b800700 1 -- 172.21.15.82:0/508591216 >> 172.21.15.82:0/508591216 conn(0x7fe134076c70 msgr2=0x7fe134077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.644+0000 7fe13b800700 1 -- 172.21.15.82:0/508591216 shutdown_connections 2024-05-03T22:17:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:45.644+0000 7fe13b800700 1 -- 172.21.15.82:0/508591216 wait complete. 2024-05-03T22:17:45.647 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-05-03T22:17:45.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:45 smithi082 ceph-mon[28404]: pgmap v536: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:45.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:45 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/508591216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:17:46.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:45 smithi116 ceph-mon[31828]: pgmap v536: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:46.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:45 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/508591216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:17:46.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:45 smithi130 ceph-mon[32417]: pgmap v536: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:46.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:45 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/508591216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:17:46.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:17:47.234 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:48.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:47 smithi116 ceph-mon[31828]: pgmap v537: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:48.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:47 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:17:48.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:47 smithi082 ceph-mon[28404]: pgmap v537: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:48.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:47 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:17:48.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:47 smithi130 ceph-mon[32417]: pgmap v537: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:48.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:47 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:17:49.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.767+0000 7f72c6e00700 1 -- 172.21.15.82:0/723867541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c00756d0 msgr2=0x7f72c0075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:49.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.767+0000 7f72c6e00700 1 --2- 172.21.15.82:0/723867541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c00756d0 0x7f72c0075ab0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009990 tx=0x7f72b0009ca0 comp rx=0 tx=0).stop 2024-05-03T22:17:49.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.767+0000 7f72c6e00700 1 -- 172.21.15.82:0/723867541 shutdown_connections 2024-05-03T22:17:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.767+0000 7f72c6e00700 1 --2- 172.21.15.82:0/723867541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c00756d0 0x7f72c0075ab0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.767+0000 7f72c6e00700 1 --2- 172.21.15.82:0/723867541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c010ff00 0x7f72c01122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.767+0000 7f72c6e00700 1 --2- 172.21.15.82:0/723867541 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c0075ff0 0x7f72c010f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.767+0000 7f72c6e00700 1 -- 172.21.15.82:0/723867541 >> 172.21.15.82:0/723867541 conn(0x7f72c007a600 msgr2=0x7f72c007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.767+0000 7f72c6e00700 1 -- 172.21.15.82:0/723867541 shutdown_connections 2024-05-03T22:17:49.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.767+0000 7f72c6e00700 1 -- 172.21.15.82:0/723867541 wait complete. 2024-05-03T22:17:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.768+0000 7f72c6e00700 1 Processor -- start 2024-05-03T22:17:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.768+0000 7f72c6e00700 1 -- start start 2024-05-03T22:17:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.769+0000 7f72c6e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c00756d0 0x7f72c01a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.769+0000 7f72c6e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c0075ff0 0x7f72c01a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.769+0000 7f72c6e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c010ff00 0x7f72c019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.769+0000 7f72c6e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0115740 con 0x7f72c010ff00 2024-05-03T22:17:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.769+0000 7f72c6e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01155c0 con 0x7f72c00756d0 2024-05-03T22:17:49.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.769+0000 7f72c6e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01158c0 con 0x7f72c0075ff0 2024-05-03T22:17:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.769+0000 7f72c4e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c010ff00 0x7f72c019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.770+0000 7f72b7e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c0075ff0 0x7f72c01a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.770+0000 7f72c4e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c010ff00 0x7f72c019bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54154/0 (socket says 172.21.15.82:54154) 2024-05-03T22:17:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.770+0000 7f72c4e00700 1 -- 172.21.15.82:0/4220571837 learned_addr learned my addr 172.21.15.82:0/4220571837 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.770+0000 7f72b7e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c0075ff0 0x7f72c01a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.82:47234/0 (socket says 172.21.15.82:47234) 2024-05-03T22:17:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.770+0000 7f72bfe00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c00756d0 0x7f72c01a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.770+0000 7f72c4e00700 1 -- 172.21.15.82:0/4220571837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c0075ff0 msgr2=0x7f72c01a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.770+0000 7f72c4e00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c0075ff0 0x7f72c01a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.770+0000 7f72c4e00700 1 -- 172.21.15.82:0/4220571837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c00756d0 msgr2=0x7f72c01a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.770+0000 7f72c4e00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c00756d0 0x7f72c01a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:49.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.770+0000 7f72c4e00700 1 -- 172.21.15.82:0/4220571837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c019c220 con 0x7f72c010ff00 2024-05-03T22:17:49.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.770+0000 7f72bfe00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c00756d0 0x7f72c01a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:17:49.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.771+0000 7f72c4e00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c010ff00 0x7f72c019bac0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f72b8007ee0 tx=0x7f72b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:49.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.771+0000 7f72bd600700 1 -- 172.21.15.82:0/4220571837 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b800ddd0 con 0x7f72c010ff00 2024-05-03T22:17:49.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.771+0000 7f72c6e00700 1 -- 172.21.15.82:0/4220571837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c019c510 con 0x7f72c010ff00 2024-05-03T22:17:49.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.771+0000 7f72bd600700 1 -- 172.21.15.82:0/4220571837 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72b8009e20 con 0x7f72c010ff00 2024-05-03T22:17:49.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.771+0000 7f72bd600700 1 -- 172.21.15.82:0/4220571837 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8005a50 con 0x7f72c010ff00 2024-05-03T22:17:49.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.771+0000 7f72c6e00700 1 -- 172.21.15.82:0/4220571837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c01a8780 con 0x7f72c010ff00 2024-05-03T22:17:49.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.772+0000 7f72c6e00700 1 -- 172.21.15.82:0/4220571837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c006a190 con 0x7f72c010ff00 2024-05-03T22:17:49.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.776+0000 7f72bd600700 1 -- 172.21.15.82:0/4220571837 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f72b8005000 con 0x7f72c010ff00 2024-05-03T22:17:49.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.779+0000 7f72bd600700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f72a40b2ab0 0x7f72a40b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:49.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.779+0000 7f72bd600700 1 -- 172.21.15.82:0/4220571837 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f72b80e28f0 con 0x7f72c010ff00 2024-05-03T22:17:49.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.779+0000 7f72bfe00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f72a40b2ab0 0x7f72a40b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:49.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.780+0000 7f72bd600700 1 -- 172.21.15.82:0/4220571837 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f72b8010070 con 0x7f72c010ff00 2024-05-03T22:17:49.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:49.780+0000 7f72bfe00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f72a40b2ab0 0x7f72a40b4f70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72b0003760 tx=0x7f72b001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:50.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.012+0000 7f72c6e00700 1 -- 172.21.15.82:0/4220571837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72c002e510 con 0x7f72c010ff00 2024-05-03T22:17:50.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:49 smithi082 ceph-mon[28404]: pgmap v538: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:50.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:49 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:17:50.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:49 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:17:50.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:49 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:17:50.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.017+0000 7f72bd600700 1 -- 172.21.15.82:0/4220571837 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24803 (secure 0 0 0) 0x7f72b80aa090 con 0x7f72c010ff00 2024-05-03T22:17:50.019 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:17:50.019 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:14:38.277415+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:12:30.512363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:12:34.936483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:12:50.095758+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:17:50.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.020+0000 7f72c6e00700 1 -- 172.21.15.82:0/4220571837 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f72a40b2ab0 msgr2=0x7f72a40b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:50.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.020+0000 7f72c6e00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f72a40b2ab0 0x7f72a40b4f70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72b0003760 tx=0x7f72b001a040 comp rx=0 tx=0).stop 2024-05-03T22:17:50.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.020+0000 7f72c6e00700 1 -- 172.21.15.82:0/4220571837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c010ff00 msgr2=0x7f72c019bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:50.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.020+0000 7f72c6e00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c010ff00 0x7f72c019bac0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f72b8007ee0 tx=0x7f72b800d3b0 comp rx=0 tx=0).stop 2024-05-03T22:17:50.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.020+0000 7f72c6e00700 1 -- 172.21.15.82:0/4220571837 shutdown_connections 2024-05-03T22:17:50.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.020+0000 7f72c6e00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f72a40b2ab0 0x7f72a40b4f70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:50.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.020+0000 7f72c6e00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c010ff00 0x7f72c019bac0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.020+0000 7f72c6e00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72c00756d0 0x7f72c01a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.020+0000 7f72c6e00700 1 --2- 172.21.15.82:0/4220571837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c0075ff0 0x7f72c01a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.020+0000 7f72c6e00700 1 -- 172.21.15.82:0/4220571837 >> 172.21.15.82:0/4220571837 conn(0x7f72c007a600 msgr2=0x7f72c01007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.020+0000 7f72c6e00700 1 -- 172.21.15.82:0/4220571837 shutdown_connections 2024-05-03T22:17:50.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:50.021+0000 7f72c6e00700 1 -- 172.21.15.82:0/4220571837 wait complete. 2024-05-03T22:17:50.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:49 smithi116 ceph-mon[31828]: pgmap v538: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:50.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:49 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:17:50.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:49 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:17:50.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:49 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:17:50.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:49 smithi130 ceph-mon[32417]: pgmap v538: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:17:50.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:49 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:17:50.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:49 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:17:50.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:49 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:17:50.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-03T22:12:39.270198+0000', 'modified': '2024-05-03T22:14:10.244210+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34460, 'mds_1': 34433, 'mds_2': 34412, 'mds_3': 34403, 'mds_4': 24469}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14583': {'gid': 14583, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6839/4287485607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 4287485607}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 4287485607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14595': {'gid': 14595, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6841/1188447125', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6840', 'nonce': 1188447125}, {'type': 'v1', 'addr': '172.21.15.82:6841', 'nonce': 1188447125}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6833/2041703143', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6832', 'nonce': 2041703143}, {'type': 'v1', 'addr': '172.21.15.130:6833', 'nonce': 2041703143}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6835/710741525', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 710741525}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 710741525}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6837/4246597354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 4246597354}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 4246597354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.130:6839/944732551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 944732551}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 944732551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34403': {'gid': 34403, 'name': 'k', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 40, 'addr': '172.21.15.116:6833/1484646572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6832', 'nonce': 1484646572}, {'type': 'v1', 'addr': '172.21.15.116:6833', 'nonce': 1484646572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34412': {'gid': 34412, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 36, 'addr': '172.21.15.116:6835/1544765094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 1544765094}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 1544765094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34433': {'gid': 34433, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.116:6837/2428901446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 2428901446}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 2428901446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34460': {'gid': 34460, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.116:6839/3254019270', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 3254019270}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 3254019270}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34460, 'qdb_cluster': [24469, 34403, 34460, 34433, 34412]} 2024-05-03T22:17:50.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-03T22:17:50.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-03T22:17:51.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:50 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/4220571837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:17:51.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:50 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/4220571837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:17:51.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:50 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/4220571837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:17:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:52.060 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:51 smithi082 ceph-mon[28404]: pgmap v539: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:52.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:51 smithi116 ceph-mon[31828]: pgmap v539: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:52.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:51 smithi130 ceph-mon[32417]: pgmap v539: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:17:53.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.880+0000 7f15cd000700 1 -- 172.21.15.82:0/3731957962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c8114250 msgr2=0x7f15c8116640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:53.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.880+0000 7f15cd000700 1 --2- 172.21.15.82:0/3731957962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c8114250 0x7f15c8116640 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f15c000b0a0 tx=0x7f15c000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.880+0000 7f15cd000700 1 -- 172.21.15.82:0/3731957962 shutdown_connections 2024-05-03T22:17:53.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.880+0000 7f15cd000700 1 --2- 172.21.15.82:0/3731957962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c8114250 0x7f15c8116640 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.880+0000 7f15cd000700 1 --2- 172.21.15.82:0/3731957962 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15c80779d0 0x7f15c8077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.880+0000 7f15cd000700 1 --2- 172.21.15.82:0/3731957962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15c80782f0 0x7f15c8113d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.880+0000 7f15cd000700 1 -- 172.21.15.82:0/3731957962 >> 172.21.15.82:0/3731957962 conn(0x7f15c81010e0 msgr2=0x7f15c8103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:53.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.880+0000 7f15cd000700 1 -- 172.21.15.82:0/3731957962 shutdown_connections 2024-05-03T22:17:53.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.880+0000 7f15cd000700 1 -- 172.21.15.82:0/3731957962 wait complete. 2024-05-03T22:17:53.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.881+0000 7f15cd000700 1 Processor -- start 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.881+0000 7f15cd000700 1 -- start start 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.882+0000 7f15cd000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c80779d0 0x7f15c819fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.882+0000 7f15cd000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15c80782f0 0x7f15c81a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.882+0000 7f15cd000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15c8114250 0x7f15c81a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.882+0000 7f15cd000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15c8119a50 con 0x7f15c80779d0 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.882+0000 7f15cd000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f15c81198d0 con 0x7f15c8114250 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.882+0000 7f15cd000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f15c8119bd0 con 0x7f15c80782f0 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.882+0000 7f15c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c80779d0 0x7f15c819fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.882+0000 7f15c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c80779d0 0x7f15c819fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45628/0 (socket says 172.21.15.82:45628) 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.882+0000 7f15c7400700 1 -- 172.21.15.82:0/2112417450 learned_addr learned my addr 172.21.15.82:0/2112417450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.882+0000 7f15c6a00700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15c80782f0 0x7f15c81a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15c7e00700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15c8114250 0x7f15c81a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15c7400700 1 -- 172.21.15.82:0/2112417450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15c80782f0 msgr2=0x7f15c81a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:53.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15c7400700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15c80782f0 0x7f15c81a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15c7400700 1 -- 172.21.15.82:0/2112417450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15c8114250 msgr2=0x7f15c81a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15c7400700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15c8114250 0x7f15c81a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15c7400700 1 -- 172.21.15.82:0/2112417450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c81a4ea0 con 0x7f15c80779d0 2024-05-03T22:17:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15c6a00700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15c80782f0 0x7f15c81a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:17:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15c7400700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c80779d0 0x7f15c819fee0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f15b800c9b0 tx=0x7f15b800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15bfe00700 1 -- 172.21.15.82:0/2112417450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8007b00 con 0x7f15c80779d0 2024-05-03T22:17:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15bfe00700 1 -- 172.21.15.82:0/2112417450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15b8007ca0 con 0x7f15c80779d0 2024-05-03T22:17:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15cd000700 1 -- 172.21.15.82:0/2112417450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c81a5130 con 0x7f15c80779d0 2024-05-03T22:17:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15bfe00700 1 -- 172.21.15.82:0/2112417450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8018660 con 0x7f15c80779d0 2024-05-03T22:17:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.883+0000 7f15cd000700 1 -- 172.21.15.82:0/2112417450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c81aca10 con 0x7f15c80779d0 2024-05-03T22:17:53.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.887+0000 7f15bfe00700 1 -- 172.21.15.82:0/2112417450 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f15b800f450 con 0x7f15c80779d0 2024-05-03T22:17:53.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.888+0000 7f15d8e8db80 1 Processor -- start 2024-05-03T22:17:53.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.888+0000 7f15d8e8db80 1 -- start start 2024-05-03T22:17:53.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.888+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613dfb80 0x5612613dff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613d9ee0 0x5612613da360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15bfe00700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15ac0b2990 0x7f15ac0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613da8a0 0x5612613e6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56126132c9d0 con 0x5612613dfb80 2024-05-03T22:17:53.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5612612ca710 con 0x5612613da8a0 2024-05-03T22:17:53.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561261328990 con 0x5612613d9ee0 2024-05-03T22:17:53.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15bfe00700 1 -- 172.21.15.82:0/2112417450 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f15b80e2800 con 0x7f15c80779d0 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15c6a00700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15ac0b2990 0x7f15ac0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15c7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613dfb80 0x5612613dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15c7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613dfb80 0x5612613dff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45644/0 (socket says 172.21.15.82:45644) 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15c7e00700 1 -- 172.21.15.82:0/2627282340 learned_addr learned my addr 172.21.15.82:0/2627282340 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15c7400700 1 --2- 172.21.15.82:0/2627282340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613d9ee0 0x5612613da360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.889+0000 7f15c7e00700 1 --2- 172.21.15.82:0/2627282340 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613da8a0 0x5612613e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.890+0000 7f15c7e00700 1 -- 172.21.15.82:0/2627282340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613d9ee0 msgr2=0x5612613da360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.890+0000 7f15c7e00700 1 --2- 172.21.15.82:0/2627282340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613d9ee0 0x5612613da360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.890+0000 7f15c7e00700 1 -- 172.21.15.82:0/2627282340 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613da8a0 msgr2=0x5612613e6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.890+0000 7f15c7e00700 1 --2- 172.21.15.82:0/2627282340 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613da8a0 0x5612613e6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.890+0000 7f15c7e00700 1 -- 172.21.15.82:0/2627282340 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561261279880 con 0x5612613dfb80 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.890+0000 7f15c6a00700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15ac0b2990 0x7f15ac0b4e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f15c8104740 tx=0x7f15b4009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:53.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.890+0000 7f15c7e00700 1 --2- 172.21.15.82:0/2627282340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613dfb80 0x5612613dff60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009e60 tx=0x7f15c00097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1999dbd6a1f8ed10 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.890+0000 7f15bcc00700 1 -- 172.21.15.82:0/2627282340 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0004a50 con 0x5612613dfb80 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.890+0000 7f15bcc00700 1 -- 172.21.15.82:0/2627282340 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c0004bf0 con 0x5612613dfb80 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.890+0000 7f15bcc00700 1 -- 172.21.15.82:0/2627282340 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c00052a0 con 0x5612613dfb80 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.891+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2627282340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613dfb80 msgr2=0x5612613dff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.891+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/2627282340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613dfb80 0x5612613dff60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009e60 tx=0x7f15c00097a0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.891+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2627282340 shutdown_connections 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.891+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/2627282340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613dfb80 0x5612613dff60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.891+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/2627282340 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613da8a0 0x5612613e6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.891+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/2627282340 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613d9ee0 0x5612613da360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.891+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2627282340 >> 172.21.15.82:0/2627282340 conn(0x561261352680 msgr2=0x5612613d4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.891+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2627282340 shutdown_connections 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.891+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2627282340 wait complete. 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.892+0000 7f15d8e8db80 1 -- start start 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.892+0000 7f15d8e8db80 1 Processor -- start 2024-05-03T22:17:53.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613e6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 0x5612613e3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5612613e6e80 con 0x5612613d9ee0 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x561261292ad0 con 0x5612613dfb80 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5612613e7000 con 0x5612613da8a0 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15d8e8db80 10 client.0 _ll_register_callbacks cb 0x5612612d3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613e6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613e6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45652/0 (socket says 172.21.15.82:45652) 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15c7400700 1 -- 172.21.15.82:0/2079146979 learned_addr learned my addr 172.21.15.82:0/2079146979 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15c6a00700 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 0x5612613e3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.893+0000 7f15c7e00700 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15c7400700 1 -- 172.21.15.82:0/2079146979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 msgr2=0x5612613e3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:53.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15c7400700 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 0x5612613e3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15c7400700 1 -- 172.21.15.82:0/2079146979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 msgr2=0x5612613e3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15c7400700 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613e3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15c7400700 1 -- 172.21.15.82:0/2079146979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612612f23d0 con 0x5612613d9ee0 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15c7400700 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613e6580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f15b80b0fd0 tx=0x7f15b80a9950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23fb081fdbe3f32 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15b1600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15b1600700 1 -- 172.21.15.82:0/2079146979 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b80b2700 con 0x5612613d9ee0 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15b1600700 1 -- 172.21.15.82:0/2079146979 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f15b80d1640 con 0x5612613d9ee0 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2079146979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c0004bf0 con 0x5612613d9ee0 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15b1600700 1 -- 172.21.15.82:0/2079146979 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f15b80d1140 con 0x5612613d9ee0 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15d8e8db80 10 client.15201 fetch_fsmap learned FSMap version 29 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.894+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2079146979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5612613f16e0 con 0x5612613d9ee0 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.895+0000 7f15b1600700 1 -- 172.21.15.82:0/2079146979 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c0004bf0 con 0x5612613d9ee0 2024-05-03T22:17:53.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.895+0000 7f15b1600700 1 -- 172.21.15.82:0/2079146979 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f15b80b2270 con 0x5612613d9ee0 2024-05-03T22:17:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.895+0000 7f15d8e8db80 10 client.15201 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:17:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.895+0000 7f15d8e8db80 10 client.15201 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T22:17:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.895+0000 7f15d8e8db80 20 client.15201 populate_metadata read hostname 'smithi082' 2024-05-03T22:17:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.895+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x5612613f3c90 0x5612613f5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.895+0000 7f15d8e8db80 4 client.15201 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:17:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.895+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2079146979 --> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612613a6fa0 con 0x5612613f3c90 2024-05-03T22:17:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.896+0000 7f15c6a00700 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x5612613f3c90 0x5612613f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.897+0000 7f15c6a00700 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x5612613f3c90 0x5612613f5100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d203a4c212604dfd server_cookie=82fef2a353ddde07 in_seq=0 out_seq=0 2024-05-03T22:17:53.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.897+0000 7f15b1600700 10 client.15201 ms_handle_connect on v2:172.21.15.130:6838/944732551 2024-05-03T22:17:53.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15b1600700 1 -- 172.21.15.82:0/2079146979 <== mds.4 v2:172.21.15.130:6838/944732551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5612613a6fa0 con 0x5612613f3c90 2024-05-03T22:17:53.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15b1600700 10 client.15201 handle_command_reply: tid=0 2024-05-03T22:17:53.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15d8e8db80 1 client.15201 shutdown 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2079146979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 msgr2=0x5612613e6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613e6580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f15b80b0fd0 tx=0x7f15b80a9950 comp rx=0 tx=0).stop 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2079146979 shutdown_connections 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x5612613f3c90 0x5612613f5100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613e6580 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613e3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/2079146979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 0x5612613e3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2079146979 >> 172.21.15.82:0/2079146979 conn(0x561261352680 msgr2=0x5612613d8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15b1600700 0 client.15201 ms_handle_reset on v2:172.21.15.130:6838/944732551 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2079146979 shutdown_connections 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.899+0000 7f15d8e8db80 1 -- 172.21.15.82:0/2079146979 wait complete. 2024-05-03T22:17:53.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.900+0000 7f15d8e8db80 20 client.15201 trim_cache size 0 max 16384 2024-05-03T22:17:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.922+0000 7f15d8e8db80 1 Processor -- start 2024-05-03T22:17:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.922+0000 7f15d8e8db80 1 -- start start 2024-05-03T22:17:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613d4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 0x5612613d4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613e2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5612613f3440 con 0x5612613d9ee0 2024-05-03T22:17:53.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5612613f3b10 con 0x5612613dfb80 2024-05-03T22:17:53.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5612613f41e0 con 0x5612613da8a0 2024-05-03T22:17:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613d4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45656/0 (socket says 172.21.15.82:45656) 2024-05-03T22:17:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15c7400700 1 -- 172.21.15.82:0/1436425463 learned_addr learned my addr 172.21.15.82:0/1436425463 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15c7400700 1 -- 172.21.15.82:0/1436425463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 msgr2=0x5612613d4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15c7400700 1 --2- 172.21.15.82:0/1436425463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 0x5612613d4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15c7400700 1 -- 172.21.15.82:0/1436425463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 msgr2=0x5612613e2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15c7e00700 1 --2- 172.21.15.82:0/1436425463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613e2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15c7400700 1 --2- 172.21.15.82:0/1436425463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613e2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.923+0000 7f15c7400700 1 -- 172.21.15.82:0/1436425463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612613a6f80 con 0x5612613d9ee0 2024-05-03T22:17:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.924+0000 7f15c7400700 1 --2- 172.21.15.82:0/1436425463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613d4660 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f15b800a740 tx=0x7f15b80a9320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbea3967cd40b63 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.924+0000 7f15b3e00700 1 -- 172.21.15.82:0/1436425463 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b80c2070 con 0x5612613d9ee0 2024-05-03T22:17:53.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.924+0000 7f15b3e00700 1 -- 172.21.15.82:0/1436425463 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15b80d12e0 con 0x5612613d9ee0 2024-05-03T22:17:53.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.924+0000 7f15b3e00700 1 -- 172.21.15.82:0/1436425463 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b80a8b00 con 0x5612613d9ee0 2024-05-03T22:17:53.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.925+0000 7f15d8e8db80 1 -- 172.21.15.82:0/1436425463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 msgr2=0x5612613d4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:53.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.925+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/1436425463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613d4660 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f15b800a740 tx=0x7f15b80a9320 comp rx=0 tx=0).stop 2024-05-03T22:17:53.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.925+0000 7f15d8e8db80 1 -- 172.21.15.82:0/1436425463 shutdown_connections 2024-05-03T22:17:53.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.925+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/1436425463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613d4660 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.925+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/1436425463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613e2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.925+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/1436425463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 0x5612613d4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.925+0000 7f15d8e8db80 1 -- 172.21.15.82:0/1436425463 >> 172.21.15.82:0/1436425463 conn(0x561261352680 msgr2=0x5612613e38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:53.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.925+0000 7f15d8e8db80 1 -- 172.21.15.82:0/1436425463 shutdown_connections 2024-05-03T22:17:53.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.925+0000 7f15d8e8db80 1 -- 172.21.15.82:0/1436425463 wait complete. 2024-05-03T22:17:53.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.925+0000 7f15d8e8db80 1 -- start start 2024-05-03T22:17:53.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.926+0000 7f15d8e8db80 1 Processor -- start 2024-05-03T22:17:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.926+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613fe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.926+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 0x5612613feac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.926+0000 7f15d8e8db80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613f9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.926+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5612613f4f80 con 0x5612613d9ee0 2024-05-03T22:17:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.926+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5612613f48b0 con 0x5612613dfb80 2024-05-03T22:17:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.926+0000 7f15d8e8db80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5612613f5650 con 0x5612613da8a0 2024-05-03T22:17:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.926+0000 7f15d8e8db80 10 client.0 _ll_register_callbacks cb 0x5612612d3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:17:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.926+0000 7f15c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.926+0000 7f15c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613fe580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45662/0 (socket says 172.21.15.82:45662) 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.926+0000 7f15c7400700 1 -- 172.21.15.82:0/527492536 learned_addr learned my addr 172.21.15.82:0/527492536 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15c6a00700 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 0x5612613feac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15c7e00700 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15c7400700 1 -- 172.21.15.82:0/527492536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 msgr2=0x5612613feac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15c7400700 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 0x5612613feac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15c7400700 1 -- 172.21.15.82:0/527492536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 msgr2=0x5612613f9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15c7400700 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613f9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15c7400700 1 -- 172.21.15.82:0/527492536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612613d1450 con 0x5612613d9ee0 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15c7400700 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613fe580 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f15b80a50c0 tx=0x7f15b80d1490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e607242025a2412 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15b1600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:17:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15b1600700 1 -- 172.21.15.82:0/527492536 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b80c2070 con 0x5612613d9ee0 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15b1600700 1 -- 172.21.15.82:0/527492536 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f15b80aade0 con 0x5612613d9ee0 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.927+0000 7f15d8e8db80 1 -- 172.21.15.82:0/527492536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15b80d12e0 con 0x5612613d9ee0 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.928+0000 7f15b1600700 1 -- 172.21.15.82:0/527492536 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f15b80cab50 con 0x5612613d9ee0 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.928+0000 7f15d8e8db80 10 client.15207 fetch_fsmap learned FSMap version 29 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.928+0000 7f15d8e8db80 1 -- 172.21.15.82:0/527492536 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56126145f640 con 0x5612613d9ee0 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.928+0000 7f15b1600700 1 -- 172.21.15.82:0/527492536 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15b80d12e0 con 0x5612613d9ee0 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.928+0000 7f15b1600700 1 -- 172.21.15.82:0/527492536 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f15b80a8570 con 0x5612613d9ee0 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.928+0000 7f15d8e8db80 10 client.15207 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.928+0000 7f15d8e8db80 10 client.15207 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.928+0000 7f15d8e8db80 20 client.15207 populate_metadata read hostname 'smithi082' 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.928+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x561261463cc0 0x5612614629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.928+0000 7f15d8e8db80 4 client.15207 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:17:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.928+0000 7f15d8e8db80 1 -- 172.21.15.82:0/527492536 --> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] -- command(tid 0: {"prefix": "status"}) -- 0x56126133a3b0 con 0x561261463cc0 2024-05-03T22:17:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.929+0000 7f15c6a00700 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x561261463cc0 0x5612614629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.930+0000 7f15c6a00700 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x561261463cc0 0x5612614629d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=40bd7911abba3c90 server_cookie=9d243c7ef770e671 in_seq=0 out_seq=0 2024-05-03T22:17:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.930+0000 7f15b1600700 10 client.15207 ms_handle_connect on v2:172.21.15.130:6838/944732551 2024-05-03T22:17:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.930+0000 7f15b1600700 1 -- 172.21.15.82:0/527492536 <== mds.4 v2:172.21.15.130:6838/944732551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56126133a3b0 con 0x561261463cc0 2024-05-03T22:17:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.930+0000 7f15b1600700 10 client.15207 handle_command_reply: tid=0 2024-05-03T22:17:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.930+0000 7f15d8e8db80 1 client.15207 shutdown 2024-05-03T22:17:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15d8e8db80 1 -- 172.21.15.82:0/527492536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 msgr2=0x5612613fe580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613fe580 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f15b80a50c0 tx=0x7f15b80d1490 comp rx=0 tx=0).stop 2024-05-03T22:17:53.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15d8e8db80 1 -- 172.21.15.82:0/527492536 shutdown_connections 2024-05-03T22:17:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.130:6838/944732551,v1:172.21.15.130:6839/944732551] conn(0x561261463cc0 0x5612614629d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5612613d9ee0 0x5612613fe580 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612613dfb80 0x5612613f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15d8e8db80 1 --2- 172.21.15.82:0/527492536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5612613da8a0 0x5612613feac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15d8e8db80 1 -- 172.21.15.82:0/527492536 >> 172.21.15.82:0/527492536 conn(0x561261352680 msgr2=0x5612613d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15b1600700 0 client.15207 ms_handle_reset on v2:172.21.15.130:6838/944732551 2024-05-03T22:17:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15d8e8db80 1 -- 172.21.15.82:0/527492536 shutdown_connections 2024-05-03T22:17:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15d8e8db80 1 -- 172.21.15.82:0/527492536 wait complete. 2024-05-03T22:17:53.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.931+0000 7f15d8e8db80 20 client.15207 trim_cache size 0 max 16384 2024-05-03T22:17:53.935 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:17:53.935 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:17:53.936 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 4, 2024-05-03T22:17:53.936 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24469, 2024-05-03T22:17:53.936 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-03T22:17:53.936 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-03T22:17:53.936 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-03T22:17:53.936 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 228.82076745000001, 2024-05-03T22:17:53.936 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 29, 2024-05-03T22:17:53.936 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-05-03T22:17:53.936 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-05-03T22:17:53.936 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 351.50353272199999 2024-05-03T22:17:53.936 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 -- 172.21.15.82:0/2112417450 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15ac0b2990 msgr2=0x7f15ac0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15ac0b2990 0x7f15ac0b4e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f15c8104740 tx=0x7f15b4009550 comp rx=0 tx=0).stop 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 -- 172.21.15.82:0/2112417450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c80779d0 msgr2=0x7f15c819fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c80779d0 0x7f15c819fee0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f15b800c9b0 tx=0x7f15b800cd70 comp rx=0 tx=0).stop 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 -- 172.21.15.82:0/2112417450 shutdown_connections 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f15ac0b2990 0x7f15ac0b4e50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15c80779d0 0x7f15c819fee0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15c8114250 0x7f15c81a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 --2- 172.21.15.82:0/2112417450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15c80782f0 0x7f15c81a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 -- 172.21.15.82:0/2112417450 >> 172.21.15.82:0/2112417450 conn(0x7f15c81010e0 msgr2=0x7f15c81034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 -- 172.21.15.82:0/2112417450 shutdown_connections 2024-05-03T22:17:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:53.932+0000 7f15cd000700 1 -- 172.21.15.82:0/2112417450 wait complete. 2024-05-03T22:17:53.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:53 smithi082 ceph-mon[28404]: pgmap v540: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:54.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:53 smithi116 ceph-mon[31828]: pgmap v540: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:54.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:53 smithi130 ceph-mon[32417]: pgmap v540: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:17:54.997 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell mds.k status 2024-05-03T22:17:55.428 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:17:56.143 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:55 smithi082 ceph-mon[28404]: pgmap v541: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:56.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:55 smithi116 ceph-mon[31828]: pgmap v541: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:56.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:55 smithi130 ceph-mon[32417]: pgmap v541: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:17:57.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:57 smithi082 ceph-mon[28404]: pgmap v542: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.042+0000 7fd975200700 1 -- 172.21.15.82:0/953309583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9701056c0 msgr2=0x7fd970105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.042+0000 7fd975200700 1 --2- 172.21.15.82:0/953309583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9701056c0 0x7fd970105b40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009990 tx=0x7fd95c009ca0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.042+0000 7fd975200700 1 -- 172.21.15.82:0/953309583 shutdown_connections 2024-05-03T22:17:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.042+0000 7fd975200700 1 --2- 172.21.15.82:0/953309583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd970106080 0x7fd970112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.042+0000 7fd975200700 1 --2- 172.21.15.82:0/953309583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd97010b6c0 0x7fd97010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.042+0000 7fd975200700 1 --2- 172.21.15.82:0/953309583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9701056c0 0x7fd970105b40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.042+0000 7fd975200700 1 -- 172.21.15.82:0/953309583 >> 172.21.15.82:0/953309583 conn(0x7fd9701011b0 msgr2=0x7fd9701035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:58.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.042+0000 7fd975200700 1 -- 172.21.15.82:0/953309583 shutdown_connections 2024-05-03T22:17:58.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.042+0000 7fd975200700 1 -- 172.21.15.82:0/953309583 wait complete. 2024-05-03T22:17:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.043+0000 7fd975200700 1 Processor -- start 2024-05-03T22:17:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.043+0000 7fd975200700 1 -- start start 2024-05-03T22:17:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.043+0000 7fd975200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9701056c0 0x7fd9701a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.043+0000 7fd975200700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd970106080 0x7fd9701a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd975200700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd97010b6c0 0x7fd97019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd975200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd970115800 con 0x7fd9701056c0 2024-05-03T22:17:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd975200700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd970115680 con 0x7fd97010b6c0 2024-05-03T22:17:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd975200700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd970115980 con 0x7fd970106080 2024-05-03T22:17:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd96de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9701056c0 0x7fd9701a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd96de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9701056c0 0x7fd9701a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45672/0 (socket says 172.21.15.82:45672) 2024-05-03T22:17:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd96de00700 1 -- 172.21.15.82:0/2845610219 learned_addr learned my addr 172.21.15.82:0/2845610219 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd96d400700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd970106080 0x7fd9701a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd96e800700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd97010b6c0 0x7fd97019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd96de00700 1 -- 172.21.15.82:0/2845610219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd970106080 msgr2=0x7fd9701a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd96de00700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd970106080 0x7fd9701a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd96de00700 1 -- 172.21.15.82:0/2845610219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd97010b6c0 msgr2=0x7fd97019baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd96de00700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd97010b6c0 0x7fd97019baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd96de00700 1 -- 172.21.15.82:0/2845610219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97019c200 con 0x7fd9701056c0 2024-05-03T22:17:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.044+0000 7fd96e800700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd97010b6c0 0x7fd97019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:17:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.045+0000 7fd96de00700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9701056c0 0x7fd9701a18e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd96000d950 tx=0x7fd96000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.045+0000 7fd966a00700 1 -- 172.21.15.82:0/2845610219 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960016070 con 0x7fd9701056c0 2024-05-03T22:17:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.045+0000 7fd966a00700 1 -- 172.21.15.82:0/2845610219 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd960010460 con 0x7fd9701056c0 2024-05-03T22:17:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.045+0000 7fd975200700 1 -- 172.21.15.82:0/2845610219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97019c4f0 con 0x7fd9701056c0 2024-05-03T22:17:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.045+0000 7fd966a00700 1 -- 172.21.15.82:0/2845610219 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96000f620 con 0x7fd9701056c0 2024-05-03T22:17:58.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.045+0000 7fd975200700 1 -- 172.21.15.82:0/2845610219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9701a87b0 con 0x7fd9701056c0 2024-05-03T22:17:58.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.049+0000 7fd966a00700 1 -- 172.21.15.82:0/2845610219 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd960019070 con 0x7fd9701056c0 2024-05-03T22:17:58.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.050+0000 7fd97fc11b80 1 Processor -- start 2024-05-03T22:17:58.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.050+0000 7fd97fc11b80 1 -- start start 2024-05-03T22:17:58.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.050+0000 7fd966a00700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd9540b2910 0x7fd9540b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.050+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa25cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.050+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa1fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.050+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa20980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.050+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cc9a9729d0 con 0x55cc9aa20500 2024-05-03T22:17:58.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.050+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55cc9a910710 con 0x55cc9aa26200 2024-05-03T22:17:58.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.050+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cc9a96e990 con 0x55cc9aa258e0 2024-05-03T22:17:58.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.051+0000 7fd966a00700 1 -- 172.21.15.82:0/2845610219 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fd9600e2380 con 0x7fd9701056c0 2024-05-03T22:17:58.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.051+0000 7fd96e800700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd9540b2910 0x7fd9540b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.051+0000 7fd96de00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa25cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.051+0000 7fd96e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa20980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.051+0000 7fd96d400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa1fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.051+0000 7fd96e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa20980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45676/0 (socket says 172.21.15.82:45676) 2024-05-03T22:17:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.051+0000 7fd96e800700 1 -- 172.21.15.82:0/139876363 learned_addr learned my addr 172.21.15.82:0/139876363 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.052+0000 7fd96e800700 1 -- 172.21.15.82:0/139876363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 msgr2=0x55cc9aa25cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.052+0000 7fd96e800700 1 --2- 172.21.15.82:0/139876363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa25cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.052+0000 7fd96e800700 1 -- 172.21.15.82:0/139876363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 msgr2=0x55cc9aa1fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.052+0000 7fd96e800700 1 --2- 172.21.15.82:0/139876363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa1fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.052+0000 7fd96e800700 1 -- 172.21.15.82:0/139876363 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc9a8bf880 con 0x55cc9aa20500 2024-05-03T22:17:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.052+0000 7fd96e800700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd9540b2910 0x7fd9540b4dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd968012bf0 tx=0x7fd968012310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.052+0000 7fd96e800700 1 --2- 172.21.15.82:0/139876363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa20980 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd968016b40 tx=0x7fd968019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bf583c6b798c91 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.052+0000 7fd95b400700 1 -- 172.21.15.82:0/139876363 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968026070 con 0x55cc9aa20500 2024-05-03T22:17:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.052+0000 7fd95b400700 1 -- 172.21.15.82:0/139876363 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd96801d030 con 0x55cc9aa20500 2024-05-03T22:17:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.052+0000 7fd95b400700 1 -- 172.21.15.82:0/139876363 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968010040 con 0x55cc9aa20500 2024-05-03T22:17:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.053+0000 7fd97fc11b80 1 -- 172.21.15.82:0/139876363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 msgr2=0x55cc9aa20980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.053+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/139876363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa20980 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd968016b40 tx=0x7fd968019000 comp rx=0 tx=0).stop 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.053+0000 7fd97fc11b80 1 -- 172.21.15.82:0/139876363 shutdown_connections 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.053+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/139876363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa20980 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.053+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/139876363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa25cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.053+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/139876363 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa1fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.053+0000 7fd97fc11b80 1 -- 172.21.15.82:0/139876363 >> 172.21.15.82:0/139876363 conn(0x55cc9a998680 msgr2=0x55cc9aa1a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.054+0000 7fd97fc11b80 1 -- 172.21.15.82:0/139876363 shutdown_connections 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.054+0000 7fd97fc11b80 1 -- 172.21.15.82:0/139876363 wait complete. 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.054+0000 7fd97fc11b80 1 -- start start 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.054+0000 7fd97fc11b80 1 Processor -- start 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.055+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa2be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.055+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa29200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.055+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa29740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.055+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cc9aa2cc50 con 0x55cc9aa20500 2024-05-03T22:17:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.055+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55cc9a8d8ad0 con 0x55cc9aa26200 2024-05-03T22:17:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.055+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cc9aa2cdd0 con 0x55cc9aa258e0 2024-05-03T22:17:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.055+0000 7fd97fc11b80 10 client.0 _ll_register_callbacks cb 0x55cc9a919c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:17:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.055+0000 7fd96de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa2be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.055+0000 7fd96de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa2be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45680/0 (socket says 172.21.15.82:45680) 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.055+0000 7fd96de00700 1 -- 172.21.15.82:0/1237979452 learned_addr learned my addr 172.21.15.82:0/1237979452 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.056+0000 7fd96d400700 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa29200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.056+0000 7fd96e800700 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa29740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.056+0000 7fd96de00700 1 -- 172.21.15.82:0/1237979452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 msgr2=0x55cc9aa29200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.056+0000 7fd96de00700 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa29200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.056+0000 7fd96de00700 1 -- 172.21.15.82:0/1237979452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 msgr2=0x55cc9aa29740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.056+0000 7fd96de00700 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa29740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.056+0000 7fd96de00700 1 -- 172.21.15.82:0/1237979452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc9a9383d0 con 0x55cc9aa20500 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.056+0000 7fd96de00700 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa2be10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd96000b2f0 tx=0x7fd9600aee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f918d1d634913d27 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.056+0000 7fd94fe00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.057+0000 7fd94fe00700 1 -- 172.21.15.82:0/1237979452 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960020030 con 0x55cc9aa20500 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.057+0000 7fd94fe00700 1 -- 172.21.15.82:0/1237979452 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fd9600e2120 con 0x55cc9aa20500 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.057+0000 7fd97fc11b80 1 -- 172.21.15.82:0/1237979452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd96801d030 con 0x55cc9aa20500 2024-05-03T22:17:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.057+0000 7fd94fe00700 1 -- 172.21.15.82:0/1237979452 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd9600a9b20 con 0x55cc9aa20500 2024-05-03T22:17:58.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.057+0000 7fd97fc11b80 10 client.15219 fetch_fsmap learned FSMap version 29 2024-05-03T22:17:58.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.057+0000 7fd97fc11b80 1 -- 172.21.15.82:0/1237979452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cc9aa373d0 con 0x55cc9aa20500 2024-05-03T22:17:58.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.057+0000 7fd94fe00700 1 -- 172.21.15.82:0/1237979452 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd96801d030 con 0x55cc9aa20500 2024-05-03T22:17:58.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.058+0000 7fd94fe00700 1 -- 172.21.15.82:0/1237979452 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd9600a9680 con 0x55cc9aa20500 2024-05-03T22:17:58.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.058+0000 7fd97fc11b80 10 client.15219 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:17:58.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.058+0000 7fd97fc11b80 10 client.15219 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T22:17:58.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.058+0000 7fd97fc11b80 20 client.15219 populate_metadata read hostname 'smithi082' 2024-05-03T22:17:58.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.058+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x55cc9aa399f0 0x55cc9aa3ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.058+0000 7fd97fc11b80 4 client.15219 mds_command: new command op to 34403 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:17:58.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.058+0000 7fd97fc11b80 1 -- 172.21.15.82:0/1237979452 --> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc9a9ecfa0 con 0x55cc9aa399f0 2024-05-03T22:17:58.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.059+0000 7fd96d400700 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x55cc9aa399f0 0x55cc9aa3ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.060+0000 7fd96d400700 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x55cc9aa399f0 0x55cc9aa3ae60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6ad9dca5dee46fd5 server_cookie=50fdf0f7dbb7e95d in_seq=0 out_seq=0 2024-05-03T22:17:58.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.060+0000 7fd94fe00700 10 client.15219 ms_handle_connect on v2:172.21.15.116:6832/1484646572 2024-05-03T22:17:58.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd94fe00700 1 -- 172.21.15.82:0/1237979452 <== mds.3 v2:172.21.15.116:6832/1484646572 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cc9a9ecfa0 con 0x55cc9aa399f0 2024-05-03T22:17:58.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd94fe00700 10 client.15219 handle_command_reply: tid=0 2024-05-03T22:17:58.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd97fc11b80 1 client.15219 shutdown 2024-05-03T22:17:58.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd97fc11b80 1 -- 172.21.15.82:0/1237979452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 msgr2=0x55cc9aa2be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:58.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa2be10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd96000b2f0 tx=0x7fd9600aee60 comp rx=0 tx=0).stop 2024-05-03T22:17:58.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd97fc11b80 1 -- 172.21.15.82:0/1237979452 shutdown_connections 2024-05-03T22:17:58.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x55cc9aa399f0 0x55cc9aa3ae60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa2be10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa29740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/1237979452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa29200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd97fc11b80 1 -- 172.21.15.82:0/1237979452 >> 172.21.15.82:0/1237979452 conn(0x55cc9a998680 msgr2=0x55cc9aa15360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:58.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd94fe00700 0 client.15219 ms_handle_reset on v2:172.21.15.116:6832/1484646572 2024-05-03T22:17:58.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.062+0000 7fd97fc11b80 1 -- 172.21.15.82:0/1237979452 shutdown_connections 2024-05-03T22:17:58.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.063+0000 7fd97fc11b80 1 -- 172.21.15.82:0/1237979452 wait complete. 2024-05-03T22:17:58.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.063+0000 7fd97fc11b80 20 client.15219 trim_cache size 0 max 16384 2024-05-03T22:17:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.086+0000 7fd97fc11b80 1 Processor -- start 2024-05-03T22:17:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.086+0000 7fd97fc11b80 1 -- start start 2024-05-03T22:17:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.086+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa1fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.086+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa233f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.086+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa23930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.086+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cc9aa391a0 con 0x55cc9aa20500 2024-05-03T22:17:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.086+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55cc9aa39870 con 0x55cc9aa26200 2024-05-03T22:17:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.086+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cc9aa39f40 con 0x55cc9aa258e0 2024-05-03T22:17:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa1fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa1fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45696/0 (socket says 172.21.15.82:45696) 2024-05-03T22:17:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96de00700 1 -- 172.21.15.82:0/880583020 learned_addr learned my addr 172.21.15.82:0/880583020 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96e800700 1 --2- 172.21.15.82:0/880583020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa23930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96de00700 1 -- 172.21.15.82:0/880583020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 msgr2=0x55cc9aa233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96d400700 1 --2- 172.21.15.82:0/880583020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96de00700 1 --2- 172.21.15.82:0/880583020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96de00700 1 -- 172.21.15.82:0/880583020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 msgr2=0x55cc9aa23930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96de00700 1 --2- 172.21.15.82:0/880583020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa23930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96de00700 1 -- 172.21.15.82:0/880583020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc9aa1b7a0 con 0x55cc9aa20500 2024-05-03T22:17:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96e800700 1 --2- 172.21.15.82:0/880583020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa23930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:17:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.087+0000 7fd96d400700 1 --2- 172.21.15.82:0/880583020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:17:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.088+0000 7fd96de00700 1 --2- 172.21.15.82:0/880583020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa1fee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd960005950 tx=0x7fd960091170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcc10b0bd89e608 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.088+0000 7fd95aa00700 1 -- 172.21.15.82:0/880583020 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960020070 con 0x55cc9aa20500 2024-05-03T22:17:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.088+0000 7fd95aa00700 1 -- 172.21.15.82:0/880583020 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9600aa470 con 0x55cc9aa20500 2024-05-03T22:17:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.088+0000 7fd95aa00700 1 -- 172.21.15.82:0/880583020 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9600a8f30 con 0x55cc9aa20500 2024-05-03T22:17:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.089+0000 7fd97fc11b80 1 -- 172.21.15.82:0/880583020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 msgr2=0x55cc9aa1fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.089+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/880583020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa1fee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd960005950 tx=0x7fd960091170 comp rx=0 tx=0).stop 2024-05-03T22:17:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.089+0000 7fd97fc11b80 1 -- 172.21.15.82:0/880583020 shutdown_connections 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.089+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/880583020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa20500 0x55cc9aa1fee0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.089+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/880583020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa26200 0x55cc9aa23930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.089+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/880583020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa258e0 0x55cc9aa233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.089+0000 7fd97fc11b80 1 -- 172.21.15.82:0/880583020 >> 172.21.15.82:0/880583020 conn(0x55cc9a998680 msgr2=0x55cc9aa291c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.089+0000 7fd97fc11b80 1 -- 172.21.15.82:0/880583020 shutdown_connections 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.089+0000 7fd97fc11b80 1 -- 172.21.15.82:0/880583020 wait complete. 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.089+0000 7fd97fc11b80 1 -- start start 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.090+0000 7fd97fc11b80 1 Processor -- start 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.090+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa20500 0x55cc9aa447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.090+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa258e0 0x55cc9aa3f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.090+0000 7fd97fc11b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa26200 0x55cc9aa3f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.090+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cc9aa3ace0 con 0x55cc9aa26200 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.090+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55cc9aa3a610 con 0x55cc9aa258e0 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.090+0000 7fd97fc11b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cc9aa3b3b0 con 0x55cc9aa20500 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.090+0000 7fd97fc11b80 10 client.0 _ll_register_callbacks cb 0x55cc9a919c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:17:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd96e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa26200 0x55cc9aa3f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd96e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa26200 0x55cc9aa3f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45708/0 (socket says 172.21.15.82:45708) 2024-05-03T22:17:58.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd96e800700 1 -- 172.21.15.82:0/899202161 learned_addr learned my addr 172.21.15.82:0/899202161 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:17:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd96de00700 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa20500 0x55cc9aa447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd96d400700 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa258e0 0x55cc9aa3f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd96e800700 1 -- 172.21.15.82:0/899202161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa20500 msgr2=0x55cc9aa447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd96e800700 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa20500 0x55cc9aa447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd96e800700 1 -- 172.21.15.82:0/899202161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa258e0 msgr2=0x55cc9aa3f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd96e800700 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa258e0 0x55cc9aa3f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd96e800700 1 -- 172.21.15.82:0/899202161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc9aa3ffc0 con 0x55cc9aa26200 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd96e800700 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa26200 0x55cc9aa3f7d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd968016b40 tx=0x7fd968018be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a0183a64aeff45 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.091+0000 7fd94fe00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.092+0000 7fd94fe00700 1 -- 172.21.15.82:0/899202161 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968030070 con 0x55cc9aa26200 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.092+0000 7fd94fe00700 1 -- 172.21.15.82:0/899202161 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fd968019480 con 0x55cc9aa26200 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.092+0000 7fd97fc11b80 1 -- 172.21.15.82:0/899202161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc9a9803b0 con 0x55cc9aa26200 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.092+0000 7fd94fe00700 1 -- 172.21.15.82:0/899202161 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd968026040 con 0x55cc9aa26200 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.092+0000 7fd97fc11b80 10 client.15225 fetch_fsmap learned FSMap version 29 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.092+0000 7fd97fc11b80 1 -- 172.21.15.82:0/899202161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cc9aaa5da0 con 0x55cc9aa26200 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.092+0000 7fd94fe00700 1 -- 172.21.15.82:0/899202161 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cc9a9803b0 con 0x55cc9aa26200 2024-05-03T22:17:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.093+0000 7fd94fe00700 1 -- 172.21.15.82:0/899202161 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd968019b10 con 0x55cc9aa26200 2024-05-03T22:17:58.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.093+0000 7fd97fc11b80 10 client.15225 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:17:58.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.093+0000 7fd97fc11b80 10 client.15225 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T22:17:58.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.093+0000 7fd97fc11b80 20 client.15225 populate_metadata read hostname 'smithi082' 2024-05-03T22:17:58.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.093+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x55cc9aaaa740 0x55cc9aaa9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:17:58.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.093+0000 7fd97fc11b80 4 client.15225 mds_command: new command op to 34403 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:17:58.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.093+0000 7fd97fc11b80 1 -- 172.21.15.82:0/899202161 --> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] -- command(tid 0: {"prefix": "status"}) -- 0x55cc9a97a450 con 0x55cc9aaaa740 2024-05-03T22:17:58.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.093+0000 7fd96de00700 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x55cc9aaaa740 0x55cc9aaa9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:17:58.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.094+0000 7fd96de00700 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x55cc9aaaa740 0x55cc9aaa9450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=45103eaac6c4aa39 server_cookie=8511e90ea1721dbb in_seq=0 out_seq=0 2024-05-03T22:17:58.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.094+0000 7fd94fe00700 10 client.15225 ms_handle_connect on v2:172.21.15.116:6832/1484646572 2024-05-03T22:17:58.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd94fe00700 1 -- 172.21.15.82:0/899202161 <== mds.3 v2:172.21.15.116:6832/1484646572 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55cc9a97a450 con 0x55cc9aaaa740 2024-05-03T22:17:58.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd94fe00700 10 client.15225 handle_command_reply: tid=0 2024-05-03T22:17:58.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd97fc11b80 1 client.15225 shutdown 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd97fc11b80 1 -- 172.21.15.82:0/899202161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa26200 msgr2=0x55cc9aa3f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa26200 0x55cc9aa3f7d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd968016b40 tx=0x7fd968018be0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd97fc11b80 1 -- 172.21.15.82:0/899202161 shutdown_connections 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.116:6832/1484646572,v1:172.21.15.116:6833/1484646572] conn(0x55cc9aaaa740 0x55cc9aaa9450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cc9aa26200 0x55cc9aa3f7d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cc9aa20500 0x55cc9aa447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd97fc11b80 1 --2- 172.21.15.82:0/899202161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc9aa258e0 0x55cc9aa3f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd94fe00700 0 client.15225 ms_handle_reset on v2:172.21.15.116:6832/1484646572 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.095+0000 7fd97fc11b80 1 -- 172.21.15.82:0/899202161 >> 172.21.15.82:0/899202161 conn(0x55cc9a998680 msgr2=0x55cc9aa233f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.096+0000 7fd97fc11b80 1 -- 172.21.15.82:0/899202161 shutdown_connections 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.096+0000 7fd97fc11b80 1 -- 172.21.15.82:0/899202161 wait complete. 2024-05-03T22:17:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.096+0000 7fd97fc11b80 20 client.15225 trim_cache size 0 max 16384 2024-05-03T22:17:58.100 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:17:58.100 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:17:58.100 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 3, 2024-05-03T22:17:58.100 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 34403, 2024-05-03T22:17:58.100 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-03T22:17:58.100 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-03T22:17:58.100 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-03T22:17:58.100 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 234.003138533, 2024-05-03T22:17:58.100 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 29, 2024-05-03T22:17:58.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-05-03T22:17:58.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-05-03T22:17:58.101 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 386.97343399800002 2024-05-03T22:17:58.101 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:17:58.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.096+0000 7fd975200700 1 -- 172.21.15.82:0/2845610219 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd9540b2910 msgr2=0x7fd9540b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:58.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.096+0000 7fd975200700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd9540b2910 0x7fd9540b4dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd968012bf0 tx=0x7fd968012310 comp rx=0 tx=0).stop 2024-05-03T22:17:58.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.096+0000 7fd975200700 1 -- 172.21.15.82:0/2845610219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9701056c0 msgr2=0x7fd9701a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:17:58.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.096+0000 7fd975200700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9701056c0 0x7fd9701a18e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd96000d950 tx=0x7fd96000dd10 comp rx=0 tx=0).stop 2024-05-03T22:17:58.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.097+0000 7fd975200700 1 -- 172.21.15.82:0/2845610219 shutdown_connections 2024-05-03T22:17:58.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.097+0000 7fd975200700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fd9540b2910 0x7fd9540b4dd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.097+0000 7fd975200700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9701056c0 0x7fd9701a18e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.097+0000 7fd975200700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd97010b6c0 0x7fd97019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.097+0000 7fd975200700 1 --2- 172.21.15.82:0/2845610219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd970106080 0x7fd9701a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:17:58.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.097+0000 7fd975200700 1 -- 172.21.15.82:0/2845610219 >> 172.21.15.82:0/2845610219 conn(0x7fd9701011b0 msgr2=0x7fd970101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:17:58.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.097+0000 7fd975200700 1 -- 172.21.15.82:0/2845610219 shutdown_connections 2024-05-03T22:17:58.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:17:58.097+0000 7fd975200700 1 -- 172.21.15.82:0/2845610219 wait complete. 2024-05-03T22:17:58.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:57 smithi116 ceph-mon[31828]: pgmap v542: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:58.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:57 smithi130 ceph-mon[32417]: pgmap v542: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:17:59.161 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell mds.e status 2024-05-03T22:17:59.611 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:18:00.103 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:17:59 smithi082 ceph-mon[28404]: pgmap v543: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:00.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:17:59 smithi116 ceph-mon[31828]: pgmap v543: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:00.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:17:59 smithi130 ceph-mon[32417]: pgmap v543: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:01.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:01 smithi082 ceph-mon[28404]: pgmap v544: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:01.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.962+0000 7fc97a400700 1 -- 172.21.15.82:0/1266100726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9741055d0 msgr2=0x7fc974105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:01.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.962+0000 7fc97a400700 1 --2- 172.21.15.82:0/1266100726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9741055d0 0x7fc974105a50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc9600099c0 tx=0x7fc960009cd0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.962+0000 7fc97a400700 1 -- 172.21.15.82:0/1266100726 shutdown_connections 2024-05-03T22:18:01.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.962+0000 7fc97a400700 1 --2- 172.21.15.82:0/1266100726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc974105f90 0x7fc974112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.962+0000 7fc97a400700 1 --2- 172.21.15.82:0/1266100726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc97410b680 0x7fc97410ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.962+0000 7fc97a400700 1 --2- 172.21.15.82:0/1266100726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9741055d0 0x7fc974105a50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.962+0000 7fc97a400700 1 -- 172.21.15.82:0/1266100726 >> 172.21.15.82:0/1266100726 conn(0x7fc9741010e0 msgr2=0x7fc974103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:01.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.962+0000 7fc97a400700 1 -- 172.21.15.82:0/1266100726 shutdown_connections 2024-05-03T22:18:01.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.962+0000 7fc97a400700 1 -- 172.21.15.82:0/1266100726 wait complete. 2024-05-03T22:18:01.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.964+0000 7fc97a400700 1 Processor -- start 2024-05-03T22:18:01.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.964+0000 7fc97a400700 1 -- start start 2024-05-03T22:18:01.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.965+0000 7fc97a400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9741055d0 0x7fc9741a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:01.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.965+0000 7fc97a400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc974105f90 0x7fc9741a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:01.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.965+0000 7fc97a400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc97410b680 0x7fc97419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:01.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.965+0000 7fc97a400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc974115680 con 0x7fc9741055d0 2024-05-03T22:18:01.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.965+0000 7fc97a400700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc974115500 con 0x7fc97410b680 2024-05-03T22:18:01.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.965+0000 7fc97a400700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc974115800 con 0x7fc974105f90 2024-05-03T22:18:01.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.965+0000 7fc979000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9741055d0 0x7fc9741a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:01.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.965+0000 7fc979000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9741055d0 0x7fc9741a1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45714/0 (socket says 172.21.15.82:45714) 2024-05-03T22:18:01.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.965+0000 7fc979000700 1 -- 172.21.15.82:0/1431331460 learned_addr learned my addr 172.21.15.82:0/1431331460 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:01.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.965+0000 7fc973e00700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc974105f90 0x7fc9741a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:01.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.966+0000 7fc979000700 1 -- 172.21.15.82:0/1431331460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc974105f90 msgr2=0x7fc9741a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:01.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.966+0000 7fc979000700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc974105f90 0x7fc9741a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.966+0000 7fc979000700 1 -- 172.21.15.82:0/1431331460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc97410b680 msgr2=0x7fc97419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:01.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.966+0000 7fc979000700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc97410b680 0x7fc97419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.966+0000 7fc979000700 1 -- 172.21.15.82:0/1431331460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97419c160 con 0x7fc9741055d0 2024-05-03T22:18:01.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.966+0000 7fc979000700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9741055d0 0x7fc9741a1840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc96800c9b0 tx=0x7fc96800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:01.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.966+0000 7fc971600700 1 -- 172.21.15.82:0/1431331460 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968007b00 con 0x7fc9741055d0 2024-05-03T22:18:01.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.966+0000 7fc971600700 1 -- 172.21.15.82:0/1431331460 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc968007ca0 con 0x7fc9741055d0 2024-05-03T22:18:01.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.966+0000 7fc97a400700 1 -- 172.21.15.82:0/1431331460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97419c450 con 0x7fc9741055d0 2024-05-03T22:18:01.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.966+0000 7fc971600700 1 -- 172.21.15.82:0/1431331460 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968018660 con 0x7fc9741055d0 2024-05-03T22:18:01.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.966+0000 7fc97a400700 1 -- 172.21.15.82:0/1431331460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9741a8710 con 0x7fc9741055d0 2024-05-03T22:18:01.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.970+0000 7fc971600700 1 -- 172.21.15.82:0/1431331460 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc96800f450 con 0x7fc9741055d0 2024-05-03T22:18:01.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.971+0000 7fc9863b6b80 1 Processor -- start 2024-05-03T22:18:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc9863b6b80 1 -- start start 2024-05-03T22:18:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc971600700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc95c0b2910 0x7fc95c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c4020f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401aee0 0x5600c401b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c401b8a0 0x5600c4027940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5600c3f6d9d0 con 0x5600c4020b80 2024-05-03T22:18:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5600c3f0b710 con 0x5600c401b8a0 2024-05-03T22:18:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5600c3f69990 con 0x5600c401aee0 2024-05-03T22:18:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc971600700 1 -- 172.21.15.82:0/1431331460 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fc9680e2800 con 0x7fc9741055d0 2024-05-03T22:18:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc979000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c4020f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc979000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c4020f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45726/0 (socket says 172.21.15.82:45726) 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc979000700 1 -- 172.21.15.82:0/1585274617 learned_addr learned my addr 172.21.15.82:0/1585274617 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.972+0000 7fc979a00700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc95c0b2910 0x7fc95c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc973e00700 1 --2- 172.21.15.82:0/1585274617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401aee0 0x5600c401b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc979000700 1 -- 172.21.15.82:0/1585274617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401aee0 msgr2=0x5600c401b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc979000700 1 --2- 172.21.15.82:0/1585274617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401aee0 0x5600c401b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc979a00700 1 --2- 172.21.15.82:0/1585274617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c401b8a0 0x5600c4027940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc979000700 1 -- 172.21.15.82:0/1585274617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c401b8a0 msgr2=0x5600c4027940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc979000700 1 --2- 172.21.15.82:0/1585274617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c401b8a0 0x5600c4027940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc979000700 1 -- 172.21.15.82:0/1585274617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600c3eba880 con 0x5600c4020b80 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc973e00700 1 --2- 172.21.15.82:0/1585274617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401aee0 0x5600c401b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc979000700 1 --2- 172.21.15.82:0/1585274617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c4020f60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc96800afd0 tx=0x7fc9680a9780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2448c5dfba86767 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc979a00700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc95c0b2910 0x7fc95c0b4dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5600c4016a40 tx=0x7fc96c0093d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc966000700 1 -- 172.21.15.82:0/1585274617 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9680a93b0 con 0x5600c4020b80 2024-05-03T22:18:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.973+0000 7fc966000700 1 -- 172.21.15.82:0/1585274617 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9680a9fa0 con 0x5600c4020b80 2024-05-03T22:18:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.974+0000 7fc966000700 1 -- 172.21.15.82:0/1585274617 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9680cc0d0 con 0x5600c4020b80 2024-05-03T22:18:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.974+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1585274617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 msgr2=0x5600c4020f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.974+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/1585274617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c4020f60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc96800afd0 tx=0x7fc9680a9780 comp rx=0 tx=0).stop 2024-05-03T22:18:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.974+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1585274617 shutdown_connections 2024-05-03T22:18:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.974+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/1585274617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c4020f60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.974+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/1585274617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c401b8a0 0x5600c4027940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.974+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/1585274617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401aee0 0x5600c401b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.974+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1585274617 >> 172.21.15.82:0/1585274617 conn(0x5600c3f93680 msgr2=0x5600c4015b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.974+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1585274617 shutdown_connections 2024-05-03T22:18:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.975+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1585274617 wait complete. 2024-05-03T22:18:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.975+0000 7fc9863b6b80 1 -- start start 2024-05-03T22:18:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.975+0000 7fc9863b6b80 1 Processor -- start 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401aee0 0x5600c4027540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401b8a0 0x5600c40248e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c4020b80 0x5600c4024e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5600c4027ee0 con 0x5600c401aee0 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5600c3ed3ad0 con 0x5600c4020b80 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5600c4028060 con 0x5600c401b8a0 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc9863b6b80 10 client.0 _ll_register_callbacks cb 0x5600c3f14c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc979000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401aee0 0x5600c4027540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc979000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401aee0 0x5600c4027540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45738/0 (socket says 172.21.15.82:45738) 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc979000700 1 -- 172.21.15.82:0/1982178337 learned_addr learned my addr 172.21.15.82:0/1982178337 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc973e00700 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401b8a0 0x5600c40248e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.976+0000 7fc979000700 1 -- 172.21.15.82:0/1982178337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401b8a0 msgr2=0x5600c40248e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:01.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc979000700 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401b8a0 0x5600c40248e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc979000700 1 -- 172.21.15.82:0/1982178337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c4020b80 msgr2=0x5600c4024e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc979000700 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c4020b80 0x5600c4024e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc979000700 1 -- 172.21.15.82:0/1982178337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600c3f333d0 con 0x5600c401aee0 2024-05-03T22:18:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc979000700 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401aee0 0x5600c4027540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc9680a9180 tx=0x7fc9680a94e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448f38d79b7e01b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc95aa00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:18:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc95aa00700 1 -- 172.21.15.82:0/1982178337 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9680b2700 con 0x5600c401aee0 2024-05-03T22:18:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc95aa00700 1 -- 172.21.15.82:0/1982178337 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fc9680cc0d0 con 0x5600c401aee0 2024-05-03T22:18:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1982178337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9680a9fa0 con 0x5600c401aee0 2024-05-03T22:18:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc95aa00700 1 -- 172.21.15.82:0/1982178337 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc9680dffe0 con 0x5600c401aee0 2024-05-03T22:18:01.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc9863b6b80 10 client.15237 fetch_fsmap learned FSMap version 29 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.977+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1982178337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5600c4032610 con 0x5600c401aee0 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.978+0000 7fc95aa00700 1 -- 172.21.15.82:0/1982178337 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9680a9fa0 con 0x5600c401aee0 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.978+0000 7fc95aa00700 1 -- 172.21.15.82:0/1982178337 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc96806f080 con 0x5600c401aee0 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.978+0000 7fc9863b6b80 10 client.15237 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.978+0000 7fc9863b6b80 10 client.15237 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.978+0000 7fc9863b6b80 20 client.15237 populate_metadata read hostname 'smithi082' 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.978+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x5600c4034800 0x5600c4035c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.978+0000 7fc9863b6b80 4 client.15237 mds_command: new command op to 34412 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.978+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1982178337 --> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600c3fe7fa0 con 0x5600c4034800 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.979+0000 7fc973e00700 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x5600c4034800 0x5600c4035c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.980+0000 7fc973e00700 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x5600c4034800 0x5600c4035c70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4d9bed583987f9a4 server_cookie=156b94223de6d119 in_seq=0 out_seq=0 2024-05-03T22:18:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.980+0000 7fc95aa00700 10 client.15237 ms_handle_connect on v2:172.21.15.116:6834/1544765094 2024-05-03T22:18:01.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc95aa00700 1 -- 172.21.15.82:0/1982178337 <== mds.2 v2:172.21.15.116:6834/1544765094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5600c3fe7fa0 con 0x5600c4034800 2024-05-03T22:18:01.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc95aa00700 10 client.15237 handle_command_reply: tid=0 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc9863b6b80 1 client.15237 shutdown 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1982178337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401aee0 msgr2=0x5600c4027540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401aee0 0x5600c4027540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc9680a9180 tx=0x7fc9680a94e0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1982178337 shutdown_connections 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x5600c4034800 0x5600c4035c70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401aee0 0x5600c4027540 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c4020b80 0x5600c4024e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/1982178337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401b8a0 0x5600c40248e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1982178337 >> 172.21.15.82:0/1982178337 conn(0x5600c3f93680 msgr2=0x5600c4019ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc95aa00700 0 client.15237 ms_handle_reset on v2:172.21.15.116:6834/1544765094 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1982178337 shutdown_connections 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.982+0000 7fc9863b6b80 1 -- 172.21.15.82:0/1982178337 wait complete. 2024-05-03T22:18:01.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:01.983+0000 7fc9863b6b80 20 client.15237 trim_cache size 0 max 16384 2024-05-03T22:18:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.006+0000 7fc9863b6b80 1 Processor -- start 2024-05-03T22:18:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.007+0000 7fc9863b6b80 1 -- start start 2024-05-03T22:18:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.007+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401aee0 0x5600c4024e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.007+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401b8a0 0x5600c4026d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.007+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c4020b80 0x5600c40254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.007+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5600c4033fb0 con 0x5600c401b8a0 2024-05-03T22:18:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.007+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5600c4034680 con 0x5600c4020b80 2024-05-03T22:18:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.007+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5600c4034d50 con 0x5600c401aee0 2024-05-03T22:18:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.007+0000 7fc973e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401b8a0 0x5600c4026d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.007+0000 7fc973e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401b8a0 0x5600c4026d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45754/0 (socket says 172.21.15.82:45754) 2024-05-03T22:18:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.007+0000 7fc973e00700 1 -- 172.21.15.82:0/2583415201 learned_addr learned my addr 172.21.15.82:0/2583415201 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.008+0000 7fc979000700 1 --2- 172.21.15.82:0/2583415201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401aee0 0x5600c4024e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.008+0000 7fc973e00700 1 -- 172.21.15.82:0/2583415201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401aee0 msgr2=0x5600c4024e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.008+0000 7fc973e00700 1 --2- 172.21.15.82:0/2583415201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401aee0 0x5600c4024e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.008+0000 7fc973e00700 1 -- 172.21.15.82:0/2583415201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c4020b80 msgr2=0x5600c40254b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.008+0000 7fc973e00700 1 --2- 172.21.15.82:0/2583415201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c4020b80 0x5600c40254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.008+0000 7fc973e00700 1 -- 172.21.15.82:0/2583415201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600c3fe7f80 con 0x5600c401b8a0 2024-05-03T22:18:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.008+0000 7fc973e00700 1 --2- 172.21.15.82:0/2583415201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401b8a0 0x5600c4026d50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc960006010 tx=0x7fc960009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ce35187ecaaecd server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.008+0000 7fc965600700 1 -- 172.21.15.82:0/2583415201 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960005330 con 0x5600c401b8a0 2024-05-03T22:18:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.008+0000 7fc965600700 1 -- 172.21.15.82:0/2583415201 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc96002b070 con 0x5600c401b8a0 2024-05-03T22:18:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.008+0000 7fc965600700 1 -- 172.21.15.82:0/2583415201 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960003970 con 0x5600c401b8a0 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.009+0000 7fc9863b6b80 1 -- 172.21.15.82:0/2583415201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401b8a0 msgr2=0x5600c4026d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.009+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/2583415201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401b8a0 0x5600c4026d50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc960006010 tx=0x7fc960009310 comp rx=0 tx=0).stop 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.009+0000 7fc9863b6b80 1 -- 172.21.15.82:0/2583415201 shutdown_connections 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.009+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/2583415201 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c4020b80 0x5600c40254b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.009+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/2583415201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401aee0 0x5600c4024e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.009+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/2583415201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c401b8a0 0x5600c4026d50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.009+0000 7fc9863b6b80 1 -- 172.21.15.82:0/2583415201 >> 172.21.15.82:0/2583415201 conn(0x5600c3f93680 msgr2=0x5600c400f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.009+0000 7fc9863b6b80 1 -- 172.21.15.82:0/2583415201 shutdown_connections 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.009+0000 7fc9863b6b80 1 -- 172.21.15.82:0/2583415201 wait complete. 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.010+0000 7fc9863b6b80 1 -- start start 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.010+0000 7fc9863b6b80 1 Processor -- start 2024-05-03T22:18:02.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.010+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c401aee0 0x5600c403f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.010+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401b8a0 0x5600c4025da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.010+0000 7fc9863b6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c40264e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.010+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5600c4035af0 con 0x5600c4020b80 2024-05-03T22:18:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.010+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5600c4035420 con 0x5600c401aee0 2024-05-03T22:18:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.010+0000 7fc9863b6b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5600c40361c0 con 0x5600c401b8a0 2024-05-03T22:18:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc9863b6b80 10 client.0 _ll_register_callbacks cb 0x5600c3f14c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:18:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc979a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c40264e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc979a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c40264e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45760/0 (socket says 172.21.15.82:45760) 2024-05-03T22:18:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc979a00700 1 -- 172.21.15.82:0/55650481 learned_addr learned my addr 172.21.15.82:0/55650481 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc973e00700 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401b8a0 0x5600c4025da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:02.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc979000700 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c401aee0 0x5600c403f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc979a00700 1 -- 172.21.15.82:0/55650481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401b8a0 msgr2=0x5600c4025da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc979a00700 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401b8a0 0x5600c4025da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc979a00700 1 -- 172.21.15.82:0/55650481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c401aee0 msgr2=0x5600c403f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc979a00700 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c401aee0 0x5600c403f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc979a00700 1 -- 172.21.15.82:0/55650481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600c4012450 con 0x5600c4020b80 2024-05-03T22:18:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.011+0000 7fc973e00700 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401b8a0 0x5600c4025da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:18:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.012+0000 7fc979a00700 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c40264e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc96c01b740 tx=0x7fc96c01bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bafb1b008f3606 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.012+0000 7fc95aa00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.012+0000 7fc95aa00700 1 -- 172.21.15.82:0/55650481 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c028060 con 0x5600c4020b80 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.012+0000 7fc9863b6b80 1 -- 172.21.15.82:0/55650481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc96002b070 con 0x5600c4020b80 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.012+0000 7fc95aa00700 1 -- 172.21.15.82:0/55650481 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fc96c019650 con 0x5600c4020b80 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.012+0000 7fc95aa00700 1 -- 172.21.15.82:0/55650481 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc96c02f050 con 0x5600c4020b80 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.012+0000 7fc9863b6b80 10 client.15243 fetch_fsmap learned FSMap version 29 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.012+0000 7fc9863b6b80 1 -- 172.21.15.82:0/55650481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5600c409fd20 con 0x5600c4020b80 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.013+0000 7fc95aa00700 1 -- 172.21.15.82:0/55650481 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc96002b070 con 0x5600c4020b80 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.013+0000 7fc95aa00700 1 -- 172.21.15.82:0/55650481 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc96c022910 con 0x5600c4020b80 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.013+0000 7fc9863b6b80 10 client.15243 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.013+0000 7fc9863b6b80 10 client.15243 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.013+0000 7fc9863b6b80 20 client.15243 populate_metadata read hostname 'smithi082' 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.013+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x5600c40a48e0 0x5600c40a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.013+0000 7fc9863b6b80 4 client.15243 mds_command: new command op to 34412 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.013+0000 7fc9863b6b80 1 -- 172.21.15.82:0/55650481 --> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] -- command(tid 0: {"prefix": "status"}) -- 0x5600c3f7b3b0 con 0x5600c40a48e0 2024-05-03T22:18:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.014+0000 7fc979000700 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x5600c40a48e0 0x5600c40a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.015+0000 7fc979000700 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x5600c40a48e0 0x5600c40a35f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bee19e53213f4fa0 server_cookie=44ec817d72a1f413 in_seq=0 out_seq=0 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.015+0000 7fc95aa00700 10 client.15243 ms_handle_connect on v2:172.21.15.116:6834/1544765094 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.015+0000 7fc95aa00700 1 -- 172.21.15.82:0/55650481 <== mds.2 v2:172.21.15.116:6834/1544765094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5600c3f7b3b0 con 0x5600c40a48e0 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.015+0000 7fc95aa00700 10 client.15243 handle_command_reply: tid=0 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.015+0000 7fc9863b6b80 1 client.15243 shutdown 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc9863b6b80 1 -- 172.21.15.82:0/55650481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 msgr2=0x5600c40264e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c40264e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc96c01b740 tx=0x7fc96c01bb00 comp rx=0 tx=0).stop 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc9863b6b80 1 -- 172.21.15.82:0/55650481 shutdown_connections 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.116:6834/1544765094,v1:172.21.15.116:6835/1544765094] conn(0x5600c40a48e0 0x5600c40a35f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600c4020b80 0x5600c40264e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5600c401aee0 0x5600c403f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc9863b6b80 1 --2- 172.21.15.82:0/55650481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5600c401b8a0 0x5600c4025da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc9863b6b80 1 -- 172.21.15.82:0/55650481 >> 172.21.15.82:0/55650481 conn(0x5600c3f93680 msgr2=0x5600c400fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc95aa00700 0 client.15243 ms_handle_reset on v2:172.21.15.116:6834/1544765094 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc9863b6b80 1 -- 172.21.15.82:0/55650481 shutdown_connections 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc9863b6b80 1 -- 172.21.15.82:0/55650481 wait complete. 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.016+0000 7fc9863b6b80 20 client.15243 trim_cache size 0 max 16384 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 34412, 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-03T22:18:02.020 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 238.93181653400001, 2024-05-03T22:18:02.021 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 29, 2024-05-03T22:18:02.021 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-05-03T22:18:02.021 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-05-03T22:18:02.021 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 375.69806510000001 2024-05-03T22:18:02.021 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:18:02.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 -- 172.21.15.82:0/1431331460 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc95c0b2910 msgr2=0x7fc95c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:02.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc95c0b2910 0x7fc95c0b4dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5600c4016a40 tx=0x7fc96c0093d0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 -- 172.21.15.82:0/1431331460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9741055d0 msgr2=0x7fc9741a1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9741055d0 0x7fc9741a1840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc96800c9b0 tx=0x7fc96800cd70 comp rx=0 tx=0).stop 2024-05-03T22:18:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 -- 172.21.15.82:0/1431331460 shutdown_connections 2024-05-03T22:18:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fc95c0b2910 0x7fc95c0b4dd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9741055d0 0x7fc9741a1840 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc97410b680 0x7fc97419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 --2- 172.21.15.82:0/1431331460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc974105f90 0x7fc9741a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 -- 172.21.15.82:0/1431331460 >> 172.21.15.82:0/1431331460 conn(0x7fc9741010e0 msgr2=0x7fc9741027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 -- 172.21.15.82:0/1431331460 shutdown_connections 2024-05-03T22:18:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:02.017+0000 7fc97a400700 1 -- 172.21.15.82:0/1431331460 wait complete. 2024-05-03T22:18:02.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:01 smithi116 ceph-mon[31828]: pgmap v544: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:02.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:01 smithi130 ceph-mon[32417]: pgmap v544: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:03.047 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-03T22:18:03.495 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:18:03.895 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:03 smithi082 ceph-mon[28404]: pgmap v545: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:04.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:03 smithi116 ceph-mon[31828]: pgmap v545: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:04.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:03 smithi130 ceph-mon[32417]: pgmap v545: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:05.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.988+0000 7f500a600700 1 -- 172.21.15.82:0/1251369534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5004104100 msgr2=0x7f5004108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:05.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.988+0000 7f500a600700 1 --2- 172.21.15.82:0/1251369534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5004104100 0x7f5004108120 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0099c0 tx=0x7f4fec009cd0 comp rx=0 tx=0).stop 2024-05-03T22:18:05.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.988+0000 7f500a600700 1 -- 172.21.15.82:0/1251369534 shutdown_connections 2024-05-03T22:18:05.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.988+0000 7f500a600700 1 --2- 172.21.15.82:0/1251369534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5004108850 0x7f50041103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:05.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.988+0000 7f500a600700 1 --2- 172.21.15.82:0/1251369534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5004103750 0x7f5004103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:05.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.988+0000 7f500a600700 1 --2- 172.21.15.82:0/1251369534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5004104100 0x7f5004108120 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:05.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.988+0000 7f500a600700 1 -- 172.21.15.82:0/1251369534 >> 172.21.15.82:0/1251369534 conn(0x7f500407a600 msgr2=0x7f500407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:05.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.989+0000 7f500a600700 1 -- 172.21.15.82:0/1251369534 shutdown_connections 2024-05-03T22:18:05.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.989+0000 7f500a600700 1 -- 172.21.15.82:0/1251369534 wait complete. 2024-05-03T22:18:05.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.989+0000 7f500a600700 1 Processor -- start 2024-05-03T22:18:05.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.990+0000 7f500a600700 1 -- start start 2024-05-03T22:18:05.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.990+0000 7f500a600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5004103750 0x7f500419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.990+0000 7f500a600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5004104100 0x7f500419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.990+0000 7f500a600700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5004108850 0x7f5004199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.990+0000 7f500a600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50041134e0 con 0x7f5004104100 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.990+0000 7f500a600700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5004113360 con 0x7f5004108850 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.990+0000 7f500a600700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5004113660 con 0x7f5004103750 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.990+0000 7f4ffbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5004104100 0x7f500419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.990+0000 7f4ffbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5004104100 0x7f500419fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53724/0 (socket says 172.21.15.82:53724) 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.990+0000 7f4ffbe00700 1 -- 172.21.15.82:0/3032049228 learned_addr learned my addr 172.21.15.82:0/3032049228 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.991+0000 7f5003400700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5004103750 0x7f500419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.991+0000 7f5003e00700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5004108850 0x7f5004199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.991+0000 7f4ffbe00700 1 -- 172.21.15.82:0/3032049228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5004103750 msgr2=0x7f500419f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:05.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.991+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5004103750 0x7f500419f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:05.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.991+0000 7f4ffbe00700 1 -- 172.21.15.82:0/3032049228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5004108850 msgr2=0x7f5004199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:05.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.991+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5004108850 0x7f5004199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:05.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.991+0000 7f4ffbe00700 1 -- 172.21.15.82:0/3032049228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500419a060 con 0x7f5004104100 2024-05-03T22:18:05.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.991+0000 7f5003e00700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5004108850 0x7f5004199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:18:05.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.991+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5004104100 0x7f500419fc30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4fec005f50 tx=0x7f4fec00f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:05.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.992+0000 7f5000c00700 1 -- 172.21.15.82:0/3032049228 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec027070 con 0x7f5004104100 2024-05-03T22:18:05.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.992+0000 7f500a600700 1 -- 172.21.15.82:0/3032049228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500419a2f0 con 0x7f5004104100 2024-05-03T22:18:05.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.992+0000 7f5000c00700 1 -- 172.21.15.82:0/3032049228 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fec00fdd0 con 0x7f5004104100 2024-05-03T22:18:05.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.992+0000 7f5000c00700 1 -- 172.21.15.82:0/3032049228 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0173f0 con 0x7f5004104100 2024-05-03T22:18:05.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.992+0000 7f500a600700 1 -- 172.21.15.82:0/3032049228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50041a65c0 con 0x7f5004104100 2024-05-03T22:18:05.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.995+0000 7f5000c00700 1 -- 172.21.15.82:0/3032049228 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f4fec02a070 con 0x7f5004104100 2024-05-03T22:18:05.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.996+0000 7f5014fb4b80 1 Processor -- start 2024-05-03T22:18:05.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.996+0000 7f5014fb4b80 1 -- start start 2024-05-03T22:18:05.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f5000c00700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4fe80b2910 0x7f4fe80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0b200 0x55c9fcf04ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf05500 0x55c9fcf05980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c9fce579d0 con 0x55c9fcf0b200 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c9fcdf5710 con 0x55c9fcf05500 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c9fce53990 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f5000c00700 1 -- 172.21.15.82:0/3032049228 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f4fec0e35d0 con 0x7f5004104100 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f5003e00700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4fe80b2910 0x7f4fe80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f4ffbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0b200 0x55c9fcf04ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f4ffbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0b200 0x55c9fcf04ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53736/0 (socket says 172.21.15.82:53736) 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.997+0000 7f4ffbe00700 1 -- 172.21.15.82:0/1928234917 learned_addr learned my addr 172.21.15.82:0/1928234917 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f5003400700 1 --2- 172.21.15.82:0/1928234917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f5003e00700 1 --2- 172.21.15.82:0/1928234917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf05500 0x55c9fcf05980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f4ffbe00700 1 -- 172.21.15.82:0/1928234917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf0a8e0 msgr2=0x55c9fcf0acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:06.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/1928234917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f4ffbe00700 1 -- 172.21.15.82:0/1928234917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf05500 msgr2=0x55c9fcf05980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:06.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/1928234917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf05500 0x55c9fcf05980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f4ffbe00700 1 -- 172.21.15.82:0/1928234917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9fcda4880 con 0x55c9fcf0b200 2024-05-03T22:18:06.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f5003400700 1 --2- 172.21.15.82:0/1928234917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:18:06.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f5003e00700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4fe80b2910 0x7f4fe80b4dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0094f0 tx=0x7f4ffc0079a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/1928234917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0b200 0x55c9fcf04ee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0aa400 tx=0x7f4fec0aa180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713165e0ff6b5264 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f4ff8c00700 1 -- 172.21.15.82:0/1928234917 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0e2070 con 0x55c9fcf0b200 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f4ff8c00700 1 -- 172.21.15.82:0/1928234917 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fec0aae00 con 0x55c9fcf0b200 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.998+0000 7f4ff8c00700 1 -- 172.21.15.82:0/1928234917 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec092110 con 0x55c9fcf0b200 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.999+0000 7f5014fb4b80 1 -- 172.21.15.82:0/1928234917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0b200 msgr2=0x55c9fcf04ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.999+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/1928234917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0b200 0x55c9fcf04ee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0aa400 tx=0x7f4fec0aa180 comp rx=0 tx=0).stop 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.999+0000 7f5014fb4b80 1 -- 172.21.15.82:0/1928234917 shutdown_connections 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.999+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/1928234917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf05500 0x55c9fcf05980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.999+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/1928234917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.999+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/1928234917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0b200 0x55c9fcf04ee0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.999+0000 7f5014fb4b80 1 -- 172.21.15.82:0/1928234917 >> 172.21.15.82:0/1928234917 conn(0x55c9fce7d680 msgr2=0x55c9fceff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.999+0000 7f5014fb4b80 1 -- 172.21.15.82:0/1928234917 shutdown_connections 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:05.999+0000 7f5014fb4b80 1 -- 172.21.15.82:0/1928234917 wait complete. 2024-05-03T22:18:06.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.000+0000 7f5014fb4b80 1 -- start start 2024-05-03T22:18:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.000+0000 7f5014fb4b80 1 Processor -- start 2024-05-03T22:18:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf05500 0x55c9fcf10e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf0b200 0x55c9fcf0e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c9fcf11a70 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c9fcdbdad0 con 0x55c9fcf0b200 2024-05-03T22:18:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c9fcf11bf0 con 0x55c9fcf05500 2024-05-03T22:18:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f5014fb4b80 10 client.0 _ll_register_callbacks cb 0x55c9fcdfec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:18:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f4ffbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f4ffbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53744/0 (socket says 172.21.15.82:53744) 2024-05-03T22:18:06.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f4ffbe00700 1 -- 172.21.15.82:0/2515658834 learned_addr learned my addr 172.21.15.82:0/2515658834 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:06.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f5003400700 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf05500 0x55c9fcf10e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f5003e00700 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf0b200 0x55c9fcf0e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f4ffbe00700 1 -- 172.21.15.82:0/2515658834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf05500 msgr2=0x55c9fcf10e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:06.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf05500 0x55c9fcf10e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f4ffbe00700 1 -- 172.21.15.82:0/2515658834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf0b200 msgr2=0x55c9fcf0e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf0b200 0x55c9fcf0e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.001+0000 7f4ffbe00700 1 -- 172.21.15.82:0/2515658834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9fce1d3d0 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.002+0000 7f5003e00700 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf0b200 0x55c9fcf0e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:18:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.002+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0e1d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4fec000c00 tx=0x7f4fec005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817e2b3b7e9a4212 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.002+0000 7f4ff1600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:18:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.002+0000 7f4ff1600700 1 -- 172.21.15.82:0/2515658834 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec06b020 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.002+0000 7f4ff1600700 1 -- 172.21.15.82:0/2515658834 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f4fec0aab70 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.002+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2515658834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fec0aae00 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.002+0000 7f4ff1600700 1 -- 172.21.15.82:0/2515658834 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4fec0e2050 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.002+0000 7f5014fb4b80 10 client.15255 fetch_fsmap learned FSMap version 29 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.002+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2515658834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c9fcf11a70 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.003+0000 7f4ff1600700 1 -- 172.21.15.82:0/2515658834 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fec0aae00 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.003+0000 7f4ff1600700 1 -- 172.21.15.82:0/2515658834 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4fec0050d0 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.003+0000 7f5014fb4b80 10 client.15255 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.003+0000 7f5014fb4b80 10 client.15255 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.003+0000 7f5014fb4b80 20 client.15255 populate_metadata read hostname 'smithi082' 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.003+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x55c9fcf1e530 0x55c9fcf1f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.003+0000 7f5014fb4b80 4 client.15255 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.003+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2515658834 --> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9fced1fa0 con 0x55c9fcf1e530 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.004+0000 7f5003400700 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x55c9fcf1e530 0x55c9fcf1f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.005+0000 7f5003400700 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x55c9fcf1e530 0x55c9fcf1f9a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a74799fbfe96ba2 server_cookie=f3c66f9a827c1e59 in_seq=0 out_seq=0 2024-05-03T22:18:06.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.005+0000 7f4ff1600700 10 client.15255 ms_handle_connect on v2:172.21.15.116:6836/2428901446 2024-05-03T22:18:06.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f4ff1600700 1 -- 172.21.15.82:0/2515658834 <== mds.1 v2:172.21.15.116:6836/2428901446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c9fced1fa0 con 0x55c9fcf1e530 2024-05-03T22:18:06.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f4ff1600700 10 client.15255 handle_command_reply: tid=0 2024-05-03T22:18:06.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 1 client.15255 shutdown 2024-05-03T22:18:06.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2515658834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 msgr2=0x55c9fcf0e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0e1d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4fec000c00 tx=0x7f4fec005c00 comp rx=0 tx=0).stop 2024-05-03T22:18:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2515658834 shutdown_connections 2024-05-03T22:18:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x55c9fcf1e530 0x55c9fcf1f9a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf0b200 0x55c9fcf0e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf05500 0x55c9fcf10e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/2515658834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0e1d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2515658834 >> 172.21.15.82:0/2515658834 conn(0x55c9fce7d680 msgr2=0x55c9fcefa360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f4ff1600700 0 client.15255 ms_handle_reset on v2:172.21.15.116:6836/2428901446 2024-05-03T22:18:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2515658834 shutdown_connections 2024-05-03T22:18:06.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2515658834 wait complete. 2024-05-03T22:18:06.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.007+0000 7f5014fb4b80 20 client.15255 trim_cache size 0 max 16384 2024-05-03T22:18:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.029+0000 7f5014fb4b80 1 Processor -- start 2024-05-03T22:18:06.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.029+0000 7f5014fb4b80 1 -- start start 2024-05-03T22:18:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.030+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf05500 0x55c9fcf04ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.030+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.030+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf0b200 0x55c9fcf28e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.030+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c9fcf1dce0 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.030+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c9fcf1e3b0 con 0x55c9fcf05500 2024-05-03T22:18:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.030+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c9fcf1ea80 con 0x55c9fcf0b200 2024-05-03T22:18:06.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.030+0000 7f4ffbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.030+0000 7f4ffbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53756/0 (socket says 172.21.15.82:53756) 2024-05-03T22:18:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.030+0000 7f4ffbe00700 1 -- 172.21.15.82:0/2568743328 learned_addr learned my addr 172.21.15.82:0/2568743328 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.030+0000 7f5003400700 1 --2- 172.21.15.82:0/2568743328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf05500 0x55c9fcf04ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.030+0000 7f5003e00700 1 --2- 172.21.15.82:0/2568743328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf0b200 0x55c9fcf28e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.031+0000 7f4ffbe00700 1 -- 172.21.15.82:0/2568743328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf0b200 msgr2=0x55c9fcf28e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.031+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/2568743328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf0b200 0x55c9fcf28e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.031+0000 7f4ffbe00700 1 -- 172.21.15.82:0/2568743328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf05500 msgr2=0x55c9fcf04ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.031+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/2568743328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf05500 0x55c9fcf04ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.031+0000 7f4ffbe00700 1 -- 172.21.15.82:0/2568743328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9fcf20900 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.031+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/2568743328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0bdb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0b3610 tx=0x7f4fec022990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf79a634994f032 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:06.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.031+0000 7f4ff3e00700 1 -- 172.21.15.82:0/2568743328 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec06b070 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.031+0000 7f4ff3e00700 1 -- 172.21.15.82:0/2568743328 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fec0c4070 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.031+0000 7f4ff3e00700 1 -- 172.21.15.82:0/2568743328 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0aa700 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.032+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2568743328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 msgr2=0x55c9fcf0bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.032+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/2568743328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0bdb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0b3610 tx=0x7f4fec022990 comp rx=0 tx=0).stop 2024-05-03T22:18:06.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.032+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2568743328 shutdown_connections 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.032+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/2568743328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf0b200 0x55c9fcf28e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.032+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/2568743328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf05500 0x55c9fcf04ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.032+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/2568743328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf0bdb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.032+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2568743328 >> 172.21.15.82:0/2568743328 conn(0x55c9fce7d680 msgr2=0x55c9fcf0b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.032+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2568743328 shutdown_connections 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.032+0000 7f5014fb4b80 1 -- 172.21.15.82:0/2568743328 wait complete. 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.032+0000 7f5014fb4b80 1 -- start start 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.033+0000 7f5014fb4b80 1 Processor -- start 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.033+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf05500 0x55c9fcf28e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.033+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf29360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.033+0000 7f5014fb4b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf0b200 0x55c9fcf23dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.033+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c9fcf1f820 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.033+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c9fcf1f150 con 0x55c9fcf0b200 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.033+0000 7f5014fb4b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c9fcf1fef0 con 0x55c9fcf05500 2024-05-03T22:18:06.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.033+0000 7f5014fb4b80 10 client.0 _ll_register_callbacks cb 0x55c9fcdfec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:18:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.033+0000 7f4ffbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf29360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.033+0000 7f4ffbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf29360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53762/0 (socket says 172.21.15.82:53762) 2024-05-03T22:18:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.033+0000 7f4ffbe00700 1 -- 172.21.15.82:0/3700041211 learned_addr learned my addr 172.21.15.82:0/3700041211 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f5003400700 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf05500 0x55c9fcf28e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f4ffbe00700 1 -- 172.21.15.82:0/3700041211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf05500 msgr2=0x55c9fcf28e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf05500 0x55c9fcf28e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f4ffbe00700 1 -- 172.21.15.82:0/3700041211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf0b200 msgr2=0x55c9fcf23dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf0b200 0x55c9fcf23dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f4ffbe00700 1 -- 172.21.15.82:0/3700041211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9fcf24490 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f5003400700 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf05500 0x55c9fcf28e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f4ffbe00700 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf29360 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0b1180 tx=0x7f4fec0aa180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6f24d735fec4f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f4ff1600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f4ff1600700 1 -- 172.21.15.82:0/3700041211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec089060 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f4ff1600700 1 -- 172.21.15.82:0/3700041211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f4fec0a9b70 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.034+0000 7f5014fb4b80 1 -- 172.21.15.82:0/3700041211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fec0c4070 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.035+0000 7f4ff1600700 1 -- 172.21.15.82:0/3700041211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4fec090050 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.035+0000 7f5014fb4b80 10 client.15261 fetch_fsmap learned FSMap version 29 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.035+0000 7f5014fb4b80 1 -- 172.21.15.82:0/3700041211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c9fcf24490 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.035+0000 7f4ff1600700 1 -- 172.21.15.82:0/3700041211 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fec0c4070 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.035+0000 7f4ff1600700 1 -- 172.21.15.82:0/3700041211 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4fec0a6070 con 0x55c9fcf0a8e0 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.035+0000 7f5014fb4b80 10 client.15261 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.035+0000 7f5014fb4b80 10 client.15261 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T22:18:06.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.035+0000 7f5014fb4b80 20 client.15261 populate_metadata read hostname 'smithi082' 2024-05-03T22:18:06.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.035+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x55c9fcf8e7a0 0x55c9fcf8d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:06.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.035+0000 7f5014fb4b80 4 client.15261 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:18:06.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.035+0000 7f5014fb4b80 1 -- 172.21.15.82:0/3700041211 --> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] -- command(tid 0: {"prefix": "status"}) -- 0x55c9fce653b0 con 0x55c9fcf8e7a0 2024-05-03T22:18:06.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.036+0000 7f5003400700 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x55c9fcf8e7a0 0x55c9fcf8d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:06.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.037+0000 7f5003400700 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x55c9fcf8e7a0 0x55c9fcf8d4b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a59b1a32bd402128 server_cookie=b9c6c13768560c4b in_seq=0 out_seq=0 2024-05-03T22:18:06.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.037+0000 7f4ff1600700 10 client.15261 ms_handle_connect on v2:172.21.15.116:6836/2428901446 2024-05-03T22:18:06.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.037+0000 7f4ff1600700 1 -- 172.21.15.82:0/3700041211 <== mds.1 v2:172.21.15.116:6836/2428901446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c9fce653b0 con 0x55c9fcf8e7a0 2024-05-03T22:18:06.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.037+0000 7f4ff1600700 10 client.15261 handle_command_reply: tid=0 2024-05-03T22:18:06.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.037+0000 7f5014fb4b80 1 client.15261 shutdown 2024-05-03T22:18:06.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f5014fb4b80 1 -- 172.21.15.82:0/3700041211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 msgr2=0x55c9fcf29360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:06.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf29360 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0b1180 tx=0x7f4fec0aa180 comp rx=0 tx=0).stop 2024-05-03T22:18:06.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f5014fb4b80 1 -- 172.21.15.82:0/3700041211 shutdown_connections 2024-05-03T22:18:06.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.116:6836/2428901446,v1:172.21.15.116:6837/2428901446] conn(0x55c9fcf8e7a0 0x55c9fcf8d4b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9fcf0b200 0x55c9fcf23dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9fcf05500 0x55c9fcf28e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f5014fb4b80 1 --2- 172.21.15.82:0/3700041211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c9fcf0a8e0 0x55c9fcf29360 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f5014fb4b80 1 -- 172.21.15.82:0/3700041211 >> 172.21.15.82:0/3700041211 conn(0x55c9fce7d680 msgr2=0x55c9fcf0cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:06.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f4ff1600700 0 client.15261 ms_handle_reset on v2:172.21.15.116:6836/2428901446 2024-05-03T22:18:06.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f5014fb4b80 1 -- 172.21.15.82:0/3700041211 shutdown_connections 2024-05-03T22:18:06.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f5014fb4b80 1 -- 172.21.15.82:0/3700041211 wait complete. 2024-05-03T22:18:06.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.038+0000 7f5014fb4b80 20 client.15261 trim_cache size 0 max 16384 2024-05-03T22:18:06.042 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:18:06.042 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:18:06.042 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-05-03T22:18:06.042 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 34433, 2024-05-03T22:18:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-03T22:18:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-03T22:18:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-03T22:18:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 243.97516619300001, 2024-05-03T22:18:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 29, 2024-05-03T22:18:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-05-03T22:18:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-05-03T22:18:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 367.63336946300001 2024-05-03T22:18:06.043 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 -- 172.21.15.82:0/3032049228 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4fe80b2910 msgr2=0x7f4fe80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4fe80b2910 0x7f4fe80b4dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0094f0 tx=0x7f4ffc0079a0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 -- 172.21.15.82:0/3032049228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5004104100 msgr2=0x7f500419fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5004104100 0x7f500419fc30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4fec005f50 tx=0x7f4fec00f460 comp rx=0 tx=0).stop 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 -- 172.21.15.82:0/3032049228 shutdown_connections 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f4fe80b2910 0x7f4fe80b4dd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5004108850 0x7f5004199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5004103750 0x7f500419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 --2- 172.21.15.82:0/3032049228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5004104100 0x7f500419fc30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 -- 172.21.15.82:0/3032049228 >> 172.21.15.82:0/3032049228 conn(0x7f500407a600 msgr2=0x7f5004101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 -- 172.21.15.82:0/3032049228 shutdown_connections 2024-05-03T22:18:06.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:06.039+0000 7f500a600700 1 -- 172.21.15.82:0/3032049228 wait complete. 2024-05-03T22:18:06.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:05 smithi116 ceph-mon[31828]: pgmap v546: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:06.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:05 smithi082 ceph-mon[28404]: pgmap v546: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:06.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:05 smithi130 ceph-mon[32417]: pgmap v546: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:07.177 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-03T22:18:07.627 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:18:08.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:07 smithi082 ceph-mon[28404]: pgmap v547: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:18:08.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:07 smithi116 ceph-mon[31828]: pgmap v547: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:18:08.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:07 smithi130 ceph-mon[32417]: pgmap v547: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:18:10.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:09 smithi082 ceph-mon[28404]: pgmap v548: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:10.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:09 smithi116 ceph-mon[31828]: pgmap v548: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:10.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.171+0000 7fe7dda00700 1 -- 172.21.15.82:0/3898554434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7d8109520 msgr2=0x7fe7d8109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:10.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.171+0000 7fe7dda00700 1 --2- 172.21.15.82:0/3898554434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7d8109520 0x7fe7d8109900 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009990 tx=0x7fe7c8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.171+0000 7fe7dda00700 1 -- 172.21.15.82:0/3898554434 shutdown_connections 2024-05-03T22:18:10.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.171+0000 7fe7dda00700 1 --2- 172.21.15.82:0/3898554434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7d8109520 0x7fe7d8109900 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.171+0000 7fe7dda00700 1 --2- 172.21.15.82:0/3898554434 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7d8102450 0x7fe7d8110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.171+0000 7fe7dda00700 1 --2- 172.21.15.82:0/3898554434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d8101a90 0x7fe7d8101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.171+0000 7fe7dda00700 1 -- 172.21.15.82:0/3898554434 >> 172.21.15.82:0/3898554434 conn(0x7fe7d8078a10 msgr2=0x7fe7d80ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.171+0000 7fe7dda00700 1 -- 172.21.15.82:0/3898554434 shutdown_connections 2024-05-03T22:18:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.172+0000 7fe7dda00700 1 -- 172.21.15.82:0/3898554434 wait complete. 2024-05-03T22:18:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.173+0000 7fe7dda00700 1 Processor -- start 2024-05-03T22:18:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.174+0000 7fe7dda00700 1 -- start start 2024-05-03T22:18:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.174+0000 7fe7dda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7d8101a90 0x7fe7d819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.174+0000 7fe7dda00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d8102450 0x7fe7d819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.174+0000 7fe7dda00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7d8109520 0x7fe7d8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.174+0000 7fe7dda00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d81134e0 con 0x7fe7d8101a90 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.174+0000 7fe7dda00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8113360 con 0x7fe7d8109520 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.174+0000 7fe7dda00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8113660 con 0x7fe7d8102450 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.174+0000 7fe7d6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7d8101a90 0x7fe7d819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.174+0000 7fe7d6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7d8101a90 0x7fe7d819f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53770/0 (socket says 172.21.15.82:53770) 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.175+0000 7fe7d6a00700 1 -- 172.21.15.82:0/2523345079 learned_addr learned my addr 172.21.15.82:0/2523345079 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.175+0000 7fe7d6000700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d8102450 0x7fe7d819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.175+0000 7fe7d7400700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7d8109520 0x7fe7d8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.175+0000 7fe7d6a00700 1 -- 172.21.15.82:0/2523345079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d8102450 msgr2=0x7fe7d819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.175+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d8102450 0x7fe7d819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.175+0000 7fe7d6a00700 1 -- 172.21.15.82:0/2523345079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7d8109520 msgr2=0x7fe7d8199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.175+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7d8109520 0x7fe7d8199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.175+0000 7fe7d6a00700 1 -- 172.21.15.82:0/2523345079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d819a020 con 0x7fe7d8101a90 2024-05-03T22:18:10.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.175+0000 7fe7d6000700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d8102450 0x7fe7d819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:18:10.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.175+0000 7fe7d7400700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7d8109520 0x7fe7d8199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:18:10.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.175+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7d8101a90 0x7fe7d819f6c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80057f0 tx=0x7fe7c8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:10.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.176+0000 7fe7cf400700 1 -- 172.21.15.82:0/2523345079 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8027070 con 0x7fe7d8101a90 2024-05-03T22:18:10.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.176+0000 7fe7cf400700 1 -- 172.21.15.82:0/2523345079 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7c800fd60 con 0x7fe7d8101a90 2024-05-03T22:18:10.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.176+0000 7fe7dda00700 1 -- 172.21.15.82:0/2523345079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d819a2b0 con 0x7fe7d8101a90 2024-05-03T22:18:10.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.176+0000 7fe7cf400700 1 -- 172.21.15.82:0/2523345079 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8022d70 con 0x7fe7d8101a90 2024-05-03T22:18:10.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.176+0000 7fe7dda00700 1 -- 172.21.15.82:0/2523345079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d81a6520 con 0x7fe7d8101a90 2024-05-03T22:18:10.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.180+0000 7fe7cf400700 1 -- 172.21.15.82:0/2523345079 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe7c802a070 con 0x7fe7d8101a90 2024-05-03T22:18:10.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.181+0000 7fe7e83c8b80 1 Processor -- start 2024-05-03T22:18:10.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.181+0000 7fe7e83c8b80 1 -- start start 2024-05-03T22:18:10.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.181+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.181+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a2080 0x555c9899cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.181+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c9899d580 0x555c9899d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.181+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555c988ef9d0 con 0x555c989a2080 2024-05-03T22:18:10.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.181+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c9888d710 con 0x555c9899d580 2024-05-03T22:18:10.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.181+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555c988eb990 con 0x555c989a1760 2024-05-03T22:18:10.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7d6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a2080 0x555c9899cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7d6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a2080 0x555c9899cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53784/0 (socket says 172.21.15.82:53784) 2024-05-03T22:18:10.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7d6a00700 1 -- 172.21.15.82:0/1497397391 learned_addr learned my addr 172.21.15.82:0/1497397391 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:10.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7cf400700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe7bc0b2990 0x7fe7bc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7d6000700 1 --2- 172.21.15.82:0/1497397391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c9899d580 0x555c9899d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7d7400700 1 --2- 172.21.15.82:0/1497397391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7cf400700 1 -- 172.21.15.82:0/2523345079 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fe7c80e3780 con 0x7fe7d8101a90 2024-05-03T22:18:10.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7d7400700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe7bc0b2990 0x7fe7bc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7d6a00700 1 -- 172.21.15.82:0/1497397391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 msgr2=0x555c989a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:10.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/1497397391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7d6a00700 1 -- 172.21.15.82:0/1497397391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c9899d580 msgr2=0x555c9899d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:10.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/1497397391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c9899d580 0x555c9899d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.182+0000 7fe7d6a00700 1 -- 172.21.15.82:0/1497397391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c9883c880 con 0x555c989a2080 2024-05-03T22:18:10.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.183+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/1497397391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a2080 0x555c9899cf60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80a7b20 tx=0x7fe7c800ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c68fee110cad66 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.183+0000 7fe7c3e00700 1 -- 172.21.15.82:0/1497397391 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c80aa020 con 0x555c989a2080 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.183+0000 7fe7c3e00700 1 -- 172.21.15.82:0/1497397391 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7c80aa3c0 con 0x555c989a2080 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.183+0000 7fe7c3e00700 1 -- 172.21.15.82:0/1497397391 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c80aec60 con 0x555c989a2080 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.184+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1497397391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a2080 msgr2=0x555c9899cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.184+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/1497397391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a2080 0x555c9899cf60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80a7b20 tx=0x7fe7c800ff10 comp rx=0 tx=0).stop 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.184+0000 7fe7d7400700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe7bc0b2990 0x7fe7bc0b4e50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0012440 tx=0x7fe7d00060d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.184+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1497397391 shutdown_connections 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.184+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/1497397391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c9899d580 0x555c9899d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.184+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/1497397391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.184+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/1497397391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a2080 0x555c9899cf60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.184+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1497397391 >> 172.21.15.82:0/1497397391 conn(0x555c988cbb10 msgr2=0x555c989977a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.184+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1497397391 shutdown_connections 2024-05-03T22:18:10.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.184+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1497397391 wait complete. 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.184+0000 7fe7e83c8b80 1 -- start start 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.185+0000 7fe7e83c8b80 1 Processor -- start 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.185+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.185+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.185+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c989a2080 0x555c989a6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.185+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555c989a9a10 con 0x555c9899d580 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.185+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c98855ad0 con 0x555c989a2080 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.185+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555c989a9b90 con 0x555c989a1760 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.185+0000 7fe7e83c8b80 10 client.0 _ll_register_callbacks cb 0x555c98896c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.185+0000 7fe7d6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989a8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53798/0 (socket says 172.21.15.82:53798) 2024-05-03T22:18:10.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d6a00700 1 -- 172.21.15.82:0/686660525 learned_addr learned my addr 172.21.15.82:0/686660525 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:10.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d6000700 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d6a00700 1 -- 172.21.15.82:0/686660525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 msgr2=0x555c989a6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:10.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d6a00700 1 -- 172.21.15.82:0/686660525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c989a2080 msgr2=0x555c989a6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:10.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d7400700 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c989a2080 0x555c989a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c989a2080 0x555c989a6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d6a00700 1 -- 172.21.15.82:0/686660525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c988b53d0 con 0x555c9899d580 2024-05-03T22:18:10.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d6000700 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:18:10.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d7400700 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c989a2080 0x555c989a6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:18:10.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989a8db0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8005cb0 tx=0x7fe7c8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c457b2a1a24dcd server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:10.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7c0c00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:18:10.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.186+0000 7fe7c0c00700 1 -- 172.21.15.82:0/686660525 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c80aa020 con 0x555c9899d580 2024-05-03T22:18:10.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7c0c00700 1 -- 172.21.15.82:0/686660525 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fe7c80b31f0 con 0x555c9899d580 2024-05-03T22:18:10.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/686660525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7c80aa3c0 con 0x555c9899d580 2024-05-03T22:18:10.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7c0c00700 1 -- 172.21.15.82:0/686660525 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe7c80aafb0 con 0x555c9899d580 2024-05-03T22:18:10.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7e83c8b80 10 client.15273 fetch_fsmap learned FSMap version 29 2024-05-03T22:18:10.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/686660525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c989a9a10 con 0x555c9899d580 2024-05-03T22:18:10.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7c0c00700 1 -- 172.21.15.82:0/686660525 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7c80aa3c0 con 0x555c9899d580 2024-05-03T22:18:10.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7c0c00700 1 -- 172.21.15.82:0/686660525 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe7c80e6ce0 con 0x555c9899d580 2024-05-03T22:18:10.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7e83c8b80 10 client.15273 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:18:10.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7e83c8b80 10 client.15273 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:18:10.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7e83c8b80 20 client.15273 populate_metadata read hostname 'smithi082' 2024-05-03T22:18:10.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x555c989b6440 0x555c989b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7e83c8b80 4 client.15273 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:18:10.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.187+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/686660525 --> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c9896a180 con 0x555c989b6440 2024-05-03T22:18:10.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.188+0000 7fe7d6000700 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x555c989b6440 0x555c989b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.189+0000 7fe7d6000700 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x555c989b6440 0x555c989b78b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1127531b14e52a0d server_cookie=b7eeb549d1c80f40 in_seq=0 out_seq=0 2024-05-03T22:18:10.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.189+0000 7fe7c0c00700 10 client.15273 ms_handle_connect on v2:172.21.15.116:6838/3254019270 2024-05-03T22:18:10.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.191+0000 7fe7c0c00700 1 -- 172.21.15.82:0/686660525 <== mds.0 v2:172.21.15.116:6838/3254019270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555c9896a180 con 0x555c989b6440 2024-05-03T22:18:10.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.191+0000 7fe7c0c00700 10 client.15273 handle_command_reply: tid=0 2024-05-03T22:18:10.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.191+0000 7fe7e83c8b80 1 client.15273 shutdown 2024-05-03T22:18:10.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.192+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/686660525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 msgr2=0x555c989a8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:10.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.192+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989a8db0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8005cb0 tx=0x7fe7c8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.192+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/686660525 shutdown_connections 2024-05-03T22:18:10.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.192+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x555c989b6440 0x555c989b78b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.192+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989a8db0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.192+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c989a2080 0x555c989a6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.192+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/686660525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.192+0000 7fe7c0c00700 0 client.15273 ms_handle_reset on v2:172.21.15.116:6838/3254019270 2024-05-03T22:18:10.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.192+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/686660525 >> 172.21.15.82:0/686660525 conn(0x555c988cbb10 msgr2=0x555c989a2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:10.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.192+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/686660525 shutdown_connections 2024-05-03T22:18:10.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.192+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/686660525 wait complete. 2024-05-03T22:18:10.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.193+0000 7fe7e83c8b80 20 client.15273 trim_cache size 0 max 16384 2024-05-03T22:18:10.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.217+0000 7fe7e83c8b80 1 Processor -- start 2024-05-03T22:18:10.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.217+0000 7fe7e83c8b80 1 -- start start 2024-05-03T22:18:10.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.218+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c9899d580 0x555c98996d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.218+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a1760 0x555c9899af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.218+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a2080 0x555c9899b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.218+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555c989b5bf0 con 0x555c989a1760 2024-05-03T22:18:10.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.218+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c989b62c0 con 0x555c9899d580 2024-05-03T22:18:10.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.218+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555c989b6990 con 0x555c989a2080 2024-05-03T22:18:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.218+0000 7fe7d6000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a1760 0x555c9899af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.218+0000 7fe7d6000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a1760 0x555c9899af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53814/0 (socket says 172.21.15.82:53814) 2024-05-03T22:18:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.218+0000 7fe7d6000700 1 -- 172.21.15.82:0/3753020454 learned_addr learned my addr 172.21.15.82:0/3753020454 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.218+0000 7fe7d7400700 1 --2- 172.21.15.82:0/3753020454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a2080 0x555c9899b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.218+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/3753020454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c9899d580 0x555c98996d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.219+0000 7fe7d6000700 1 -- 172.21.15.82:0/3753020454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a2080 msgr2=0x555c9899b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.219+0000 7fe7d6000700 1 --2- 172.21.15.82:0/3753020454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a2080 0x555c9899b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.219+0000 7fe7d6000700 1 -- 172.21.15.82:0/3753020454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c9899d580 msgr2=0x555c98996d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.219+0000 7fe7d6000700 1 --2- 172.21.15.82:0/3753020454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c9899d580 0x555c98996d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.219+0000 7fe7d6000700 1 -- 172.21.15.82:0/3753020454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c989a13b0 con 0x555c989a1760 2024-05-03T22:18:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.219+0000 7fe7d7400700 1 --2- 172.21.15.82:0/3753020454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a2080 0x555c9899b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:18:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.219+0000 7fe7d6000700 1 --2- 172.21.15.82:0/3753020454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a1760 0x555c9899af50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4005950 tx=0x7fe7c4005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be4ddd0adab7646 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.219+0000 7fe7c3400700 1 -- 172.21.15.82:0/3753020454 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c401a5f0 con 0x555c989a1760 2024-05-03T22:18:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.219+0000 7fe7c3400700 1 -- 172.21.15.82:0/3753020454 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7c4010430 con 0x555c989a1760 2024-05-03T22:18:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.219+0000 7fe7c3400700 1 -- 172.21.15.82:0/3753020454 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c400d630 con 0x555c989a1760 2024-05-03T22:18:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.220+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/3753020454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a1760 msgr2=0x555c9899af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:10.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.220+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/3753020454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a1760 0x555c9899af50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4005950 tx=0x7fe7c4005f50 comp rx=0 tx=0).stop 2024-05-03T22:18:10.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.220+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/3753020454 shutdown_connections 2024-05-03T22:18:10.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.220+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/3753020454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a2080 0x555c9899b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.220+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/3753020454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c9899d580 0x555c98996d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.220+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/3753020454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c989a1760 0x555c9899af50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.220+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/3753020454 >> 172.21.15.82:0/3753020454 conn(0x555c988cbb10 msgr2=0x555c98996600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:10.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.220+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/3753020454 shutdown_connections 2024-05-03T22:18:10.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.220+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/3753020454 wait complete. 2024-05-03T22:18:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.221+0000 7fe7e83c8b80 1 -- start start 2024-05-03T22:18:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.221+0000 7fe7e83c8b80 1 Processor -- start 2024-05-03T22:18:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.221+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.221+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7e83c8b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c989a2080 0x555c989a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555c989b7730 con 0x555c9899d580 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c989b7060 con 0x555c989a2080 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7e83c8b80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555c989b7e00 con 0x555c989a1760 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7e83c8b80 10 client.0 _ll_register_callbacks cb 0x555c98896c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7d6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7d6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53830/0 (socket says 172.21.15.82:53830) 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7d6a00700 1 -- 172.21.15.82:0/1751461787 learned_addr learned my addr 172.21.15.82:0/1751461787 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7d6000700 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7d6a00700 1 -- 172.21.15.82:0/1751461787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 msgr2=0x555c989a3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7d6a00700 1 -- 172.21.15.82:0/1751461787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c989a2080 msgr2=0x555c989a3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c989a2080 0x555c989a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7d6a00700 1 -- 172.21.15.82:0/1751461787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c989a4040 con 0x555c9899d580 2024-05-03T22:18:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.222+0000 7fe7d6a00700 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989c0fa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80cd2f0 tx=0x7fe7c8022470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b4a5ee6f2417fa server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:10.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.223+0000 7fe7c0c00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-03T22:18:10.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.223+0000 7fe7c0c00700 1 -- 172.21.15.82:0/1751461787 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c80aa020 con 0x555c9899d580 2024-05-03T22:18:10.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.223+0000 7fe7c0c00700 1 -- 172.21.15.82:0/1751461787 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fe7c80abdf0 con 0x555c9899d580 2024-05-03T22:18:10.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.223+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1751461787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7c4010430 con 0x555c9899d580 2024-05-03T22:18:10.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.223+0000 7fe7c0c00700 1 -- 172.21.15.82:0/1751461787 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe7c8005110 con 0x555c9899d580 2024-05-03T22:18:10.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.223+0000 7fe7e83c8b80 10 client.15279 fetch_fsmap learned FSMap version 29 2024-05-03T22:18:10.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.223+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1751461787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c989a4040 con 0x555c9899d580 2024-05-03T22:18:10.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.223+0000 7fe7c0c00700 1 -- 172.21.15.82:0/1751461787 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7c4010430 con 0x555c9899d580 2024-05-03T22:18:10.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.223+0000 7fe7c0c00700 1 -- 172.21.15.82:0/1751461787 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe7c80b31f0 con 0x555c9899d580 2024-05-03T22:18:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.224+0000 7fe7e83c8b80 10 client.15279 fetch_fsmap finished waiting for FSMap version 29 2024-05-03T22:18:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.224+0000 7fe7e83c8b80 10 client.15279 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:18:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.224+0000 7fe7e83c8b80 20 client.15279 populate_metadata read hostname 'smithi082' 2024-05-03T22:18:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.224+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x555c98a27080 0x555c98a25d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.224+0000 7fe7e83c8b80 4 client.15279 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:18:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.224+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1751461787 --> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] -- command(tid 0: {"prefix": "status"}) -- 0x555c988fd3b0 con 0x555c98a27080 2024-05-03T22:18:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.224+0000 7fe7d6000700 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x555c98a27080 0x555c98a25d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.225+0000 7fe7d6000700 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x555c98a27080 0x555c98a25d90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=214e4f853354b0e8 server_cookie=30e50ebfd8c338f4 in_seq=0 out_seq=0 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.225+0000 7fe7c0c00700 10 client.15279 ms_handle_connect on v2:172.21.15.116:6838/3254019270 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7c0c00700 1 -- 172.21.15.82:0/1751461787 <== mds.0 v2:172.21.15.116:6838/3254019270 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555c988fd3b0 con 0x555c98a27080 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7c0c00700 10 client.15279 handle_command_reply: tid=0 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 1 client.15279 shutdown 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1751461787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 msgr2=0x555c989c0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989c0fa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80cd2f0 tx=0x7fe7c8022470 comp rx=0 tx=0).stop 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1751461787 shutdown_connections 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.116:6838/3254019270,v1:172.21.15.116:6839/3254019270] conn(0x555c98a27080 0x555c98a25d90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c9899d580 0x555c989c0fa0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c989a2080 0x555c989a3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 1 --2- 172.21.15.82:0/1751461787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c989a1760 0x555c989a3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7c0c00700 0 client.15279 ms_handle_reset on v2:172.21.15.116:6838/3254019270 2024-05-03T22:18:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1751461787 >> 172.21.15.82:0/1751461787 conn(0x555c988cbb10 msgr2=0x555c989a0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:10.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1751461787 shutdown_connections 2024-05-03T22:18:10.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 1 -- 172.21.15.82:0/1751461787 wait complete. 2024-05-03T22:18:10.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.226+0000 7fe7e83c8b80 20 client.15279 trim_cache size 0 max 16384 2024-05-03T22:18:10.235 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:18:10.235 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "81cd0262-0998-11ef-bc97-c7b262605968", 2024-05-03T22:18:10.235 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-05-03T22:18:10.235 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 34460, 2024-05-03T22:18:10.235 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-03T22:18:10.235 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-03T22:18:10.235 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-03T22:18:10.235 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 330.18796166700002, 2024-05-03T22:18:10.236 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 29, 2024-05-03T22:18:10.236 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 92, 2024-05-03T22:18:10.236 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 90, 2024-05-03T22:18:10.236 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 353.50317046200001 2024-05-03T22:18:10.236 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:18:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 -- 172.21.15.82:0/2523345079 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe7bc0b2990 msgr2=0x7fe7bc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe7bc0b2990 0x7fe7bc0b4e50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0012440 tx=0x7fe7d00060d0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 -- 172.21.15.82:0/2523345079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7d8101a90 msgr2=0x7fe7d819f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7d8101a90 0x7fe7d819f6c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80057f0 tx=0x7fe7c8009f90 comp rx=0 tx=0).stop 2024-05-03T22:18:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 -- 172.21.15.82:0/2523345079 shutdown_connections 2024-05-03T22:18:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe7bc0b2990 0x7fe7bc0b4e50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7d8101a90 0x7fe7d819f6c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7d8109520 0x7fe7d8199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 --2- 172.21.15.82:0/2523345079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7d8102450 0x7fe7d819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 -- 172.21.15.82:0/2523345079 >> 172.21.15.82:0/2523345079 conn(0x7fe7d8078a10 msgr2=0x7fe7d8100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 -- 172.21.15.82:0/2523345079 shutdown_connections 2024-05-03T22:18:10.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:10.227+0000 7fe7dda00700 1 -- 172.21.15.82:0/2523345079 wait complete. 2024-05-03T22:18:10.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:09 smithi130 ceph-mon[32417]: pgmap v548: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:11.285 INFO:teuthology.run_tasks:Running task sequential... 2024-05-03T22:18:11.295 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-03T22:18:11.296 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-03T22:18:11.296 INFO:teuthology.task.print:Enabling mgr modules 2024-05-03T22:18:11.296 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-03T22:18:11.305 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-03T22:18:11.306 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-03T22:18:11.306 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-05-03T22:18:11.306 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-03T22:18:11.306 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-03T22:18:11.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:11.306 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-03T22:18:11.365 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-03T22:18:11.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:11.367 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:18:11.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:11.457 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-03T22:18:11.567 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-03T22:18:11.568 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-03T22:18:11.977 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:18:12.153 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:11 smithi082 ceph-mon[28404]: pgmap v549: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:12.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:11 smithi116 ceph-mon[31828]: pgmap v549: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:12.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:11 smithi130 ceph-mon[32417]: pgmap v549: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:14.160 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:13 smithi082 ceph-mon[28404]: pgmap v550: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:14.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:13 smithi116 ceph-mon[31828]: pgmap v550: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:14.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:13 smithi130 ceph-mon[32417]: pgmap v550: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.499+0000 7f50ef000700 1 -- 172.21.15.82:0/2820976649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e81033d0 msgr2=0x7f50e8103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.499+0000 7f50ef000700 1 --2- 172.21.15.82:0/2820976649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e81033d0 0x7f50e8103850 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009990 tx=0x7f50d4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.499+0000 7f50ef000700 1 -- 172.21.15.82:0/2820976649 shutdown_connections 2024-05-03T22:18:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.499+0000 7f50ef000700 1 --2- 172.21.15.82:0/2820976649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50e8103d90 0x7f50e81102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.499+0000 7f50ef000700 1 --2- 172.21.15.82:0/2820976649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50e8109460 0x7f50e8109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.499+0000 7f50ef000700 1 --2- 172.21.15.82:0/2820976649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e81033d0 0x7f50e8103850 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.499+0000 7f50ef000700 1 -- 172.21.15.82:0/2820976649 >> 172.21.15.82:0/2820976649 conn(0x7f50e80fef20 msgr2=0x7f50e8101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:14.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.499+0000 7f50ef000700 1 -- 172.21.15.82:0/2820976649 shutdown_connections 2024-05-03T22:18:14.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.499+0000 7f50ef000700 1 -- 172.21.15.82:0/2820976649 wait complete. 2024-05-03T22:18:14.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.500+0000 7f50ef000700 1 Processor -- start 2024-05-03T22:18:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.501+0000 7f50ef000700 1 -- start start 2024-05-03T22:18:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.501+0000 7f50ef000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50e81033d0 0x7f50e81a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.501+0000 7f50ef000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e8103d90 0x7f50e81a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.501+0000 7f50ef000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50e8109460 0x7f50e819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.501+0000 7f50ef000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50e8113470 con 0x7f50e8103d90 2024-05-03T22:18:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.501+0000 7f50ef000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f50e81132f0 con 0x7f50e8109460 2024-05-03T22:18:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.501+0000 7f50ef000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50e81135f0 con 0x7f50e81033d0 2024-05-03T22:18:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.502+0000 7f50ed200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e8103d90 0x7f50e81a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.502+0000 7f50ed200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e8103d90 0x7f50e81a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55966/0 (socket says 172.21.15.82:55966) 2024-05-03T22:18:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.502+0000 7f50ed200700 1 -- 172.21.15.82:0/989241814 learned_addr learned my addr 172.21.15.82:0/989241814 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.502+0000 7f50edc00700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50e81033d0 0x7f50e81a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.502+0000 7f50ee600700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50e8109460 0x7f50e819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.502+0000 7f50ed200700 1 -- 172.21.15.82:0/989241814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50e81033d0 msgr2=0x7f50e81a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.502+0000 7f50ed200700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50e81033d0 0x7f50e81a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.502+0000 7f50ed200700 1 -- 172.21.15.82:0/989241814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50e8109460 msgr2=0x7f50e819ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.502+0000 7f50ed200700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50e8109460 0x7f50e819ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.502+0000 7f50ed200700 1 -- 172.21.15.82:0/989241814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e819c170 con 0x7f50e8103d90 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.503+0000 7f50ed200700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e8103d90 0x7f50e81a1d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f50d4000c00 tx=0x7f50d4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.503+0000 7f50e6000700 1 -- 172.21.15.82:0/989241814 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4027070 con 0x7f50e8103d90 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.503+0000 7f50e6000700 1 -- 172.21.15.82:0/989241814 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f50d400fb80 con 0x7f50e8103d90 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.503+0000 7f50ef000700 1 -- 172.21.15.82:0/989241814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e819c400 con 0x7f50e8103d90 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.503+0000 7f50e6000700 1 -- 172.21.15.82:0/989241814 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4022c30 con 0x7f50e8103d90 2024-05-03T22:18:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.503+0000 7f50ef000700 1 -- 172.21.15.82:0/989241814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e81a8720 con 0x7f50e8103d90 2024-05-03T22:18:14.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.504+0000 7f50ef000700 1 -- 172.21.15.82:0/989241814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e806a190 con 0x7f50e8103d90 2024-05-03T22:18:14.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.506+0000 7f50e6000700 1 -- 172.21.15.82:0/989241814 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f50d402a070 con 0x7f50e8103d90 2024-05-03T22:18:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.508+0000 7f50e6000700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50d00b2910 0x7f50d00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.508+0000 7f50e6000700 1 -- 172.21.15.82:0/989241814 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f50d40e3720 con 0x7f50e8103d90 2024-05-03T22:18:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.508+0000 7f50edc00700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50d00b2910 0x7f50d00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.509+0000 7f50edc00700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50d00b2910 0x7f50d00b4dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50e819cb50 tx=0x7f50dc00b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.513+0000 7f50e6000700 1 -- 172.21.15.82:0/989241814 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f50d4013070 con 0x7f50e8103d90 2024-05-03T22:18:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.794+0000 7f50ef000700 1 -- 172.21.15.82:0/989241814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f50e81a88f0 con 0x7f50e8103d90 2024-05-03T22:18:14.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.795+0000 7f50e6000700 1 -- 172.21.15.82:0/989241814 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+88 (secure 0 0 0) 0x7f50d40aaf50 con 0x7f50e8103d90 2024-05-03T22:18:14.797 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-03T22:18:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.798+0000 7f50ef000700 1 -- 172.21.15.82:0/989241814 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50d00b2910 msgr2=0x7f50d00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.798+0000 7f50ef000700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50d00b2910 0x7f50d00b4dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50e819cb50 tx=0x7f50dc00b5b0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.798+0000 7f50ef000700 1 -- 172.21.15.82:0/989241814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e8103d90 msgr2=0x7f50e81a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.798+0000 7f50ef000700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e8103d90 0x7f50e81a1d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f50d4000c00 tx=0x7f50d4005ef0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.799+0000 7f50ef000700 1 -- 172.21.15.82:0/989241814 shutdown_connections 2024-05-03T22:18:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.799+0000 7f50ef000700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f50d00b2910 0x7f50d00b4dd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.799+0000 7f50ef000700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50e8109460 0x7f50e819ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.799+0000 7f50ef000700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50e81033d0 0x7f50e81a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.799+0000 7f50ef000700 1 --2- 172.21.15.82:0/989241814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50e8103d90 0x7f50e81a1d90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.799+0000 7f50ef000700 1 -- 172.21.15.82:0/989241814 >> 172.21.15.82:0/989241814 conn(0x7f50e80fef20 msgr2=0x7f50e810eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.799+0000 7f50ef000700 1 -- 172.21.15.82:0/989241814 shutdown_connections 2024-05-03T22:18:14.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:14.799+0000 7f50ef000700 1 -- 172.21.15.82:0/989241814 wait complete. 2024-05-03T22:18:15.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:14 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/989241814' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:18:15.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:14 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/989241814' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:18:15.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:14 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/989241814' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:18:16.070 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:15 smithi082 ceph-mon[28404]: pgmap v551: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:16.072 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-03T22:18:16.073 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-03T22:18:16.073 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-05-03T22:18:16.073 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-03T22:18:16.073 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-03T22:18:16.073 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-03T22:18:16.073 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-03T22:18:16.073 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-03T22:18:16.073 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-03T22:18:16.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:16.073 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-05-03T22:18:16.128 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-03T22:18:16.128 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-03T22:18:16.128 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-03T22:18:16.128 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:18:16.129 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-03T22:18:16.129 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:18:16.129 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:18:16.129 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-05-03T22:18:16.129 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-05-03T22:18:16.129 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:18:16.129 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-05-03T22:18:16.129 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-05-03T22:18:16.129 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:18:16.129 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-05-03T22:18:16.130 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-03T22:18:16.130 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-05-03T22:18:16.130 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-03T22:18:16.130 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41648sec preferred_lft 41648sec 2024-05-03T22:18:16.130 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-05-03T22:18:16.130 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:18:16.132 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-03T22:18:16.132 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:18:16.132 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-03T22:18:16.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-05-03T22:18:16.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-05-03T22:18:16.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-05-03T22:18:16.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-03T22:18:16.133 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-03T22:18:16.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:15 smithi116 ceph-mon[31828]: pgmap v551: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:16.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:18:16.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:15 smithi130 ceph-mon[32417]: pgmap v551: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:16.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:18:16.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:16.382 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-03T22:18:16.447 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-05-03T22:18:16.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:16.451 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-05-03T22:18:16.496 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-05-03T22:18:16.496 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-03T22:18:16.496 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-03T22:18:16.496 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-03T22:18:16.496 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-03T22:18:16.496 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:18:16.497 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-03T22:18:16.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-03T22:18:16.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-03T22:18:16.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-03T22:18:16.497 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-03T22:18:16.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:18:16.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:18:16.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:16.753 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-03T22:18:16.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:16.804 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-05-03T22:18:16.853 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:18:16.853 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-03T22:18:16.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:18:16.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-03T22:18:16.853 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-03T22:18:16.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:18:17.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:18:17.033 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-03T22:18:17.034 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:18:17.034 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-03T22:18:17.034 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-03T22:18:17.034 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-03T22:18:17.034 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-03T22:18:17.034 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-03T22:18:17.034 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-03T22:18:17.034 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-03T22:18:17.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:18:17.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:18:17.316 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:18:17.317 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-03T22:18:17.317 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-05-03T22:18:17.317 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-05-03T22:18:17.317 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-03T22:18:17.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:18:17.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:18:17.521 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-05-03T22:18:17.521 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T22:18:17.521 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-03T22:18:17.563 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-03T22:18:17.563 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T22:18:17.563 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-03T22:18:17.655 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-05-03T22:18:17.739 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:18:17.795 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-05-03T22:18:17.795 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-05-03T22:18:17.795 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-05-03T22:18:17.795 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-05-03T22:18:17.795 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-05-03T22:18:17.796 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f12cee7f96b7f798451d140ad007c61d7ed639b7a5372fce3d6bd8f3ea83bf37/merged 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/2f6bf6b7d8fe7dbe7a83d377fb416b69a0d54666292249c14045907e7e6b7172/merged 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/861896c61d2f031631d8e293b5df3957eee0e08e1e4e297b69a116cb880b53ac/merged 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/4c44bb9710d86eeed12ad78f36375e0e7989f2e1c81405b1136d84006a300867/merged 2024-05-03T22:18:17.797 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/04f6a320f35eb1ac7e90fbc1919579de39160c7dedf0a68aa5d9b7dde22acb43/merged 2024-05-03T22:18:17.798 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/994e3dece91aede54b7238cd7a639d589b771513c1da466cb264b66175f0591a/merged 2024-05-03T22:18:17.798 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f5d203975eeab06eaecd53a2ddd536403a93407a61bc928c7c674ec107544ad1/merged 2024-05-03T22:18:17.798 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/53aa8f8114ca808a718332650d5f87a19b3036847a5a6531975627ca30fd5880/merged 2024-05-03T22:18:17.798 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5e6a503d3b44749713154d460a79097934ace2aa7ce440d7dcc18cc5174f60d2/merged 2024-05-03T22:18:17.798 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/79c5de15c7c6c3114fd78c68fb4f342d4f5964482363c58fafe69f4f95e2375d/merged 2024-05-03T22:18:17.798 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-05-03T22:18:17.798 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:18:17.798 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:18:17.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:17.799 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-05-03T22:18:17.850 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-03T22:18:17.850 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/c4c99729-4e2a-4a57-b93e-0d9fb77274d2 --client_fs=cephfs) 2024-05-03T22:18:17.856 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-05-03T22:18:17.927 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:18:17.969 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-05-03T22:18:17.969 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-05-03T22:18:17.970 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f12cee7f96b7f798451d140ad007c61d7ed639b7a5372fce3d6bd8f3ea83bf37/merged 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/2f6bf6b7d8fe7dbe7a83d377fb416b69a0d54666292249c14045907e7e6b7172/merged 2024-05-03T22:18:17.971 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/861896c61d2f031631d8e293b5df3957eee0e08e1e4e297b69a116cb880b53ac/merged 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/4c44bb9710d86eeed12ad78f36375e0e7989f2e1c81405b1136d84006a300867/merged 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/04f6a320f35eb1ac7e90fbc1919579de39160c7dedf0a68aa5d9b7dde22acb43/merged 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/994e3dece91aede54b7238cd7a639d589b771513c1da466cb264b66175f0591a/merged 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f5d203975eeab06eaecd53a2ddd536403a93407a61bc928c7c674ec107544ad1/merged 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/53aa8f8114ca808a718332650d5f87a19b3036847a5a6531975627ca30fd5880/merged 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5e6a503d3b44749713154d460a79097934ace2aa7ce440d7dcc18cc5174f60d2/merged 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/79c5de15c7c6c3114fd78c68fb4f342d4f5964482363c58fafe69f4f95e2375d/merged 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:18:17.972 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:18:17.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:17.973 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-05-03T22:18:18.031 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2024-05-03T22:18:18.030+0000 7fbdd4d1b480 -1 init, newargv = 0x55c4993e8230 newargc=15 2024-05-03T22:18:18.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[85900]: starting ceph client 2024-05-03T22:18:18.089 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[85900]: starting fuse 2024-05-03T22:18:18.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:17 smithi116 ceph-mon[31828]: pgmap v552: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:18:18.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:17 smithi082 ceph-mon[28404]: pgmap v552: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:18:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:17 smithi130 ceph-mon[32417]: pgmap v552: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:18:19.161 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-05-03T22:18:19.254 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:18:19.310 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-05-03T22:18:19.310 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-05-03T22:18:19.310 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-05-03T22:18:19.311 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-05-03T22:18:19.311 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-05-03T22:18:19.311 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-05-03T22:18:19.311 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-05-03T22:18:19.311 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-05-03T22:18:19.312 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-05-03T22:18:19.312 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-05-03T22:18:19.312 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-05-03T22:18:19.312 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-05-03T22:18:19.312 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:18:19.312 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-05-03T22:18:19.313 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-05-03T22:18:19.313 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-05-03T22:18:19.313 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-05-03T22:18:19.313 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-05-03T22:18:19.313 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-05-03T22:18:19.313 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:18:19.313 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:18:19.314 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:18:19.314 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:18:19.314 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-05-03T22:18:19.314 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-05-03T22:18:19.314 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:18:19.314 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f12cee7f96b7f798451d140ad007c61d7ed639b7a5372fce3d6bd8f3ea83bf37/merged 2024-05-03T22:18:19.315 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/2f6bf6b7d8fe7dbe7a83d377fb416b69a0d54666292249c14045907e7e6b7172/merged 2024-05-03T22:18:19.315 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-05-03T22:18:19.315 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:18:19.315 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/861896c61d2f031631d8e293b5df3957eee0e08e1e4e297b69a116cb880b53ac/merged 2024-05-03T22:18:19.315 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/4c44bb9710d86eeed12ad78f36375e0e7989f2e1c81405b1136d84006a300867/merged 2024-05-03T22:18:19.316 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/04f6a320f35eb1ac7e90fbc1919579de39160c7dedf0a68aa5d9b7dde22acb43/merged 2024-05-03T22:18:19.316 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/994e3dece91aede54b7238cd7a639d589b771513c1da466cb264b66175f0591a/merged 2024-05-03T22:18:19.316 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/f5d203975eeab06eaecd53a2ddd536403a93407a61bc928c7c674ec107544ad1/merged 2024-05-03T22:18:19.316 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/53aa8f8114ca808a718332650d5f87a19b3036847a5a6531975627ca30fd5880/merged 2024-05-03T22:18:19.316 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5e6a503d3b44749713154d460a79097934ace2aa7ce440d7dcc18cc5174f60d2/merged 2024-05-03T22:18:19.316 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/79c5de15c7c6c3114fd78c68fb4f342d4f5964482363c58fafe69f4f95e2375d/merged 2024-05-03T22:18:19.316 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-05-03T22:18:19.317 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:18:19.317 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:18:19.317 INFO:teuthology.orchestra.run.smithi082.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-03T22:18:19.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:19.319 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-05-03T22:18:19.374 INFO:teuthology.orchestra.run.smithi082.stdout:114 2024-05-03T22:18:19.374 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-05-03T22:18:19.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-05-03T22:18:19.374 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-05-03T22:18:19.374 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-05-03T22:18:19.374 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-05-03T22:18:19.374 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-03T22:18:19.375 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-03T22:18:19.376 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-05-03T22:18:19.376 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-05-03T22:18:19.376 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-05-03T22:18:19.376 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-03T22:18:19.376 DEBUG:teuthology.orchestra.run.smithi082:> 2024-05-03T22:18:19.376 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2024-05-03T22:18:19.376 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-05-03T22:18:19.538 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.85900.asok 2024-05-03T22:18:19.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:18:19.557 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85900.asok 2024-05-03T22:18:19.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:19.557 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85900.asok status 2024-05-03T22:18:19.784 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-03T22:18:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-05-03T22:18:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "9a047fe7599a549042d06a3fb5b6813a203eabea", 2024-05-03T22:18:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T22:18:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2024-05-03T22:18:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-05-03T22:18:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "85900", 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/volumes/qa/sv_0/c4c99729-4e2a-4a57-b93e-0d9fb77274d2" 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 15291, 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 15291 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-05-03T22:18:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2597085954 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2597085954 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.15291 192.168.0.1:0/2597085954", 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/2597085954", 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 5, 2024-05-03T22:18:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 29, 2024-05-03T22:18:19.787 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 92, 2024-05-03T22:18:19.787 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-05-03T22:18:19.787 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-05-03T22:18:19.787 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-05-03T22:18:19.787 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-03T22:18:19.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:19.799 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-05-03T22:18:19.799 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-03T22:18:19.850 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-05-03T22:18:19.850 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-03T22:18:19.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:18:19.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-03T22:18:19.929 INFO:teuthology.run_tasks:Running task exec... 2024-05-03T22:18:19.940 INFO:teuthology.task.exec:Executing custom commands... 2024-05-03T22:18:19.940 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-05-03T22:18:19.940 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-03T22:18:20.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.138+0000 7f2877e00640 1 -- 172.21.15.82:0/996797123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878108e60 msgr2=0x7f2878109280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.138+0000 7f2877e00640 1 --2- 172.21.15.82:0/996797123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878108e60 0x7f2878109280 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2868009900 tx=0x7f286802a3f0 comp rx=0 tx=0).stop 2024-05-03T22:18:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.138+0000 7f2877e00640 1 -- 172.21.15.82:0/996797123 shutdown_connections 2024-05-03T22:18:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.138+0000 7f2877e00640 1 --2- 172.21.15.82:0/996797123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287810a970 0x7f2878111290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.138+0000 7f2877e00640 1 --2- 172.21.15.82:0/996797123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2878109fb0 0x7f287810a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.138+0000 7f2877e00640 1 --2- 172.21.15.82:0/996797123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878108e60 0x7f2878109280 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.138+0000 7f2877e00640 1 -- 172.21.15.82:0/996797123 >> 172.21.15.82:0/996797123 conn(0x7f2878077e40 msgr2=0x7f287807a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.138+0000 7f2877e00640 1 -- 172.21.15.82:0/996797123 shutdown_connections 2024-05-03T22:18:20.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.139+0000 7f2877e00640 1 -- 172.21.15.82:0/996797123 wait complete. 2024-05-03T22:18:20.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.139+0000 7f2877e00640 1 Processor -- start 2024-05-03T22:18:20.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.140+0000 7f2877e00640 1 -- start start 2024-05-03T22:18:20.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.140+0000 7f2877e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878108e60 0x7f287819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.140+0000 7f2877e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2878109fb0 0x7f287819f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.140+0000 7f2877e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f287810a970 0x7f28781a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.140+0000 7f2877e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2878114890 con 0x7f2878108e60 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.140+0000 7f2877e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2878114710 con 0x7f2878109fb0 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.140+0000 7f2877e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2878114a10 con 0x7f287810a970 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.140+0000 7f2876a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878108e60 0x7f287819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.140+0000 7f2876a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878108e60 0x7f287819eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55978/0 (socket says 172.21.15.82:55978) 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.140+0000 7f2876a00640 1 -- 172.21.15.82:0/1570763913 learned_addr learned my addr 172.21.15.82:0/1570763913 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.141+0000 7f2877400640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f287810a970 0x7f28781a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.141+0000 7f286fe00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2878109fb0 0x7f287819f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.141+0000 7f2876a00640 1 -- 172.21.15.82:0/1570763913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f287810a970 msgr2=0x7f28781a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.141+0000 7f2876a00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f287810a970 0x7f28781a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:20.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.141+0000 7f2876a00640 1 -- 172.21.15.82:0/1570763913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2878109fb0 msgr2=0x7f287819f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:20.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.141+0000 7f2876a00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2878109fb0 0x7f287819f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:20.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.141+0000 7f2876a00640 1 -- 172.21.15.82:0/1570763913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28781a6af0 con 0x7f2878108e60 2024-05-03T22:18:20.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.141+0000 7f2876a00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878108e60 0x7f287819eed0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2868031460 tx=0x7f2868003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:20.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.142+0000 7f286f400640 1 -- 172.21.15.82:0/1570763913 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286803f070 con 0x7f2878108e60 2024-05-03T22:18:20.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.142+0000 7f286f400640 1 -- 172.21.15.82:0/1570763913 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2868031da0 con 0x7f2878108e60 2024-05-03T22:18:20.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.142+0000 7f2877e00640 1 -- 172.21.15.82:0/1570763913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28781a6d80 con 0x7f2878108e60 2024-05-03T22:18:20.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.142+0000 7f286f400640 1 -- 172.21.15.82:0/1570763913 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868035030 con 0x7f2878108e60 2024-05-03T22:18:20.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.142+0000 7f2877e00640 1 -- 172.21.15.82:0/1570763913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28781a7200 con 0x7f2878108e60 2024-05-03T22:18:20.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.143+0000 7f2877e00640 1 -- 172.21.15.82:0/1570763913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2878110170 con 0x7f2878108e60 2024-05-03T22:18:20.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.145+0000 7f286f400640 1 -- 172.21.15.82:0/1570763913 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f2868042070 con 0x7f2878108e60 2024-05-03T22:18:20.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.147+0000 7f286f400640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f285c0b28f0 0x7f285c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:20.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.147+0000 7f286f400640 1 -- 172.21.15.82:0/1570763913 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f2868103130 con 0x7f2878108e60 2024-05-03T22:18:20.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.147+0000 7f286fe00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f285c0b28f0 0x7f285c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:20.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.148+0000 7f286fe00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f285c0b28f0 0x7f285c0b4db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f28600058c0 tx=0x7f2860005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:20.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.152+0000 7f286f400640 1 -- 172.21.15.82:0/1570763913 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f28680ca8d0 con 0x7f2878108e60 2024-05-03T22:18:20.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:19 smithi116 ceph-mon[31828]: pgmap v553: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:20.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:19 smithi082 ceph-mon[28404]: pgmap v553: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:20.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:19 smithi130 ceph-mon[32417]: pgmap v553: 129 pgs: 129 active+clean; 640 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:20.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.404+0000 7f2877e00640 1 -- 172.21.15.82:0/1570763913 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f287802db50 con 0x7f2878108e60 2024-05-03T22:18:20.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.936+0000 7f286f400640 1 -- 172.21.15.82:0/1570763913 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v30) ==== 118+0+0 (secure 0 0 0) 0x7f28680ca1d0 con 0x7f2878108e60 2024-05-03T22:18:20.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.940+0000 7f2877e00640 1 -- 172.21.15.82:0/1570763913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f285c0b28f0 msgr2=0x7f285c0b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:20.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.940+0000 7f2877e00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f285c0b28f0 0x7f285c0b4db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f28600058c0 tx=0x7f2860005850 comp rx=0 tx=0).stop 2024-05-03T22:18:20.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.940+0000 7f2877e00640 1 -- 172.21.15.82:0/1570763913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878108e60 msgr2=0x7f287819eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:20.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.940+0000 7f2877e00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878108e60 0x7f287819eed0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2868031460 tx=0x7f2868003c80 comp rx=0 tx=0).stop 2024-05-03T22:18:20.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.940+0000 7f2877e00640 1 -- 172.21.15.82:0/1570763913 shutdown_connections 2024-05-03T22:18:20.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.940+0000 7f2877e00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f285c0b28f0 0x7f285c0b4db0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:20.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.940+0000 7f2877e00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f287810a970 0x7f28781a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:20.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.940+0000 7f2877e00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2878109fb0 0x7f287819f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:20.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.940+0000 7f2877e00640 1 --2- 172.21.15.82:0/1570763913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878108e60 0x7f287819eed0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:20.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.940+0000 7f2877e00640 1 -- 172.21.15.82:0/1570763913 >> 172.21.15.82:0/1570763913 conn(0x7f2878077e40 msgr2=0x7f287810d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:20.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.940+0000 7f2877e00640 1 -- 172.21.15.82:0/1570763913 shutdown_connections 2024-05-03T22:18:20.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:20.941+0000 7f2877e00640 1 -- 172.21.15.82:0/1570763913 wait complete. 2024-05-03T22:18:20.963 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-03T22:18:21.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.157+0000 7ffbbfa00640 1 -- 172.21.15.82:0/2066234597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb8105e20 msgr2=0x7ffbb81062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.157+0000 7ffbbfa00640 1 --2- 172.21.15.82:0/2066234597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb8105e20 0x7ffbb81062a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009900 tx=0x7ffba002a3f0 comp rx=0 tx=0).stop 2024-05-03T22:18:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.157+0000 7ffbbfa00640 1 -- 172.21.15.82:0/2066234597 shutdown_connections 2024-05-03T22:18:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.157+0000 7ffbbfa00640 1 --2- 172.21.15.82:0/2066234597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb8105e20 0x7ffbb81062a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.157+0000 7ffbbfa00640 1 --2- 172.21.15.82:0/2066234597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb81067e0 0x7ffbb810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.157+0000 7ffbbfa00640 1 --2- 172.21.15.82:0/2066234597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffbb8104c30 0x7ffbb8105050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.157+0000 7ffbbfa00640 1 -- 172.21.15.82:0/2066234597 >> 172.21.15.82:0/2066234597 conn(0x7ffbb81001a0 msgr2=0x7ffbb81025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:18:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.157+0000 7ffbbfa00640 1 -- 172.21.15.82:0/2066234597 shutdown_connections 2024-05-03T22:18:21.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.157+0000 7ffbbfa00640 1 -- 172.21.15.82:0/2066234597 wait complete. 2024-05-03T22:18:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.158+0000 7ffbbfa00640 1 Processor -- start 2024-05-03T22:18:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.159+0000 7ffbbfa00640 1 -- start start 2024-05-03T22:18:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.159+0000 7ffbbfa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffbb8104c30 0x7ffbb819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.159+0000 7ffbbfa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb8105e20 0x7ffbb819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.159+0000 7ffbbfa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb81067e0 0x7ffbb81a2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.159+0000 7ffbbfa00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb8110640 con 0x7ffbb81067e0 2024-05-03T22:18:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.159+0000 7ffbbfa00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81104c0 con 0x7ffbb8104c30 2024-05-03T22:18:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.159+0000 7ffbbfa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81107c0 con 0x7ffbb8105e20 2024-05-03T22:18:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.159+0000 7ffbbda00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb81067e0 0x7ffbb81a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.159+0000 7ffbbda00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb81067e0 0x7ffbb81a2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56004/0 (socket says 172.21.15.82:56004) 2024-05-03T22:18:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.159+0000 7ffbbda00640 1 -- 172.21.15.82:0/2330129485 learned_addr learned my addr 172.21.15.82:0/2330129485 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:18:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbafe00640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb8105e20 0x7ffbb819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbbd000640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffbb8104c30 0x7ffbb819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbbda00640 1 -- 172.21.15.82:0/2330129485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb8105e20 msgr2=0x7ffbb819b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbbda00640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffbb8105e20 0x7ffbb819b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbbda00640 1 -- 172.21.15.82:0/2330129485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffbb8104c30 msgr2=0x7ffbb819ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbbda00640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffbb8104c30 0x7ffbb819ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbbda00640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb81a28d0 con 0x7ffbb81067e0 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbbda00640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbb81067e0 0x7ffbb81a2230 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000cce0 tx=0x7ffbb000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000f450 con 0x7ffbb81067e0 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffbb000fa80 con 0x7ffbb81067e0 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbbfa00640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb81a2bc0 con 0x7ffbb81067e0 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.160+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0018ad0 con 0x7ffbb81067e0 2024-05-03T22:18:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.161+0000 7ffbbfa00640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb81a30e0 con 0x7ffbb81067e0 2024-05-03T22:18:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.162+0000 7ffbbfa00640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb810bf50 con 0x7ffbb81067e0 2024-05-03T22:18:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.164+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ffbb000f5f0 con 0x7ffbb81067e0 2024-05-03T22:18:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.166+0000 7ffbb6000640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb9c0b29a0 0x7ffb9c0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:18:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.167+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7ffbb00e2fa0 con 0x7ffbb81067e0 2024-05-03T22:18:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.167+0000 7ffbbd000640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb9c0b29a0 0x7ffb9c0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:18:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.167+0000 7ffbbd000640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb9c0b29a0 0x7ffb9c0b4e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffba8005fd0 tx=0x7ffba8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:18:21.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.171+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ffbb0014030 con 0x7ffbb81067e0 2024-05-03T22:18:21.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:20 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1570763913' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-03T22:18:21.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:20 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1570763913' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-03T22:18:21.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:20 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1570763913' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-03T22:18:21.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:18:21.411+0000 7ffbbfa00640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7ffbb8062e90 con 0x7ffb9c0b29a0 2024-05-03T22:18:22.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:21 smithi082 ceph-mon[28404]: pgmap v554: 129 pgs: 129 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-03T22:18:22.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:21 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1570763913' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-03T22:18:22.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:21 smithi082 ceph-mon[28404]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:18:22.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:21 smithi082 ceph-mon[28404]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:18:22.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:21 smithi130 ceph-mon[32417]: pgmap v554: 129 pgs: 129 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-03T22:18:22.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:21 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1570763913' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-03T22:18:22.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:21 smithi130 ceph-mon[32417]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:18:22.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:21 smithi130 ceph-mon[32417]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:18:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:21 smithi116 ceph-mon[31828]: pgmap v554: 129 pgs: 129 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-03T22:18:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:21 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1570763913' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-03T22:18:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:21 smithi116 ceph-mon[31828]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:18:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:21 smithi116 ceph-mon[31828]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:18:24.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:23 smithi082 ceph-mon[28404]: pgmap v555: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-03T22:18:24.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:23 smithi130 ceph-mon[32417]: pgmap v555: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-03T22:18:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:23 smithi116 ceph-mon[31828]: pgmap v555: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-03T22:18:26.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:25 smithi082 ceph-mon[28404]: pgmap v556: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-03T22:18:26.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:25 smithi130 ceph-mon[32417]: pgmap v556: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-03T22:18:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:25 smithi116 ceph-mon[31828]: pgmap v556: 129 pgs: 129 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-03T22:18:28.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:27 smithi082 ceph-mon[28404]: pgmap v557: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-05-03T22:18:28.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:27 smithi130 ceph-mon[32417]: pgmap v557: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-05-03T22:18:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:27 smithi116 ceph-mon[31828]: pgmap v557: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-05-03T22:18:30.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:29 smithi082 ceph-mon[28404]: pgmap v558: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T22:18:30.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:29 smithi130 ceph-mon[32417]: pgmap v558: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T22:18:30.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:29 smithi116 ceph-mon[31828]: pgmap v558: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-03T22:18:32.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:31 smithi082 ceph-mon[28404]: pgmap v559: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-05-03T22:18:32.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:31 smithi130 ceph-mon[32417]: pgmap v559: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-05-03T22:18:32.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:31 smithi116 ceph-mon[31828]: pgmap v559: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-05-03T22:18:34.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:33 smithi130 ceph-mon[32417]: pgmap v560: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 852 B/s wr, 10 op/s 2024-05-03T22:18:34.405 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:33 smithi082 ceph-mon[28404]: pgmap v560: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 852 B/s wr, 10 op/s 2024-05-03T22:18:34.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:33 smithi116 ceph-mon[31828]: pgmap v560: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 852 B/s wr, 10 op/s 2024-05-03T22:18:36.238 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:35 smithi116 ceph-mon[31828]: pgmap v561: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 8 op/s 2024-05-03T22:18:36.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:35 smithi130 ceph-mon[32417]: pgmap v561: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 8 op/s 2024-05-03T22:18:36.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:35 smithi082 ceph-mon[28404]: pgmap v561: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 8 op/s 2024-05-03T22:18:38.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:37 smithi130 ceph-mon[32417]: pgmap v562: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-03T22:18:38.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:37 smithi116 ceph-mon[31828]: pgmap v562: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-03T22:18:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:37 smithi082 ceph-mon[28404]: pgmap v562: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-03T22:18:40.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:39 smithi130 ceph-mon[32417]: pgmap v563: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:40.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:39 smithi116 ceph-mon[31828]: pgmap v563: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:40.479 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:39 smithi082 ceph-mon[28404]: pgmap v563: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:42.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:42 smithi130 ceph-mon[32417]: pgmap v564: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:42 smithi116 ceph-mon[31828]: pgmap v564: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:42.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:42 smithi082 ceph-mon[28404]: pgmap v564: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:44.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:44 smithi130 ceph-mon[32417]: pgmap v565: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:44 smithi116 ceph-mon[31828]: pgmap v565: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:44 smithi082 ceph-mon[28404]: pgmap v565: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:46.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:46 smithi082 ceph-mon[28404]: pgmap v566: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:46.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:46 smithi130 ceph-mon[32417]: pgmap v566: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:46 smithi116 ceph-mon[31828]: pgmap v566: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:48 smithi116 ceph-mon[31828]: pgmap v567: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:18:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:48 smithi082 ceph-mon[28404]: pgmap v567: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:18:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:48 smithi130 ceph-mon[32417]: pgmap v567: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:18:50.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:50 smithi116 ceph-mon[31828]: pgmap v568: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:50.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:50 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:18:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:50 smithi082 ceph-mon[28404]: pgmap v568: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:50 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:18:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:50 smithi130 ceph-mon[32417]: pgmap v568: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:18:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:50 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:18:52.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:52 smithi116 ceph-mon[31828]: pgmap v569: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:52.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:18:52.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:18:52.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:18:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:52 smithi082 ceph-mon[28404]: pgmap v569: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:18:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:18:52.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:18:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:52 smithi130 ceph-mon[32417]: pgmap v569: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:18:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:18:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:18:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:18:54.331 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:54 smithi130 ceph-mon[32417]: pgmap v570: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:54 smithi116 ceph-mon[31828]: pgmap v570: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:54.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:54 smithi082 ceph-mon[28404]: pgmap v570: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:18:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:56 smithi116 ceph-mon[31828]: pgmap v571: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:56 smithi082 ceph-mon[28404]: pgmap v571: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:56 smithi130 ceph-mon[32417]: pgmap v571: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:18:58.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:18:58 smithi116 ceph-mon[31828]: pgmap v572: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:18:58.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:18:58 smithi082 ceph-mon[28404]: pgmap v572: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:18:58.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:18:58 smithi130 ceph-mon[32417]: pgmap v572: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:00 smithi116 ceph-mon[31828]: pgmap v573: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:00.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:00 smithi082 ceph-mon[28404]: pgmap v573: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:00 smithi130 ceph-mon[32417]: pgmap v573: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:02 smithi116 ceph-mon[31828]: pgmap v574: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:02 smithi082 ceph-mon[28404]: pgmap v574: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:02 smithi130 ceph-mon[32417]: pgmap v574: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:04.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:04 smithi116 ceph-mon[31828]: pgmap v575: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:04 smithi082 ceph-mon[28404]: pgmap v575: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:04 smithi130 ceph-mon[32417]: pgmap v575: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:06 smithi116 ceph-mon[31828]: pgmap v576: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:06 smithi082 ceph-mon[28404]: pgmap v576: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:06.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:06 smithi130 ceph-mon[32417]: pgmap v576: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:08.438 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:08 smithi116 ceph-mon[31828]: pgmap v577: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:08 smithi082 ceph-mon[28404]: pgmap v577: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:08.534 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:08 smithi130 ceph-mon[32417]: pgmap v577: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:10 smithi116 ceph-mon[31828]: pgmap v578: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:10.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:10 smithi082 ceph-mon[28404]: pgmap v578: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:10.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:10 smithi130 ceph-mon[32417]: pgmap v578: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:12.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:12 smithi116 ceph-mon[31828]: pgmap v579: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:12 smithi082 ceph-mon[28404]: pgmap v579: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:12 smithi130 ceph-mon[32417]: pgmap v579: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:14.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:14 smithi116 ceph-mon[31828]: pgmap v580: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:14.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:14 smithi082 ceph-mon[28404]: pgmap v580: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:14 smithi130 ceph-mon[32417]: pgmap v580: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:16.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:16 smithi082 ceph-mon[28404]: pgmap v581: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:16.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:16 smithi116 ceph-mon[31828]: pgmap v581: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:16 smithi130 ceph-mon[32417]: pgmap v581: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:18.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:18 smithi116 ceph-mon[31828]: pgmap v582: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:18.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:18 smithi082 ceph-mon[28404]: pgmap v582: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:18.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:18 smithi130 ceph-mon[32417]: pgmap v582: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:20.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:20 smithi116 ceph-mon[31828]: pgmap v583: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:20.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:20 smithi082 ceph-mon[28404]: pgmap v583: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:20 smithi130 ceph-mon[32417]: pgmap v583: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:22 smithi116 ceph-mon[31828]: pgmap v584: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:22 smithi082 ceph-mon[28404]: pgmap v584: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:22 smithi130 ceph-mon[32417]: pgmap v584: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:24 smithi116 ceph-mon[31828]: pgmap v585: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:24.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:24 smithi082 ceph-mon[28404]: pgmap v585: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:24 smithi130 ceph-mon[32417]: pgmap v585: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:26 smithi116 ceph-mon[31828]: pgmap v586: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:26.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:26 smithi082 ceph-mon[28404]: pgmap v586: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:26 smithi130 ceph-mon[32417]: pgmap v586: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:28 smithi116 ceph-mon[31828]: pgmap v587: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:28 smithi082 ceph-mon[28404]: pgmap v587: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:28.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:28 smithi130 ceph-mon[32417]: pgmap v587: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:30.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:30 smithi116 ceph-mon[31828]: pgmap v588: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:30.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:30 smithi082 ceph-mon[28404]: pgmap v588: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:30.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:30 smithi130 ceph-mon[32417]: pgmap v588: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:32.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:32 smithi116 ceph-mon[31828]: pgmap v589: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:32.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:32 smithi082 ceph-mon[28404]: pgmap v589: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:32 smithi130 ceph-mon[32417]: pgmap v589: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:34.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:34 smithi116 ceph-mon[31828]: pgmap v590: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:34.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:34 smithi082 ceph-mon[28404]: pgmap v590: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:34 smithi130 ceph-mon[32417]: pgmap v590: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:36.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:36 smithi082 ceph-mon[28404]: pgmap v591: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:36.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:36 smithi130 ceph-mon[32417]: pgmap v591: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:36 smithi116 ceph-mon[31828]: pgmap v591: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:38 smithi082 ceph-mon[28404]: pgmap v592: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:38 smithi130 ceph-mon[32417]: pgmap v592: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:38 smithi116 ceph-mon[31828]: pgmap v592: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:40.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:40 smithi082 ceph-mon[28404]: pgmap v593: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:40.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:40 smithi130 ceph-mon[32417]: pgmap v593: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:40.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:40 smithi116 ceph-mon[31828]: pgmap v593: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:42.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:42 smithi082 ceph-mon[28404]: pgmap v594: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:42 smithi130 ceph-mon[32417]: pgmap v594: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:42 smithi116 ceph-mon[31828]: pgmap v594: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:44 smithi082 ceph-mon[28404]: pgmap v595: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:44 smithi130 ceph-mon[32417]: pgmap v595: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:44.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:44 smithi116 ceph-mon[31828]: pgmap v595: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:46 smithi082 ceph-mon[28404]: pgmap v596: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:46 smithi130 ceph-mon[32417]: pgmap v596: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:46 smithi116 ceph-mon[31828]: pgmap v596: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:48 smithi082 ceph-mon[28404]: pgmap v597: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:48 smithi130 ceph-mon[32417]: pgmap v597: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:48 smithi116 ceph-mon[31828]: pgmap v597: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:50 smithi130 ceph-mon[32417]: pgmap v598: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:50 smithi116 ceph-mon[31828]: pgmap v598: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:50 smithi082 ceph-mon[28404]: pgmap v598: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:19:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:52 smithi130 ceph-mon[32417]: pgmap v599: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:19:52.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:52 smithi116 ceph-mon[31828]: pgmap v599: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:52.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:19:52.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:52 smithi082 ceph-mon[28404]: pgmap v599: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:19:52.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:19:53.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:53 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:19:53.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:53 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:19:53.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:53 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:19:53.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:53 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:19:53.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:53 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:19:53.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:53 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:19:53.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:19:53.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:19:53.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:53 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:19:54.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:54 smithi130 ceph-mon[32417]: pgmap v600: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:54.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:54 smithi116 ceph-mon[31828]: pgmap v600: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:54 smithi082 ceph-mon[28404]: pgmap v600: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:19:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:56 smithi130 ceph-mon[32417]: pgmap v601: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:56 smithi116 ceph-mon[31828]: pgmap v601: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:56.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:56 smithi082 ceph-mon[28404]: pgmap v601: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:19:58.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:19:58 smithi130 ceph-mon[32417]: pgmap v602: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:58.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:19:58 smithi116 ceph-mon[31828]: pgmap v602: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:19:58.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:19:58 smithi082 ceph-mon[28404]: pgmap v602: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:00 smithi130 ceph-mon[32417]: pgmap v603: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:00 smithi130 ceph-mon[32417]: overall HEALTH_OK 2024-05-03T22:20:00.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:00 smithi116 ceph-mon[31828]: pgmap v603: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:00.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:00 smithi116 ceph-mon[31828]: overall HEALTH_OK 2024-05-03T22:20:00.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:00 smithi082 ceph-mon[28404]: pgmap v603: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:00.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:00 smithi082 ceph-mon[28404]: overall HEALTH_OK 2024-05-03T22:20:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:02 smithi130 ceph-mon[32417]: pgmap v604: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:02.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:02 smithi116 ceph-mon[31828]: pgmap v604: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:02.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:02 smithi082 ceph-mon[28404]: pgmap v604: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:04.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:04 smithi116 ceph-mon[31828]: pgmap v605: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:04.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:04 smithi082 ceph-mon[28404]: pgmap v605: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:04.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:04 smithi130 ceph-mon[32417]: pgmap v605: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:06 smithi116 ceph-mon[31828]: pgmap v606: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:06.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:06 smithi082 ceph-mon[28404]: pgmap v606: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:06 smithi130 ceph-mon[32417]: pgmap v606: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:08 smithi116 ceph-mon[31828]: pgmap v607: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:08.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:08 smithi082 ceph-mon[28404]: pgmap v607: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:08.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:08 smithi130 ceph-mon[32417]: pgmap v607: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:10 smithi116 ceph-mon[31828]: pgmap v608: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:10 smithi082 ceph-mon[28404]: pgmap v608: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:10 smithi130 ceph-mon[32417]: pgmap v608: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:12 smithi116 ceph-mon[31828]: pgmap v609: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:12 smithi082 ceph-mon[28404]: pgmap v609: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:12.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:12 smithi130 ceph-mon[32417]: pgmap v609: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:14.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:14 smithi116 ceph-mon[31828]: pgmap v610: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:14 smithi082 ceph-mon[28404]: pgmap v610: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:14.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:14 smithi130 ceph-mon[32417]: pgmap v610: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:16.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:16 smithi116 ceph-mon[31828]: pgmap v611: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:16 smithi082 ceph-mon[28404]: pgmap v611: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:16.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:16 smithi130 ceph-mon[32417]: pgmap v611: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:18 smithi116 ceph-mon[31828]: pgmap v612: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:18 smithi082 ceph-mon[28404]: pgmap v612: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:18 smithi130 ceph-mon[32417]: pgmap v612: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:20 smithi116 ceph-mon[31828]: pgmap v613: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:20 smithi082 ceph-mon[28404]: pgmap v613: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:20 smithi130 ceph-mon[32417]: pgmap v613: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:22 smithi116 ceph-mon[31828]: pgmap v614: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:22.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:22 smithi082 ceph-mon[28404]: pgmap v614: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:22 smithi130 ceph-mon[32417]: pgmap v614: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:24 smithi116 ceph-mon[31828]: pgmap v615: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:24.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:24 smithi082 ceph-mon[28404]: pgmap v615: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:24.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:24 smithi130 ceph-mon[32417]: pgmap v615: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:26.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:26 smithi116 ceph-mon[31828]: pgmap v616: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:26.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:26 smithi082 ceph-mon[28404]: pgmap v616: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:26.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:26 smithi130 ceph-mon[32417]: pgmap v616: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:28.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:28 smithi116 ceph-mon[31828]: pgmap v617: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:28 smithi082 ceph-mon[28404]: pgmap v617: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:28.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:28 smithi130 ceph-mon[32417]: pgmap v617: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:30.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:30 smithi116 ceph-mon[31828]: pgmap v618: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:30.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:30 smithi082 ceph-mon[28404]: pgmap v618: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:30.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:30 smithi130 ceph-mon[32417]: pgmap v618: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:32 smithi116 ceph-mon[31828]: pgmap v619: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:32.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:32 smithi082 ceph-mon[28404]: pgmap v619: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:32 smithi130 ceph-mon[32417]: pgmap v619: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:34 smithi116 ceph-mon[31828]: pgmap v620: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:34 smithi082 ceph-mon[28404]: pgmap v620: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:34.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:34 smithi130 ceph-mon[32417]: pgmap v620: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:36 smithi116 ceph-mon[31828]: pgmap v621: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:36 smithi082 ceph-mon[28404]: pgmap v621: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:36.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:36 smithi130 ceph-mon[32417]: pgmap v621: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:38 smithi116 ceph-mon[31828]: pgmap v622: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:38.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:38 smithi082 ceph-mon[28404]: pgmap v622: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:38 smithi130 ceph-mon[32417]: pgmap v622: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:20:40.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:40 smithi116 ceph-mon[31828]: pgmap v623: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:40 smithi082 ceph-mon[28404]: pgmap v623: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:40.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:40 smithi130 ceph-mon[32417]: pgmap v623: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:20:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:42 smithi116 ceph-mon[31828]: pgmap v624: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:42.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:42 smithi082 ceph-mon[28404]: pgmap v624: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:42 smithi130 ceph-mon[32417]: pgmap v624: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:20:44.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:44 smithi116 ceph-mon[31828]: pgmap v625: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:44.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:44 smithi082 ceph-mon[28404]: pgmap v625: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:44.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:44 smithi130 ceph-mon[32417]: pgmap v625: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:20:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:46 smithi116 ceph-mon[31828]: pgmap v626: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:46 smithi082 ceph-mon[28404]: pgmap v626: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:46.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:46 smithi130 ceph-mon[32417]: pgmap v626: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:20:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:48 smithi116 ceph-mon[31828]: pgmap v627: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:20:48.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:48 smithi082 ceph-mon[28404]: pgmap v627: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:20:48.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:48 smithi130 ceph-mon[32417]: pgmap v627: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:20:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:50 smithi116 ceph-mon[31828]: pgmap v628: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T22:20:50.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:50 smithi082 ceph-mon[28404]: pgmap v628: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T22:20:50.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:50 smithi130 ceph-mon[32417]: pgmap v628: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T22:20:52.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:52 smithi082 ceph-mon[28404]: pgmap v629: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:20:52.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:52 smithi130 ceph-mon[32417]: pgmap v629: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:20:52.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:52 smithi116 ceph-mon[31828]: pgmap v629: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:20:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:54 smithi082 ceph-mon[28404]: pgmap v630: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:20:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:54 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:20:54.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:54 smithi130 ceph-mon[32417]: pgmap v630: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:20:54.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:54 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:20:54.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:54 smithi116 ceph-mon[31828]: pgmap v630: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:20:54.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:54 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:20:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:20:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:20:55.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:55 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:20:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:20:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:20:55.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:55 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:20:55.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:20:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:20:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:20:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:55 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:20:56.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:56 smithi082 ceph-mon[28404]: pgmap v631: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:20:56.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:56 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi116 to 176.4M 2024-05-03T22:20:56.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:56 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-03T22:20:56.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:56 smithi082 ceph-mon[28404]: Unable to set osd_memory_target on smithi116 to 185061990: error parsing value: Value '185061990' is below minimum 939524096 2024-05-03T22:20:56.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:56 smithi082 ceph-mon[28404]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-03T22:20:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:56 smithi130 ceph-mon[32417]: pgmap v631: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:20:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:56 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi116 to 176.4M 2024-05-03T22:20:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:56 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-03T22:20:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:56 smithi130 ceph-mon[32417]: Unable to set osd_memory_target on smithi116 to 185061990: error parsing value: Value '185061990' is below minimum 939524096 2024-05-03T22:20:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:56 smithi130 ceph-mon[32417]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-03T22:20:56.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:56 smithi116 ceph-mon[31828]: pgmap v631: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:20:56.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:56 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi116 to 176.4M 2024-05-03T22:20:56.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:56 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-03T22:20:56.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:56 smithi116 ceph-mon[31828]: Unable to set osd_memory_target on smithi116 to 185061990: error parsing value: Value '185061990' is below minimum 939524096 2024-05-03T22:20:56.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:56 smithi116 ceph-mon[31828]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-03T22:20:57.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:57 smithi082 ceph-mon[28404]: pgmap v632: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:20:57.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:57 smithi130 ceph-mon[32417]: pgmap v632: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:20:57.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:57 smithi116 ceph-mon[31828]: pgmap v632: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:21:00.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:20:59 smithi116 ceph-mon[31828]: pgmap v633: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:21:00.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:20:59 smithi082 ceph-mon[28404]: pgmap v633: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:21:00.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:20:59 smithi130 ceph-mon[32417]: pgmap v633: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:21:02.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:01 smithi116 ceph-mon[31828]: pgmap v634: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:21:02.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:01 smithi082 ceph-mon[28404]: pgmap v634: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:21:02.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:01 smithi130 ceph-mon[32417]: pgmap v634: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:21:04.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:03 smithi116 ceph-mon[31828]: pgmap v635: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:21:04.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:03 smithi082 ceph-mon[28404]: pgmap v635: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:21:04.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:03 smithi130 ceph-mon[32417]: pgmap v635: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:21:06.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:05 smithi116 ceph-mon[31828]: pgmap v636: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:21:06.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:05 smithi082 ceph-mon[28404]: pgmap v636: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:21:06.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:05 smithi130 ceph-mon[32417]: pgmap v636: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:21:08.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:07 smithi116 ceph-mon[31828]: pgmap v637: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:21:08.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:07 smithi082 ceph-mon[28404]: pgmap v637: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:21:08.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:07 smithi130 ceph-mon[32417]: pgmap v637: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:21:10.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:09 smithi082 ceph-mon[28404]: pgmap v638: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:10.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:09 smithi130 ceph-mon[32417]: pgmap v638: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:09 smithi116 ceph-mon[31828]: pgmap v638: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:12.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:11 smithi082 ceph-mon[28404]: pgmap v639: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:12.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:11 smithi130 ceph-mon[32417]: pgmap v639: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:12.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:11 smithi116 ceph-mon[31828]: pgmap v639: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:14.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:13 smithi082 ceph-mon[28404]: pgmap v640: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:14.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:13 smithi130 ceph-mon[32417]: pgmap v640: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:14.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:13 smithi116 ceph-mon[31828]: pgmap v640: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:16.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:15 smithi082 ceph-mon[28404]: pgmap v641: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:16.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:15 smithi130 ceph-mon[32417]: pgmap v641: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:16.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:15 smithi116 ceph-mon[31828]: pgmap v641: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:18.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:17 smithi082 ceph-mon[28404]: pgmap v642: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:18.276 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:17 smithi130 ceph-mon[32417]: pgmap v642: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:18.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:17 smithi116 ceph-mon[31828]: pgmap v642: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:20.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:19 smithi130 ceph-mon[32417]: pgmap v643: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:20.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:19 smithi116 ceph-mon[31828]: pgmap v643: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:20.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:19 smithi082 ceph-mon[28404]: pgmap v643: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:21.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:21:21.187+0000 7ffbb4c00640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb900034c0 con 0x7ffbb81067e0 2024-05-03T22:21:21.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:21:21.188+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7ffb900034c0 con 0x7ffbb81067e0 2024-05-03T22:21:22.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:21 smithi130 ceph-mon[32417]: pgmap v644: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:21 smithi116 ceph-mon[31828]: pgmap v644: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:21 smithi082 ceph-mon[28404]: pgmap v644: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:24.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:23 smithi130 ceph-mon[32417]: pgmap v645: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:23 smithi116 ceph-mon[31828]: pgmap v645: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:24.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:23 smithi082 ceph-mon[28404]: pgmap v645: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:26.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:25 smithi130 ceph-mon[32417]: pgmap v646: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:25 smithi116 ceph-mon[31828]: pgmap v646: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:26.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:25 smithi082 ceph-mon[28404]: pgmap v646: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:28.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:28 smithi130 ceph-mon[32417]: pgmap v647: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:28 smithi116 ceph-mon[31828]: pgmap v647: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:28 smithi082 ceph-mon[28404]: pgmap v647: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:30.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:30 smithi116 ceph-mon[31828]: pgmap v648: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:30.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:30 smithi082 ceph-mon[28404]: pgmap v648: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:30.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:30 smithi130 ceph-mon[32417]: pgmap v648: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:32.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:32 smithi116 ceph-mon[31828]: pgmap v649: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:32.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:32 smithi082 ceph-mon[28404]: pgmap v649: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:32 smithi130 ceph-mon[32417]: pgmap v649: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:34.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:34 smithi116 ceph-mon[31828]: pgmap v650: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:34.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:34 smithi082 ceph-mon[28404]: pgmap v650: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:34 smithi130 ceph-mon[32417]: pgmap v650: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:36.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:36 smithi116 ceph-mon[31828]: pgmap v651: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:36.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:36 smithi082 ceph-mon[28404]: pgmap v651: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:36.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:36 smithi130 ceph-mon[32417]: pgmap v651: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:38 smithi082 ceph-mon[28404]: pgmap v652: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:38 smithi130 ceph-mon[32417]: pgmap v652: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:38 smithi116 ceph-mon[31828]: pgmap v652: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:40.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:40 smithi082 ceph-mon[28404]: pgmap v653: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:40.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:40 smithi130 ceph-mon[32417]: pgmap v653: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:40.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:40 smithi116 ceph-mon[31828]: pgmap v653: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:42.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:42 smithi082 ceph-mon[28404]: pgmap v654: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:42 smithi130 ceph-mon[32417]: pgmap v654: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:42 smithi116 ceph-mon[31828]: pgmap v654: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:44 smithi082 ceph-mon[28404]: pgmap v655: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:44 smithi130 ceph-mon[32417]: pgmap v655: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:44.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:44 smithi116 ceph-mon[31828]: pgmap v655: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:46 smithi082 ceph-mon[28404]: pgmap v656: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:46 smithi130 ceph-mon[32417]: pgmap v656: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:46 smithi116 ceph-mon[31828]: pgmap v656: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:48 smithi082 ceph-mon[28404]: pgmap v657: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:48 smithi130 ceph-mon[32417]: pgmap v657: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:48 smithi116 ceph-mon[31828]: pgmap v657: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:50 smithi082 ceph-mon[28404]: pgmap v658: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:50 smithi130 ceph-mon[32417]: pgmap v658: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:50 smithi116 ceph-mon[31828]: pgmap v658: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:21:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:52 smithi130 ceph-mon[32417]: pgmap v659: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:52.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:52 smithi116 ceph-mon[31828]: pgmap v659: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:52.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:52 smithi082 ceph-mon[28404]: pgmap v659: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:21:54.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:54 smithi130 ceph-mon[32417]: pgmap v660: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:54.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:54 smithi116 ceph-mon[31828]: pgmap v660: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:54 smithi082 ceph-mon[28404]: pgmap v660: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:21:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:56 smithi130 ceph-mon[32417]: pgmap v661: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:56 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:21:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:56 smithi116 ceph-mon[31828]: pgmap v661: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:56 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:21:56.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:56 smithi082 ceph-mon[28404]: pgmap v661: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:21:56.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:56 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:21:57.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:21:57.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:21:57.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:21:57.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:21:57.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:21:57.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:21:57.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:21:57.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:21:57.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:21:57.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:21:58.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:58 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi130 to 176.4M 2024-05-03T22:21:58.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:58 smithi130 ceph-mon[32417]: Unable to set osd_memory_target on smithi130 to 185046937: error parsing value: Value '185046937' is below minimum 939524096 2024-05-03T22:21:58.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:21:58 smithi130 ceph-mon[32417]: pgmap v662: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:58.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:58 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi130 to 176.4M 2024-05-03T22:21:58.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:58 smithi116 ceph-mon[31828]: Unable to set osd_memory_target on smithi130 to 185046937: error parsing value: Value '185046937' is below minimum 939524096 2024-05-03T22:21:58.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:21:58 smithi116 ceph-mon[31828]: pgmap v662: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:21:58.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:58 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi130 to 176.4M 2024-05-03T22:21:58.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:58 smithi082 ceph-mon[28404]: Unable to set osd_memory_target on smithi130 to 185046937: error parsing value: Value '185046937' is below minimum 939524096 2024-05-03T22:21:58.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:21:58 smithi082 ceph-mon[28404]: pgmap v662: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:22:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:00 smithi130 ceph-mon[32417]: pgmap v663: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:22:00.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:00 smithi116 ceph-mon[31828]: pgmap v663: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:22:00.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:00 smithi082 ceph-mon[28404]: pgmap v663: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:22:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:02 smithi130 ceph-mon[32417]: pgmap v664: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:22:02.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:02 smithi116 ceph-mon[31828]: pgmap v664: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:22:02.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:02 smithi082 ceph-mon[28404]: pgmap v664: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:22:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:04 smithi130 ceph-mon[32417]: pgmap v665: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:04.528 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:04 smithi082 ceph-mon[28404]: pgmap v665: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:04.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:04 smithi116 ceph-mon[31828]: pgmap v665: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:06 smithi116 ceph-mon[31828]: pgmap v666: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:06.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:06 smithi082 ceph-mon[28404]: pgmap v666: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:06 smithi130 ceph-mon[32417]: pgmap v666: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:08 smithi116 ceph-mon[31828]: pgmap v667: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:22:08.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:08 smithi082 ceph-mon[28404]: pgmap v667: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:22:08.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:08 smithi130 ceph-mon[32417]: pgmap v667: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:22:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:10 smithi116 ceph-mon[31828]: pgmap v668: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:22:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:10 smithi082 ceph-mon[28404]: pgmap v668: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:22:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:10 smithi130 ceph-mon[32417]: pgmap v668: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:22:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:12 smithi116 ceph-mon[31828]: pgmap v669: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:22:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:12 smithi082 ceph-mon[28404]: pgmap v669: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:22:12.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:12 smithi130 ceph-mon[32417]: pgmap v669: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:22:14.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:14 smithi116 ceph-mon[31828]: pgmap v670: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:14 smithi082 ceph-mon[28404]: pgmap v670: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:14.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:14 smithi130 ceph-mon[32417]: pgmap v670: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:16.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:16 smithi116 ceph-mon[31828]: pgmap v671: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:16 smithi082 ceph-mon[28404]: pgmap v671: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:16.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:16 smithi130 ceph-mon[32417]: pgmap v671: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:18 smithi116 ceph-mon[31828]: pgmap v672: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:22:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:18 smithi082 ceph-mon[28404]: pgmap v672: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:22:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:18 smithi130 ceph-mon[32417]: pgmap v672: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:22:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:20 smithi116 ceph-mon[31828]: pgmap v673: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:22:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:20 smithi082 ceph-mon[28404]: pgmap v673: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:22:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:20 smithi130 ceph-mon[32417]: pgmap v673: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:22:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:22 smithi116 ceph-mon[31828]: pgmap v674: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:22:22.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:22 smithi082 ceph-mon[28404]: pgmap v674: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:22:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:22 smithi130 ceph-mon[32417]: pgmap v674: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:22:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:24 smithi116 ceph-mon[31828]: pgmap v675: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:22:24.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:24 smithi082 ceph-mon[28404]: pgmap v675: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:22:24.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:24 smithi130 ceph-mon[32417]: pgmap v675: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:22:26.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:26 smithi116 ceph-mon[31828]: pgmap v676: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:22:26.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:26 smithi082 ceph-mon[28404]: pgmap v676: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:22:26.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:26 smithi130 ceph-mon[32417]: pgmap v676: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:22:28.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:28 smithi116 ceph-mon[31828]: pgmap v677: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:22:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:28 smithi082 ceph-mon[28404]: pgmap v677: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:22:28.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:28 smithi130 ceph-mon[32417]: pgmap v677: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:22:30.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:30 smithi116 ceph-mon[31828]: pgmap v678: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:22:30.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:30 smithi082 ceph-mon[28404]: pgmap v678: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:22:30.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:30 smithi130 ceph-mon[32417]: pgmap v678: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:22:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:32 smithi116 ceph-mon[31828]: pgmap v679: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:22:32.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:32 smithi082 ceph-mon[28404]: pgmap v679: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:22:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:32 smithi130 ceph-mon[32417]: pgmap v679: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:22:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:34 smithi116 ceph-mon[31828]: pgmap v680: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:34 smithi082 ceph-mon[28404]: pgmap v680: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:34.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:34 smithi130 ceph-mon[32417]: pgmap v680: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:36 smithi116 ceph-mon[31828]: pgmap v681: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:36 smithi082 ceph-mon[28404]: pgmap v681: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:36.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:36 smithi130 ceph-mon[32417]: pgmap v681: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:38 smithi116 ceph-mon[31828]: pgmap v682: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:22:38.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:38 smithi082 ceph-mon[28404]: pgmap v682: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:22:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:38 smithi130 ceph-mon[32417]: pgmap v682: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:22:40.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:40 smithi116 ceph-mon[31828]: pgmap v683: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:22:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:40 smithi082 ceph-mon[28404]: pgmap v683: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:22:40.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:40 smithi130 ceph-mon[32417]: pgmap v683: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:22:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:42 smithi116 ceph-mon[31828]: pgmap v684: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:22:42.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:42 smithi082 ceph-mon[28404]: pgmap v684: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:22:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:42 smithi130 ceph-mon[32417]: pgmap v684: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:22:44.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:44 smithi116 ceph-mon[31828]: pgmap v685: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:22:44.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:44 smithi082 ceph-mon[28404]: pgmap v685: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:22:44.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:44 smithi130 ceph-mon[32417]: pgmap v685: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:22:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:46 smithi116 ceph-mon[31828]: pgmap v686: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:22:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:46 smithi082 ceph-mon[28404]: pgmap v686: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:22:46.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:46 smithi130 ceph-mon[32417]: pgmap v686: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:22:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:48 smithi116 ceph-mon[31828]: pgmap v687: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:22:48.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:48 smithi082 ceph-mon[28404]: pgmap v687: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:22:48.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:48 smithi130 ceph-mon[32417]: pgmap v687: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:22:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:50 smithi116 ceph-mon[31828]: pgmap v688: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:22:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:50 smithi082 ceph-mon[28404]: pgmap v688: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:22:50.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:50 smithi130 ceph-mon[32417]: pgmap v688: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:22:52.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:52 smithi116 ceph-mon[31828]: pgmap v689: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:22:52.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:52 smithi082 ceph-mon[28404]: pgmap v689: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:22:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:52 smithi130 ceph-mon[32417]: pgmap v689: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:22:54.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:54 smithi116 ceph-mon[31828]: pgmap v690: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:54 smithi082 ceph-mon[28404]: pgmap v690: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:54.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:54 smithi130 ceph-mon[32417]: pgmap v690: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:22:56.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:56 smithi082 ceph-mon[28404]: pgmap v691: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:56 smithi130 ceph-mon[32417]: pgmap v691: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:56.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:56 smithi116 ceph-mon[31828]: pgmap v691: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:22:57.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:57 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:22:57.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:57 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:22:57.934 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:57 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:22:58.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:58 smithi082 ceph-mon[28404]: pgmap v692: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:22:58.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:58 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:22:58.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:58 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:22:58.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:58 smithi130 ceph-mon[32417]: pgmap v692: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:22:58.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:58 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:22:58.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:58 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:22:58.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:58 smithi116 ceph-mon[31828]: pgmap v692: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:22:58.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:58 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:22:58.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:58 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:22:59.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:22:59.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:22:59.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:22:59 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:22:59.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:22:59.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:22:59.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:22:59 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:22:59.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:22:59.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:22:59.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:22:59 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:23:00.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:00 smithi082 ceph-mon[28404]: pgmap v693: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:00.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:00 smithi130 ceph-mon[32417]: pgmap v693: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:00.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:00 smithi116 ceph-mon[31828]: pgmap v693: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:02.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:02 smithi082 ceph-mon[28404]: pgmap v694: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:02.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:02 smithi130 ceph-mon[32417]: pgmap v694: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:02.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:02 smithi116 ceph-mon[31828]: pgmap v694: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:04.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:04 smithi082 ceph-mon[28404]: pgmap v695: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:04.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:04 smithi130 ceph-mon[32417]: pgmap v695: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:04.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:04 smithi116 ceph-mon[31828]: pgmap v695: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:05.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:05 smithi130 ceph-mon[32417]: pgmap v696: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:05.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:05 smithi116 ceph-mon[31828]: pgmap v696: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:05.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:05 smithi082 ceph-mon[28404]: pgmap v696: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:08.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:07 smithi082 ceph-mon[28404]: pgmap v697: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:08.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:07 smithi130 ceph-mon[32417]: pgmap v697: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:08.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:07 smithi116 ceph-mon[31828]: pgmap v697: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:10.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:09 smithi130 ceph-mon[32417]: pgmap v698: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:09 smithi116 ceph-mon[31828]: pgmap v698: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:10.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:09 smithi082 ceph-mon[28404]: pgmap v698: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:12.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:11 smithi130 ceph-mon[32417]: pgmap v699: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:12.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:11 smithi116 ceph-mon[31828]: pgmap v699: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:11 smithi082 ceph-mon[28404]: pgmap v699: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:14.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:13 smithi130 ceph-mon[32417]: pgmap v700: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:14.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:13 smithi116 ceph-mon[31828]: pgmap v700: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:14.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:13 smithi082 ceph-mon[28404]: pgmap v700: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:16.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:15 smithi130 ceph-mon[32417]: pgmap v701: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:16.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:15 smithi116 ceph-mon[31828]: pgmap v701: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:15 smithi082 ceph-mon[28404]: pgmap v701: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:18.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:18 smithi130 ceph-mon[32417]: pgmap v702: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:18.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:18 smithi116 ceph-mon[31828]: pgmap v702: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:18.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:18 smithi082 ceph-mon[28404]: pgmap v702: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:20.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:20 smithi130 ceph-mon[32417]: pgmap v703: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:20.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:20 smithi116 ceph-mon[31828]: pgmap v703: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:20.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:20 smithi082 ceph-mon[28404]: pgmap v703: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:22.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:22 smithi130 ceph-mon[32417]: pgmap v704: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:22 smithi116 ceph-mon[31828]: pgmap v704: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:22 smithi082 ceph-mon[28404]: pgmap v704: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:24.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:24 smithi130 ceph-mon[32417]: pgmap v705: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:24 smithi116 ceph-mon[31828]: pgmap v705: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:24.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:24 smithi082 ceph-mon[28404]: pgmap v705: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:26 smithi116 ceph-mon[31828]: pgmap v706: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:26.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:26 smithi082 ceph-mon[28404]: pgmap v706: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:26 smithi130 ceph-mon[32417]: pgmap v706: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:28 smithi116 ceph-mon[31828]: pgmap v707: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:28 smithi082 ceph-mon[28404]: pgmap v707: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:28 smithi130 ceph-mon[32417]: pgmap v707: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:30.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:30 smithi082 ceph-mon[28404]: pgmap v708: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:30.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:30 smithi130 ceph-mon[32417]: pgmap v708: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:30.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:30 smithi116 ceph-mon[31828]: pgmap v708: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:32.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:32 smithi082 ceph-mon[28404]: pgmap v709: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:32 smithi130 ceph-mon[32417]: pgmap v709: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:32 smithi116 ceph-mon[31828]: pgmap v709: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:34.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:34 smithi082 ceph-mon[28404]: pgmap v710: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:34 smithi130 ceph-mon[32417]: pgmap v710: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:34 smithi116 ceph-mon[31828]: pgmap v710: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:36.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:36 smithi130 ceph-mon[32417]: pgmap v711: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:36 smithi116 ceph-mon[31828]: pgmap v711: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:36 smithi082 ceph-mon[28404]: pgmap v711: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:38.488 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:38 smithi116 ceph-mon[31828]: pgmap v712: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:38 smithi130 ceph-mon[32417]: pgmap v712: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:38.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:38 smithi082 ceph-mon[28404]: pgmap v712: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:40.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:40 smithi130 ceph-mon[32417]: pgmap v713: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:40.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:40 smithi116 ceph-mon[31828]: pgmap v713: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:40 smithi082 ceph-mon[28404]: pgmap v713: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:42 smithi130 ceph-mon[32417]: pgmap v714: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:42 smithi116 ceph-mon[31828]: pgmap v714: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:42.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:42 smithi082 ceph-mon[28404]: pgmap v714: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:44 smithi130 ceph-mon[32417]: pgmap v715: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:44.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:44 smithi116 ceph-mon[31828]: pgmap v715: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:44.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:44 smithi082 ceph-mon[28404]: pgmap v715: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:46 smithi130 ceph-mon[32417]: pgmap v716: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:46 smithi116 ceph-mon[31828]: pgmap v716: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:46 smithi082 ceph-mon[28404]: pgmap v716: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:48 smithi130 ceph-mon[32417]: pgmap v717: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:48 smithi116 ceph-mon[31828]: pgmap v717: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:48.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:48 smithi082 ceph-mon[28404]: pgmap v717: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:50 smithi130 ceph-mon[32417]: pgmap v718: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:50 smithi116 ceph-mon[31828]: pgmap v718: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:50 smithi082 ceph-mon[28404]: pgmap v718: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:23:52.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:52 smithi116 ceph-mon[31828]: pgmap v719: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:52.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:52 smithi082 ceph-mon[28404]: pgmap v719: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:52 smithi130 ceph-mon[32417]: pgmap v719: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:23:54.580 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:54 smithi130 ceph-mon[32417]: pgmap v720: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:54.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:54 smithi116 ceph-mon[31828]: pgmap v720: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:54 smithi082 ceph-mon[28404]: pgmap v720: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:23:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:56 smithi116 ceph-mon[31828]: pgmap v721: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:56.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:56 smithi082 ceph-mon[28404]: pgmap v721: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:56 smithi130 ceph-mon[32417]: pgmap v721: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:23:58.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:23:58 smithi116 ceph-mon[31828]: pgmap v722: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:58.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:23:58 smithi082 ceph-mon[28404]: pgmap v722: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:23:58.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:23:58 smithi130 ceph-mon[32417]: pgmap v722: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:00.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:00 smithi116 ceph-mon[31828]: pgmap v723: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:00.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:00 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:24:00.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:00 smithi082 ceph-mon[28404]: pgmap v723: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:00.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:00 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:24:00.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:00 smithi130 ceph-mon[32417]: pgmap v723: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:00.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:00 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:24:02.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:01 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.186 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:01 smithi116 ceph-mon[31828]: pgmap v724: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:02.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:01 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:01 smithi082 ceph-mon[28404]: pgmap v724: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:02.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:01 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:02.278 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:01 smithi130 ceph-mon[32417]: pgmap v724: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:03.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:02 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:24:03.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:02 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:24:03.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:02 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:03.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:02 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:24:03.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:02 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:24:03.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:02 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:03.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:02 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:24:03.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:02 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:24:03.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:02 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:24:04.128 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:03 smithi082 ceph-mon[28404]: pgmap v725: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:04.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:03 smithi116 ceph-mon[31828]: pgmap v725: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:04.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:03 smithi130 ceph-mon[32417]: pgmap v725: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:06.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:05 smithi130 ceph-mon[32417]: pgmap v726: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:05 smithi116 ceph-mon[31828]: pgmap v726: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:06.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:05 smithi082 ceph-mon[28404]: pgmap v726: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:08.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:08 smithi130 ceph-mon[32417]: pgmap v727: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:08.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:08 smithi116 ceph-mon[31828]: pgmap v727: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:08 smithi082 ceph-mon[28404]: pgmap v727: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:10.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:10 smithi130 ceph-mon[32417]: pgmap v728: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:10 smithi116 ceph-mon[31828]: pgmap v728: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:10.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:10 smithi082 ceph-mon[28404]: pgmap v728: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:12.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:12 smithi130 ceph-mon[32417]: pgmap v729: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:12.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:12 smithi116 ceph-mon[31828]: pgmap v729: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:12 smithi082 ceph-mon[28404]: pgmap v729: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:14.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:14 smithi116 ceph-mon[31828]: pgmap v730: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:14.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:14 smithi082 ceph-mon[28404]: pgmap v730: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:14.529 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:14 smithi130 ceph-mon[32417]: pgmap v730: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:16.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:16 smithi116 ceph-mon[31828]: pgmap v731: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:16.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:16 smithi082 ceph-mon[28404]: pgmap v731: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:16 smithi130 ceph-mon[32417]: pgmap v731: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:18.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:18 smithi116 ceph-mon[31828]: pgmap v732: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:18.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:18 smithi082 ceph-mon[28404]: pgmap v732: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:18.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:18 smithi130 ceph-mon[32417]: pgmap v732: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:20.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:20 smithi116 ceph-mon[31828]: pgmap v733: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:20.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:20 smithi082 ceph-mon[28404]: pgmap v733: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:20 smithi130 ceph-mon[32417]: pgmap v733: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:21.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:24:21.216+0000 7ffbb4c00640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb90005850 con 0x7ffbb81067e0 2024-05-03T22:24:21.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:24:21.217+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 8 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7ffb90005850 con 0x7ffbb81067e0 2024-05-03T22:24:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:22 smithi116 ceph-mon[31828]: pgmap v734: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:22 smithi082 ceph-mon[28404]: pgmap v734: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:22 smithi130 ceph-mon[32417]: pgmap v734: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:24.330 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:24 smithi130 ceph-mon[32417]: pgmap v735: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:24.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:24 smithi116 ceph-mon[31828]: pgmap v735: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:24.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:24 smithi082 ceph-mon[28404]: pgmap v735: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:26.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:26 smithi116 ceph-mon[31828]: pgmap v736: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:26.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:26 smithi082 ceph-mon[28404]: pgmap v736: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:26 smithi130 ceph-mon[32417]: pgmap v736: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:28.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:28 smithi116 ceph-mon[31828]: pgmap v737: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:28 smithi082 ceph-mon[28404]: pgmap v737: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:28 smithi130 ceph-mon[32417]: pgmap v737: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:30.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:30 smithi116 ceph-mon[31828]: pgmap v738: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:30.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:30 smithi082 ceph-mon[28404]: pgmap v738: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:30.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:30 smithi130 ceph-mon[32417]: pgmap v738: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:32.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:32 smithi116 ceph-mon[31828]: pgmap v739: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:32.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:32 smithi082 ceph-mon[28404]: pgmap v739: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:32 smithi130 ceph-mon[32417]: pgmap v739: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:34.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:34 smithi116 ceph-mon[31828]: pgmap v740: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:34.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:34 smithi082 ceph-mon[28404]: pgmap v740: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:34 smithi130 ceph-mon[32417]: pgmap v740: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:36.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:36 smithi116 ceph-mon[31828]: pgmap v741: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:36.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:36 smithi082 ceph-mon[28404]: pgmap v741: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:36.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:36 smithi130 ceph-mon[32417]: pgmap v741: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:38.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:38 smithi116 ceph-mon[31828]: pgmap v742: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:38 smithi082 ceph-mon[28404]: pgmap v742: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:38 smithi130 ceph-mon[32417]: pgmap v742: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:40.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:40 smithi116 ceph-mon[31828]: pgmap v743: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:40.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:40 smithi082 ceph-mon[28404]: pgmap v743: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:40.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:40 smithi130 ceph-mon[32417]: pgmap v743: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:42 smithi116 ceph-mon[31828]: pgmap v744: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:42.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:42 smithi082 ceph-mon[28404]: pgmap v744: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:42 smithi130 ceph-mon[32417]: pgmap v744: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:44 smithi116 ceph-mon[31828]: pgmap v745: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:44 smithi082 ceph-mon[28404]: pgmap v745: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:44 smithi130 ceph-mon[32417]: pgmap v745: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:46 smithi116 ceph-mon[31828]: pgmap v746: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:46 smithi082 ceph-mon[28404]: pgmap v746: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:46 smithi130 ceph-mon[32417]: pgmap v746: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:48 smithi116 ceph-mon[31828]: pgmap v747: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:48 smithi082 ceph-mon[28404]: pgmap v747: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:48 smithi130 ceph-mon[32417]: pgmap v747: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:50.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:50 smithi116 ceph-mon[31828]: pgmap v748: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:50 smithi082 ceph-mon[28404]: pgmap v748: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:50 smithi130 ceph-mon[32417]: pgmap v748: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:24:52.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:52 smithi116 ceph-mon[31828]: pgmap v749: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:52 smithi082 ceph-mon[28404]: pgmap v749: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:52 smithi130 ceph-mon[32417]: pgmap v749: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:24:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:54 smithi116 ceph-mon[31828]: pgmap v750: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:54.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:54 smithi082 ceph-mon[28404]: pgmap v750: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:54.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:54 smithi130 ceph-mon[32417]: pgmap v750: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:24:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:56 smithi116 ceph-mon[31828]: pgmap v751: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:56 smithi082 ceph-mon[28404]: pgmap v751: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:56 smithi130 ceph-mon[32417]: pgmap v751: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:24:58.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:24:58 smithi116 ceph-mon[31828]: pgmap v752: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:58.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:24:58 smithi082 ceph-mon[28404]: pgmap v752: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:24:58.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:24:58 smithi130 ceph-mon[32417]: pgmap v752: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:00 smithi116 ceph-mon[31828]: pgmap v753: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:00.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:00 smithi082 ceph-mon[28404]: pgmap v753: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:00 smithi130 ceph-mon[32417]: pgmap v753: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:02 smithi116 ceph-mon[31828]: pgmap v754: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:02 smithi082 ceph-mon[28404]: pgmap v754: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:02 smithi130 ceph-mon[32417]: pgmap v754: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:03.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:03 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:25:03.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:03 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:25:03.684 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:03 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:25:04.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:04 smithi082 ceph-mon[28404]: pgmap v755: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:04.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:04 smithi130 ceph-mon[32417]: pgmap v755: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:04.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:04 smithi116 ceph-mon[31828]: pgmap v755: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:06 smithi116 ceph-mon[31828]: pgmap v756: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:06 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:06 smithi082 ceph-mon[28404]: pgmap v756: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:06.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:06 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:06 smithi130 ceph-mon[32417]: pgmap v756: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:06.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:06.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:06 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:07.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:07 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:25:07.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:07 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:25:07.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:07 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:07.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:07 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:25:07.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:07 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:25:07.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:07 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:07.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:07 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:25:07.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:07 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:25:07.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:07 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:25:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:08 smithi116 ceph-mon[31828]: pgmap v757: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:08.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:08 smithi082 ceph-mon[28404]: pgmap v757: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:08.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:08 smithi130 ceph-mon[32417]: pgmap v757: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:10.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:10 smithi116 ceph-mon[31828]: pgmap v758: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:10 smithi082 ceph-mon[28404]: pgmap v758: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:10 smithi130 ceph-mon[32417]: pgmap v758: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:12 smithi082 ceph-mon[28404]: pgmap v759: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:12.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:12 smithi130 ceph-mon[32417]: pgmap v759: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:12.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:12 smithi116 ceph-mon[31828]: pgmap v759: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:14 smithi082 ceph-mon[28404]: pgmap v760: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:14.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:14 smithi130 ceph-mon[32417]: pgmap v760: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:14.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:14 smithi116 ceph-mon[31828]: pgmap v760: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:16 smithi082 ceph-mon[28404]: pgmap v761: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:16.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:16 smithi130 ceph-mon[32417]: pgmap v761: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:16.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:16 smithi116 ceph-mon[31828]: pgmap v761: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:18 smithi082 ceph-mon[28404]: pgmap v762: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:18 smithi130 ceph-mon[32417]: pgmap v762: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:18.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:18 smithi116 ceph-mon[31828]: pgmap v762: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:20 smithi082 ceph-mon[28404]: pgmap v763: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:20 smithi130 ceph-mon[32417]: pgmap v763: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:20.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:20 smithi116 ceph-mon[31828]: pgmap v763: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:22.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:22 smithi082 ceph-mon[28404]: pgmap v764: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:22 smithi130 ceph-mon[32417]: pgmap v764: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:22.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:22 smithi116 ceph-mon[31828]: pgmap v764: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:24.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:24 smithi130 ceph-mon[32417]: pgmap v765: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:24.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:24 smithi116 ceph-mon[31828]: pgmap v765: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:24.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:24 smithi082 ceph-mon[28404]: pgmap v765: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:26.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:26 smithi130 ceph-mon[32417]: pgmap v766: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:26.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:26 smithi116 ceph-mon[31828]: pgmap v766: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:26.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:26 smithi082 ceph-mon[28404]: pgmap v766: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:28.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:28 smithi130 ceph-mon[32417]: pgmap v767: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:28.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:28 smithi116 ceph-mon[31828]: pgmap v767: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:28.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:28 smithi082 ceph-mon[28404]: pgmap v767: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:30.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:30 smithi130 ceph-mon[32417]: pgmap v768: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:30.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:30 smithi116 ceph-mon[31828]: pgmap v768: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:30.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:30 smithi082 ceph-mon[28404]: pgmap v768: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:32 smithi130 ceph-mon[32417]: pgmap v769: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:32.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:32 smithi116 ceph-mon[31828]: pgmap v769: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:32.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:32 smithi082 ceph-mon[28404]: pgmap v769: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:33.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:33 smithi116 ceph-mon[31828]: pgmap v770: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:33.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:33 smithi082 ceph-mon[28404]: pgmap v770: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:34.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:33 smithi130 ceph-mon[32417]: pgmap v770: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:36.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:36 smithi116 ceph-mon[31828]: pgmap v771: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:36.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:36 smithi082 ceph-mon[28404]: pgmap v771: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:36.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:36 smithi130 ceph-mon[32417]: pgmap v771: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:38.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:38 smithi116 ceph-mon[31828]: pgmap v772: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:38 smithi082 ceph-mon[28404]: pgmap v772: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:38 smithi130 ceph-mon[32417]: pgmap v772: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:40.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:40 smithi116 ceph-mon[31828]: pgmap v773: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:40.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:40 smithi082 ceph-mon[28404]: pgmap v773: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:40.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:40 smithi130 ceph-mon[32417]: pgmap v773: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:42.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:42 smithi116 ceph-mon[31828]: pgmap v774: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:42.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:42 smithi082 ceph-mon[28404]: pgmap v774: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:42 smithi130 ceph-mon[32417]: pgmap v774: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:44.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:44 smithi116 ceph-mon[31828]: pgmap v775: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:44 smithi082 ceph-mon[28404]: pgmap v775: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:44 smithi130 ceph-mon[32417]: pgmap v775: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:46.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:46 smithi116 ceph-mon[31828]: pgmap v776: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:46.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:46 smithi082 ceph-mon[28404]: pgmap v776: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:46 smithi130 ceph-mon[32417]: pgmap v776: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:48.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:48 smithi116 ceph-mon[31828]: pgmap v777: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:48.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:48 smithi082 ceph-mon[28404]: pgmap v777: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:48 smithi130 ceph-mon[32417]: pgmap v777: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:50.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:50 smithi116 ceph-mon[31828]: pgmap v778: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:50.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:50 smithi082 ceph-mon[28404]: pgmap v778: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:50 smithi130 ceph-mon[32417]: pgmap v778: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:25:52.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:52 smithi116 ceph-mon[31828]: pgmap v779: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:52 smithi082 ceph-mon[28404]: pgmap v779: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:52 smithi130 ceph-mon[32417]: pgmap v779: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:25:54.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:54 smithi116 ceph-mon[31828]: pgmap v780: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:54.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:54 smithi082 ceph-mon[28404]: pgmap v780: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:54.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:54 smithi130 ceph-mon[32417]: pgmap v780: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:25:56.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:56 smithi116 ceph-mon[31828]: pgmap v781: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:56 smithi082 ceph-mon[28404]: pgmap v781: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:56 smithi130 ceph-mon[32417]: pgmap v781: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:25:58.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:25:58 smithi116 ceph-mon[31828]: pgmap v782: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:58.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:25:58 smithi082 ceph-mon[28404]: pgmap v782: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:25:58.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:25:58 smithi130 ceph-mon[32417]: pgmap v782: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:26:00.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:00 smithi116 ceph-mon[31828]: pgmap v783: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:00.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:00 smithi082 ceph-mon[28404]: pgmap v783: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:00 smithi130 ceph-mon[32417]: pgmap v783: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:02.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:02 smithi116 ceph-mon[31828]: pgmap v784: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:26:02.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:02 smithi082 ceph-mon[28404]: pgmap v784: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:26:02.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:02 smithi130 ceph-mon[32417]: pgmap v784: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:26:04.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:04 smithi116 ceph-mon[31828]: pgmap v785: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:04 smithi082 ceph-mon[28404]: pgmap v785: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:04 smithi130 ceph-mon[32417]: pgmap v785: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:06 smithi116 ceph-mon[31828]: pgmap v786: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:06 smithi082 ceph-mon[28404]: pgmap v786: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:06.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:06 smithi130 ceph-mon[32417]: pgmap v786: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:08.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:08 smithi116 ceph-mon[31828]: pgmap v787: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:26:08.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:08 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:26:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:08 smithi082 ceph-mon[28404]: pgmap v787: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:26:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:08 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:26:08.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:08 smithi130 ceph-mon[32417]: pgmap v787: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:26:08.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:08 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:26:09.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:09 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:26:09.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:09 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:26:09.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:09 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:26:09.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:09 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:26:09.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:09 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:26:09.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:09 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:26:09.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:09 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:26:09.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:09 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:26:09.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:09 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:26:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:10 smithi116 ceph-mon[31828]: pgmap v788: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:10.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:10 smithi082 ceph-mon[28404]: pgmap v788: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:10.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:10 smithi130 ceph-mon[32417]: pgmap v788: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:12.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:12 smithi116 ceph-mon[31828]: pgmap v789: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:26:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:12 smithi082 ceph-mon[28404]: pgmap v789: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:26:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:12 smithi130 ceph-mon[32417]: pgmap v789: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:26:14.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:14 smithi116 ceph-mon[31828]: pgmap v790: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:26:14.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:14 smithi082 ceph-mon[28404]: pgmap v790: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:26:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:14 smithi130 ceph-mon[32417]: pgmap v790: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:26:16.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:16 smithi116 ceph-mon[31828]: pgmap v791: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:26:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:16 smithi082 ceph-mon[28404]: pgmap v791: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:26:16.530 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:16 smithi130 ceph-mon[32417]: pgmap v791: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:26:18.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:18 smithi082 ceph-mon[28404]: pgmap v792: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:26:18.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:18 smithi130 ceph-mon[32417]: pgmap v792: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:26:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:18 smithi116 ceph-mon[31828]: pgmap v792: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:26:20.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:20 smithi082 ceph-mon[28404]: pgmap v793: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T22:26:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:20 smithi130 ceph-mon[32417]: pgmap v793: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T22:26:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:20 smithi116 ceph-mon[31828]: pgmap v793: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T22:26:22.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:22 smithi082 ceph-mon[28404]: pgmap v794: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:26:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:22 smithi130 ceph-mon[32417]: pgmap v794: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:26:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:22 smithi116 ceph-mon[31828]: pgmap v794: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:26:24.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:24 smithi082 ceph-mon[28404]: pgmap v795: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:24 smithi130 ceph-mon[32417]: pgmap v795: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:24 smithi116 ceph-mon[31828]: pgmap v795: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:26.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:26 smithi082 ceph-mon[28404]: pgmap v796: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:26 smithi130 ceph-mon[32417]: pgmap v796: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:26.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:26 smithi116 ceph-mon[31828]: pgmap v796: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:28.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:28 smithi082 ceph-mon[28404]: pgmap v797: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:26:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:28 smithi130 ceph-mon[32417]: pgmap v797: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:26:28.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:28 smithi116 ceph-mon[31828]: pgmap v797: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:26:30.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:30 smithi130 ceph-mon[32417]: pgmap v798: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:30.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:30 smithi116 ceph-mon[31828]: pgmap v798: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:30.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:30 smithi082 ceph-mon[28404]: pgmap v798: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:32 smithi130 ceph-mon[32417]: pgmap v799: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:26:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:32 smithi116 ceph-mon[31828]: pgmap v799: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:26:32.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:32 smithi082 ceph-mon[28404]: pgmap v799: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:26:34.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:34 smithi130 ceph-mon[32417]: pgmap v800: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:34 smithi116 ceph-mon[31828]: pgmap v800: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:34 smithi082 ceph-mon[28404]: pgmap v800: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:36.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:26:36.238+0000 7ffbb4c00640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7ffb90005b70 con 0x7ffbb81067e0 2024-05-03T22:26:36.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:26:36.239+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7ffb90005b70 con 0x7ffbb81067e0 2024-05-03T22:26:36.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:36 smithi130 ceph-mon[32417]: pgmap v801: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:36.529 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:36 smithi082 ceph-mon[28404]: pgmap v801: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:36 smithi116 ceph-mon[31828]: pgmap v801: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:38.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:38 smithi130 ceph-mon[32417]: pgmap v802: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:26:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:38 smithi116 ceph-mon[31828]: pgmap v802: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:26:38.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:38 smithi082 ceph-mon[28404]: pgmap v802: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:26:40.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:40 smithi130 ceph-mon[32417]: pgmap v803: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:40.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:40 smithi116 ceph-mon[31828]: pgmap v803: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:40 smithi082 ceph-mon[28404]: pgmap v803: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:26:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:42 smithi130 ceph-mon[32417]: pgmap v804: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:26:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:42 smithi116 ceph-mon[31828]: pgmap v804: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:26:42.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:42 smithi082 ceph-mon[28404]: pgmap v804: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:26:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:44 smithi130 ceph-mon[32417]: pgmap v805: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:44.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:44 smithi116 ceph-mon[31828]: pgmap v805: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:44.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:44 smithi082 ceph-mon[28404]: pgmap v805: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:26:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:46 smithi116 ceph-mon[31828]: pgmap v806: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:46 smithi082 ceph-mon[28404]: pgmap v806: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:46.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:46 smithi130 ceph-mon[32417]: pgmap v806: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:26:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:48 smithi116 ceph-mon[31828]: pgmap v807: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:26:48.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:48 smithi082 ceph-mon[28404]: pgmap v807: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:26:48.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:48 smithi130 ceph-mon[32417]: pgmap v807: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:26:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:50 smithi116 ceph-mon[31828]: pgmap v808: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:26:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:50 smithi082 ceph-mon[28404]: pgmap v808: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:26:50.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:50 smithi130 ceph-mon[32417]: pgmap v808: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:26:52.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:52 smithi116 ceph-mon[31828]: pgmap v809: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:26:52.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:52 smithi082 ceph-mon[28404]: pgmap v809: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:26:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:52 smithi130 ceph-mon[32417]: pgmap v809: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:26:54.580 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:54 smithi130 ceph-mon[32417]: pgmap v810: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:26:54.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:54 smithi116 ceph-mon[31828]: pgmap v810: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:26:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:54 smithi082 ceph-mon[28404]: pgmap v810: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:26:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:56 smithi116 ceph-mon[31828]: pgmap v811: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:26:56.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:56 smithi082 ceph-mon[28404]: pgmap v811: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:26:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:56 smithi130 ceph-mon[32417]: pgmap v811: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:26:58.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:26:58 smithi116 ceph-mon[31828]: pgmap v812: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:26:58.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:26:58 smithi082 ceph-mon[28404]: pgmap v812: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:26:58.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:26:58 smithi130 ceph-mon[32417]: pgmap v812: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:27:00.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:00 smithi116 ceph-mon[31828]: pgmap v813: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:00.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:00 smithi082 ceph-mon[28404]: pgmap v813: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:00.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:00 smithi130 ceph-mon[32417]: pgmap v813: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:02.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:02 smithi116 ceph-mon[31828]: pgmap v814: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:02.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:02 smithi082 ceph-mon[28404]: pgmap v814: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:02.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:02 smithi130 ceph-mon[32417]: pgmap v814: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:04.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:04 smithi116 ceph-mon[31828]: pgmap v815: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:04.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:04 smithi082 ceph-mon[28404]: pgmap v815: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:04.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:04 smithi130 ceph-mon[32417]: pgmap v815: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:06 smithi116 ceph-mon[31828]: pgmap v816: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:06.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:06 smithi082 ceph-mon[28404]: pgmap v816: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:06 smithi130 ceph-mon[32417]: pgmap v816: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:08 smithi116 ceph-mon[31828]: pgmap v817: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:08.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:08 smithi082 ceph-mon[28404]: pgmap v817: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:08.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:08 smithi130 ceph-mon[32417]: pgmap v817: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:09.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:09 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:27:09.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:09 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:27:09.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:09 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:27:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:10 smithi116 ceph-mon[31828]: pgmap v818: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:10 smithi082 ceph-mon[28404]: pgmap v818: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:10 smithi130 ceph-mon[32417]: pgmap v818: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:11 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:27:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:11 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:27:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:11 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:27:11.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:11 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:27:11.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:11 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:27:11.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:11 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:27:11.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:11 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:27:11.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:11 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:27:11.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:11 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:27:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:12 smithi116 ceph-mon[31828]: pgmap v819: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:12 smithi082 ceph-mon[28404]: pgmap v819: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:12.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:12 smithi130 ceph-mon[32417]: pgmap v819: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:14.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:14 smithi116 ceph-mon[31828]: pgmap v820: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:14 smithi082 ceph-mon[28404]: pgmap v820: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:14.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:14 smithi130 ceph-mon[32417]: pgmap v820: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:16.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:16 smithi116 ceph-mon[31828]: pgmap v821: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:16 smithi082 ceph-mon[28404]: pgmap v821: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:16.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:16 smithi130 ceph-mon[32417]: pgmap v821: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:18.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:18 smithi116 ceph-mon[31828]: pgmap v822: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:18 smithi082 ceph-mon[28404]: pgmap v822: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:18 smithi130 ceph-mon[32417]: pgmap v822: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:20 smithi116 ceph-mon[31828]: pgmap v823: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:20 smithi082 ceph-mon[28404]: pgmap v823: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:20 smithi130 ceph-mon[32417]: pgmap v823: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:21.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:27:21.245+0000 7ffbb4c00640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb90005ed0 con 0x7ffbb81067e0 2024-05-03T22:27:21.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:27:21.246+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7ffb90005ed0 con 0x7ffbb81067e0 2024-05-03T22:27:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:22 smithi116 ceph-mon[31828]: pgmap v824: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:22.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:22 smithi082 ceph-mon[28404]: pgmap v824: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:22 smithi130 ceph-mon[32417]: pgmap v824: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:24 smithi116 ceph-mon[31828]: pgmap v825: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:24.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:24 smithi082 ceph-mon[28404]: pgmap v825: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:24.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:24 smithi130 ceph-mon[32417]: pgmap v825: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:26.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:26 smithi116 ceph-mon[31828]: pgmap v826: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:26.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:26 smithi082 ceph-mon[28404]: pgmap v826: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:26.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:26 smithi130 ceph-mon[32417]: pgmap v826: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:28.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:28 smithi116 ceph-mon[31828]: pgmap v827: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:28 smithi082 ceph-mon[28404]: pgmap v827: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:28.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:28 smithi130 ceph-mon[32417]: pgmap v827: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:30.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:30 smithi116 ceph-mon[31828]: pgmap v828: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:30.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:30 smithi082 ceph-mon[28404]: pgmap v828: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:30.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:30 smithi130 ceph-mon[32417]: pgmap v828: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:32 smithi116 ceph-mon[31828]: pgmap v829: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:32.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:32 smithi082 ceph-mon[28404]: pgmap v829: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:32 smithi130 ceph-mon[32417]: pgmap v829: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:34 smithi082 ceph-mon[28404]: pgmap v830: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:34.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:34 smithi130 ceph-mon[32417]: pgmap v830: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:34.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:34 smithi116 ceph-mon[31828]: pgmap v830: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:36 smithi082 ceph-mon[28404]: pgmap v831: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:36.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:36 smithi130 ceph-mon[32417]: pgmap v831: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:36.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:36 smithi116 ceph-mon[31828]: pgmap v831: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:38.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:38 smithi082 ceph-mon[28404]: pgmap v832: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:38.737 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:38 smithi116 ceph-mon[31828]: pgmap v832: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:38 smithi130 ceph-mon[32417]: pgmap v832: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:40 smithi082 ceph-mon[28404]: pgmap v833: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:40.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:40 smithi130 ceph-mon[32417]: pgmap v833: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:40.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:40 smithi116 ceph-mon[31828]: pgmap v833: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:42.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:42 smithi082 ceph-mon[28404]: pgmap v834: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:42 smithi130 ceph-mon[32417]: pgmap v834: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:42.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:42 smithi116 ceph-mon[31828]: pgmap v834: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:44.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:44 smithi082 ceph-mon[28404]: pgmap v835: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:44.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:44 smithi130 ceph-mon[32417]: pgmap v835: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:44.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:44 smithi116 ceph-mon[31828]: pgmap v835: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:46.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:46 smithi130 ceph-mon[32417]: pgmap v836: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:46.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:46 smithi116 ceph-mon[31828]: pgmap v836: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:46.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:46 smithi082 ceph-mon[28404]: pgmap v836: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:48.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:48 smithi130 ceph-mon[32417]: pgmap v837: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:48.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:48 smithi116 ceph-mon[31828]: pgmap v837: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:48.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:48 smithi082 ceph-mon[28404]: pgmap v837: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:50.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:50 smithi130 ceph-mon[32417]: pgmap v838: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:50.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:50 smithi116 ceph-mon[31828]: pgmap v838: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:50.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:50 smithi082 ceph-mon[28404]: pgmap v838: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:27:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:52 smithi130 ceph-mon[32417]: pgmap v839: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:52.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:52 smithi116 ceph-mon[31828]: pgmap v839: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:52.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:52 smithi082 ceph-mon[28404]: pgmap v839: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:27:54.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:54 smithi130 ceph-mon[32417]: pgmap v840: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:54.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:54 smithi116 ceph-mon[31828]: pgmap v840: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:54.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:54 smithi082 ceph-mon[28404]: pgmap v840: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:27:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:56 smithi130 ceph-mon[32417]: pgmap v841: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:56.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:56 smithi116 ceph-mon[31828]: pgmap v841: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:56.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:56 smithi082 ceph-mon[28404]: pgmap v841: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:27:58.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:27:58 smithi130 ceph-mon[32417]: pgmap v842: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:58.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:27:58 smithi116 ceph-mon[31828]: pgmap v842: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:27:58.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:27:58 smithi082 ceph-mon[28404]: pgmap v842: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:00.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:00 smithi130 ceph-mon[32417]: pgmap v843: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:00.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:00 smithi116 ceph-mon[31828]: pgmap v843: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:00.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:00 smithi082 ceph-mon[28404]: pgmap v843: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:02.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:02 smithi116 ceph-mon[31828]: pgmap v844: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:02.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:02 smithi082 ceph-mon[28404]: pgmap v844: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:03.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:02 smithi130 ceph-mon[32417]: pgmap v844: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:04.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:04 smithi116 ceph-mon[31828]: pgmap v845: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:04.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:04 smithi082 ceph-mon[28404]: pgmap v845: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:05.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:04 smithi130 ceph-mon[32417]: pgmap v845: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:05.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:05 smithi116 ceph-mon[31828]: pgmap v846: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:05.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:05 smithi082 ceph-mon[28404]: pgmap v846: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:06.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:05 smithi130 ceph-mon[32417]: pgmap v846: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:08.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:08 smithi116 ceph-mon[31828]: pgmap v847: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:08 smithi082 ceph-mon[28404]: pgmap v847: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:08.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:08 smithi130 ceph-mon[32417]: pgmap v847: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:10 smithi116 ceph-mon[31828]: pgmap v848: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:10 smithi082 ceph-mon[28404]: pgmap v848: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:10 smithi130 ceph-mon[32417]: pgmap v848: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:11.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:11 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:28:11.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:11 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:28:11.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:11 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:28:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:12 smithi116 ceph-mon[31828]: pgmap v849: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:12 smithi082 ceph-mon[28404]: pgmap v849: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:12.776 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:12 smithi130 ceph-mon[32417]: pgmap v849: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:13.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:28:13.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:28:13.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:28:13.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:28:13.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:28:13.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:28:13.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:28:13.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:28:13.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:28:14.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:14 smithi116 ceph-mon[31828]: pgmap v850: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:28:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:14 smithi082 ceph-mon[28404]: pgmap v850: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:28:14.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:14 smithi130 ceph-mon[32417]: pgmap v850: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:28:16.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:16 smithi116 ceph-mon[31828]: pgmap v851: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:28:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:16 smithi082 ceph-mon[28404]: pgmap v851: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:28:16.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:16 smithi130 ceph-mon[32417]: pgmap v851: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:28:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:18 smithi116 ceph-mon[31828]: pgmap v852: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:28:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:18 smithi082 ceph-mon[28404]: pgmap v852: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:28:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:18 smithi130 ceph-mon[32417]: pgmap v852: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:28:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:20 smithi116 ceph-mon[31828]: pgmap v853: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:28:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:20 smithi082 ceph-mon[28404]: pgmap v853: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:28:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:20 smithi130 ceph-mon[32417]: pgmap v853: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:28:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:22 smithi116 ceph-mon[31828]: pgmap v854: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:28:22.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:22 smithi082 ceph-mon[28404]: pgmap v854: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:28:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:22 smithi130 ceph-mon[32417]: pgmap v854: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:28:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:24 smithi116 ceph-mon[31828]: pgmap v855: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:28:24.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:24 smithi082 ceph-mon[28404]: pgmap v855: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:28:24.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:24 smithi130 ceph-mon[32417]: pgmap v855: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:28:26.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:26 smithi082 ceph-mon[28404]: pgmap v856: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:28:26.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:26 smithi130 ceph-mon[32417]: pgmap v856: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:28:26.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:26 smithi116 ceph-mon[31828]: pgmap v856: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:28:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:28 smithi082 ceph-mon[28404]: pgmap v857: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:28:28.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:28 smithi130 ceph-mon[32417]: pgmap v857: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:28:28.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:28 smithi116 ceph-mon[31828]: pgmap v857: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:28:30.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:30 smithi082 ceph-mon[28404]: pgmap v858: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:28:30.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:30 smithi130 ceph-mon[32417]: pgmap v858: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:28:30.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:30 smithi116 ceph-mon[31828]: pgmap v858: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:28:32.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:32 smithi082 ceph-mon[28404]: pgmap v859: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:28:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:32 smithi130 ceph-mon[32417]: pgmap v859: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:28:32.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:32 smithi116 ceph-mon[31828]: pgmap v859: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:28:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:34 smithi082 ceph-mon[28404]: pgmap v860: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:34.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:34 smithi130 ceph-mon[32417]: pgmap v860: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:34.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:34 smithi116 ceph-mon[31828]: pgmap v860: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:36 smithi082 ceph-mon[28404]: pgmap v861: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:36.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:36 smithi130 ceph-mon[32417]: pgmap v861: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:36.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:36 smithi116 ceph-mon[31828]: pgmap v861: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:38.738 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:38 smithi116 ceph-mon[31828]: pgmap v862: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:38 smithi130 ceph-mon[32417]: pgmap v862: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:38.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:38 smithi082 ceph-mon[28404]: pgmap v862: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:40.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:40 smithi130 ceph-mon[32417]: pgmap v863: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:40.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:40 smithi116 ceph-mon[31828]: pgmap v863: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:40.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:40 smithi082 ceph-mon[28404]: pgmap v863: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:42 smithi130 ceph-mon[32417]: pgmap v864: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:42.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:42 smithi116 ceph-mon[31828]: pgmap v864: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:42.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:42 smithi082 ceph-mon[28404]: pgmap v864: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:44.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:44 smithi130 ceph-mon[32417]: pgmap v865: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:44.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:44 smithi116 ceph-mon[31828]: pgmap v865: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:44.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:44 smithi082 ceph-mon[28404]: pgmap v865: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:46.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:46 smithi130 ceph-mon[32417]: pgmap v866: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:46.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:46 smithi116 ceph-mon[31828]: pgmap v866: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:46.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:46 smithi082 ceph-mon[28404]: pgmap v866: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:48.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:48 smithi130 ceph-mon[32417]: pgmap v867: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:48.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:48 smithi116 ceph-mon[31828]: pgmap v867: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:48.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:48 smithi082 ceph-mon[28404]: pgmap v867: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:50.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:50 smithi130 ceph-mon[32417]: pgmap v868: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:50.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:50 smithi116 ceph-mon[31828]: pgmap v868: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:50.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:50 smithi082 ceph-mon[28404]: pgmap v868: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:28:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:52 smithi130 ceph-mon[32417]: pgmap v869: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:52.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:52 smithi116 ceph-mon[31828]: pgmap v869: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:52.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:52 smithi082 ceph-mon[28404]: pgmap v869: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:28:54.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:54 smithi116 ceph-mon[31828]: pgmap v870: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:54.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:54 smithi082 ceph-mon[28404]: pgmap v870: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:55.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:54 smithi130 ceph-mon[32417]: pgmap v870: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:28:56.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:56 smithi116 ceph-mon[31828]: pgmap v871: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:56.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:56 smithi082 ceph-mon[28404]: pgmap v871: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:57.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:56 smithi130 ceph-mon[32417]: pgmap v871: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:28:58.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:28:58 smithi116 ceph-mon[31828]: pgmap v872: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:58.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:28:58 smithi082 ceph-mon[28404]: pgmap v872: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:28:59.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:28:58 smithi130 ceph-mon[32417]: pgmap v872: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:00.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:00 smithi116 ceph-mon[31828]: pgmap v873: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:00.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:00 smithi082 ceph-mon[28404]: pgmap v873: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:01.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:00 smithi130 ceph-mon[32417]: pgmap v873: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:01.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:01 smithi116 ceph-mon[31828]: pgmap v874: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:01.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:01 smithi082 ceph-mon[28404]: pgmap v874: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:02.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:01 smithi130 ceph-mon[32417]: pgmap v874: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:04.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:04 smithi116 ceph-mon[31828]: pgmap v875: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:04.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:04 smithi082 ceph-mon[28404]: pgmap v875: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:04.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:04 smithi130 ceph-mon[32417]: pgmap v875: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:06.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:06 smithi116 ceph-mon[31828]: pgmap v876: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:06 smithi082 ceph-mon[28404]: pgmap v876: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:06.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:06 smithi130 ceph-mon[32417]: pgmap v876: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:08.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:08 smithi116 ceph-mon[31828]: pgmap v877: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:08.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:08 smithi082 ceph-mon[28404]: pgmap v877: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:08.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:08 smithi130 ceph-mon[32417]: pgmap v877: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:10.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:10 smithi116 ceph-mon[31828]: pgmap v878: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:10.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:10 smithi082 ceph-mon[28404]: pgmap v878: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:10.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:10 smithi130 ceph-mon[32417]: pgmap v878: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:12.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:12 smithi082 ceph-mon[28404]: pgmap v879: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:12.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:12 smithi130 ceph-mon[32417]: pgmap v879: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:12 smithi116 ceph-mon[31828]: pgmap v879: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:13.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:13 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:29:13.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:13 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:29:13.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:13 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:29:14.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:14 smithi082 ceph-mon[28404]: pgmap v880: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:14.526 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:14 smithi130 ceph-mon[32417]: pgmap v880: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:14.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:14 smithi116 ceph-mon[31828]: pgmap v880: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:15.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:29:15.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:29:15.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:29:15.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:29:15.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:29:15.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:29:15.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:29:15.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:29:15.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:29:16.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:16 smithi082 ceph-mon[28404]: pgmap v881: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:16.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:16 smithi130 ceph-mon[32417]: pgmap v881: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:16.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:16 smithi116 ceph-mon[31828]: pgmap v881: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:18.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:18 smithi130 ceph-mon[32417]: pgmap v882: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:18 smithi116 ceph-mon[31828]: pgmap v882: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:18 smithi082 ceph-mon[28404]: pgmap v882: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:20.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:20 smithi130 ceph-mon[32417]: pgmap v883: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:20 smithi116 ceph-mon[31828]: pgmap v883: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:20 smithi082 ceph-mon[28404]: pgmap v883: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:22.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:22 smithi130 ceph-mon[32417]: pgmap v884: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:22.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:22 smithi116 ceph-mon[31828]: pgmap v884: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:22.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:22 smithi082 ceph-mon[28404]: pgmap v884: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:24.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:24 smithi130 ceph-mon[32417]: pgmap v885: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:24 smithi116 ceph-mon[31828]: pgmap v885: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:24.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:24 smithi082 ceph-mon[28404]: pgmap v885: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:26.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:26 smithi130 ceph-mon[32417]: pgmap v886: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:26.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:26 smithi116 ceph-mon[31828]: pgmap v886: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:26.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:26 smithi082 ceph-mon[28404]: pgmap v886: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:28.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:28 smithi130 ceph-mon[32417]: pgmap v887: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:28.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:28 smithi116 ceph-mon[31828]: pgmap v887: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:28 smithi082 ceph-mon[28404]: pgmap v887: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:30.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:30 smithi116 ceph-mon[31828]: pgmap v888: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:30.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:30 smithi082 ceph-mon[28404]: pgmap v888: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:30.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:30 smithi130 ceph-mon[32417]: pgmap v888: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:32 smithi116 ceph-mon[31828]: pgmap v889: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:32.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:32 smithi082 ceph-mon[28404]: pgmap v889: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:32 smithi130 ceph-mon[32417]: pgmap v889: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:34 smithi116 ceph-mon[31828]: pgmap v890: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:34.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:34 smithi082 ceph-mon[28404]: pgmap v890: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:34.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:34 smithi130 ceph-mon[32417]: pgmap v890: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:36 smithi116 ceph-mon[31828]: pgmap v891: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:36 smithi082 ceph-mon[28404]: pgmap v891: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:36.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:36 smithi130 ceph-mon[32417]: pgmap v891: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:38 smithi116 ceph-mon[31828]: pgmap v892: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:38.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:38 smithi082 ceph-mon[28404]: pgmap v892: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:38 smithi130 ceph-mon[32417]: pgmap v892: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:40.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:40 smithi116 ceph-mon[31828]: pgmap v893: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:40 smithi082 ceph-mon[28404]: pgmap v893: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:40.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:40 smithi130 ceph-mon[32417]: pgmap v893: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:42 smithi116 ceph-mon[31828]: pgmap v894: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:42.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:42 smithi082 ceph-mon[28404]: pgmap v894: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:42 smithi130 ceph-mon[32417]: pgmap v894: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:44.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:44 smithi116 ceph-mon[31828]: pgmap v895: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:44.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:44 smithi082 ceph-mon[28404]: pgmap v895: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:44.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:44 smithi130 ceph-mon[32417]: pgmap v895: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:46 smithi116 ceph-mon[31828]: pgmap v896: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:46 smithi082 ceph-mon[28404]: pgmap v896: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:46.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:46 smithi130 ceph-mon[32417]: pgmap v896: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:48 smithi116 ceph-mon[31828]: pgmap v897: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:48.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:48 smithi082 ceph-mon[28404]: pgmap v897: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:48.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:48 smithi130 ceph-mon[32417]: pgmap v897: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:50 smithi116 ceph-mon[31828]: pgmap v898: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:50 smithi082 ceph-mon[28404]: pgmap v898: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:50.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:50 smithi130 ceph-mon[32417]: pgmap v898: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:29:52.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:52 smithi116 ceph-mon[31828]: pgmap v899: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:52.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:52 smithi082 ceph-mon[28404]: pgmap v899: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:52 smithi130 ceph-mon[32417]: pgmap v899: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:29:54.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:54 smithi116 ceph-mon[31828]: pgmap v900: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:54 smithi082 ceph-mon[28404]: pgmap v900: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:54.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:54 smithi130 ceph-mon[32417]: pgmap v900: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:29:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:56 smithi116 ceph-mon[31828]: pgmap v901: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:56.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:56 smithi082 ceph-mon[28404]: pgmap v901: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:56 smithi130 ceph-mon[32417]: pgmap v901: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:29:58.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:29:58 smithi082 ceph-mon[28404]: pgmap v902: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:58.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:29:58 smithi130 ceph-mon[32417]: pgmap v902: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:29:58.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:29:58 smithi116 ceph-mon[31828]: pgmap v902: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:00.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:00 smithi082 ceph-mon[28404]: pgmap v903: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:00.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:00 smithi082 ceph-mon[28404]: overall HEALTH_OK 2024-05-03T22:30:00.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:00 smithi130 ceph-mon[32417]: pgmap v903: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:00.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:00 smithi130 ceph-mon[32417]: overall HEALTH_OK 2024-05-03T22:30:00.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:00 smithi116 ceph-mon[31828]: pgmap v903: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:00.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:00 smithi116 ceph-mon[31828]: overall HEALTH_OK 2024-05-03T22:30:02.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:02 smithi082 ceph-mon[28404]: pgmap v904: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:02.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:02 smithi130 ceph-mon[32417]: pgmap v904: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:02.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:02 smithi116 ceph-mon[31828]: pgmap v904: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:04.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:04 smithi082 ceph-mon[28404]: pgmap v905: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:04.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:04 smithi130 ceph-mon[32417]: pgmap v905: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:04.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:04 smithi116 ceph-mon[31828]: pgmap v905: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:06.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:06 smithi082 ceph-mon[28404]: pgmap v906: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:06 smithi130 ceph-mon[32417]: pgmap v906: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:06.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:06 smithi116 ceph-mon[31828]: pgmap v906: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:08.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:08 smithi082 ceph-mon[28404]: pgmap v907: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:08.738 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:08 smithi116 ceph-mon[31828]: pgmap v907: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:08.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:08 smithi130 ceph-mon[32417]: pgmap v907: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:10 smithi130 ceph-mon[32417]: pgmap v908: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:10.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:10 smithi116 ceph-mon[31828]: pgmap v908: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:10.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:10 smithi082 ceph-mon[28404]: pgmap v908: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:12.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:12 smithi130 ceph-mon[32417]: pgmap v909: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:12.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:12 smithi116 ceph-mon[31828]: pgmap v909: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:12.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:12 smithi082 ceph-mon[28404]: pgmap v909: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:14.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:14 smithi130 ceph-mon[32417]: pgmap v910: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:14.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:14 smithi116 ceph-mon[31828]: pgmap v910: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:14.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:14 smithi082 ceph-mon[28404]: pgmap v910: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:15.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:15 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:30:15.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:15 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:30:15.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:15 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:30:16.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:16 smithi130 ceph-mon[32417]: pgmap v911: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:16.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:16 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:30:16.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:16 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:30:16.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:16 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:30:16.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:16 smithi116 ceph-mon[31828]: pgmap v911: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:16.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:16 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:30:16.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:16 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:30:16.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:16 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:30:16.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:16 smithi082 ceph-mon[28404]: pgmap v911: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:16.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:16 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:30:16.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:16 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:30:16.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:16 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:30:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:18 smithi130 ceph-mon[32417]: pgmap v912: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:18.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:18 smithi116 ceph-mon[31828]: pgmap v912: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:18.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:18 smithi082 ceph-mon[28404]: pgmap v912: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:20 smithi130 ceph-mon[32417]: pgmap v913: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:20.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:20 smithi116 ceph-mon[31828]: pgmap v913: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:20.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:20 smithi082 ceph-mon[28404]: pgmap v913: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:21.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:30:21.274+0000 7ffbb4c00640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb900060f0 con 0x7ffbb81067e0 2024-05-03T22:30:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:30:21.275+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7ffb900060f0 con 0x7ffbb81067e0 2024-05-03T22:30:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:22 smithi130 ceph-mon[32417]: pgmap v914: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:22.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:22 smithi116 ceph-mon[31828]: pgmap v914: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:22 smithi082 ceph-mon[28404]: pgmap v914: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:24.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:24 smithi116 ceph-mon[31828]: pgmap v915: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:24.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:24 smithi082 ceph-mon[28404]: pgmap v915: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:25.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:24 smithi130 ceph-mon[32417]: pgmap v915: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:26.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:26 smithi116 ceph-mon[31828]: pgmap v916: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:26.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:26 smithi082 ceph-mon[28404]: pgmap v916: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:27.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:26 smithi130 ceph-mon[32417]: pgmap v916: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:28.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:28 smithi116 ceph-mon[31828]: pgmap v917: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:28.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:28 smithi082 ceph-mon[28404]: pgmap v917: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:29.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:28 smithi130 ceph-mon[32417]: pgmap v917: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:30.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:30 smithi116 ceph-mon[31828]: pgmap v918: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:30.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:30 smithi082 ceph-mon[28404]: pgmap v918: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:31.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:30 smithi130 ceph-mon[32417]: pgmap v918: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:32.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:32 smithi116 ceph-mon[31828]: pgmap v919: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:32.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:32 smithi082 ceph-mon[28404]: pgmap v919: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:33.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:32 smithi130 ceph-mon[32417]: pgmap v919: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:34.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:34 smithi116 ceph-mon[31828]: pgmap v920: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:34.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:34 smithi082 ceph-mon[28404]: pgmap v920: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:35.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:34 smithi130 ceph-mon[32417]: pgmap v920: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:36.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:36 smithi116 ceph-mon[31828]: pgmap v921: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:36.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:36 smithi082 ceph-mon[28404]: pgmap v921: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:37.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:36 smithi130 ceph-mon[32417]: pgmap v921: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:37.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:37 smithi116 ceph-mon[31828]: pgmap v922: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:37.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:37 smithi082 ceph-mon[28404]: pgmap v922: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:38.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:37 smithi130 ceph-mon[32417]: pgmap v922: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:40.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:40 smithi082 ceph-mon[28404]: pgmap v923: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:40.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:40 smithi130 ceph-mon[32417]: pgmap v923: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:40.639 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:40 smithi116 ceph-mon[31828]: pgmap v923: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:30:42.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:42 smithi082 ceph-mon[28404]: pgmap v924: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:42.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:42 smithi130 ceph-mon[32417]: pgmap v924: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:42 smithi116 ceph-mon[31828]: pgmap v924: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:44.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:44 smithi082 ceph-mon[28404]: pgmap v925: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:44.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:44 smithi130 ceph-mon[32417]: pgmap v925: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:44.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:44 smithi116 ceph-mon[31828]: pgmap v925: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:46.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:46 smithi130 ceph-mon[32417]: pgmap v926: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:46 smithi116 ceph-mon[31828]: pgmap v926: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:46 smithi082 ceph-mon[28404]: pgmap v926: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:48.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:48 smithi130 ceph-mon[32417]: pgmap v927: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:48 smithi116 ceph-mon[31828]: pgmap v927: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:48.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:48 smithi082 ceph-mon[28404]: pgmap v927: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:50.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:50 smithi130 ceph-mon[32417]: pgmap v928: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:50 smithi116 ceph-mon[31828]: pgmap v928: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:50 smithi082 ceph-mon[28404]: pgmap v928: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:52.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:52 smithi082 ceph-mon[28404]: pgmap v929: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:52.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:52 smithi130 ceph-mon[32417]: pgmap v929: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:52.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:52 smithi116 ceph-mon[31828]: pgmap v929: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:30:54.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:54 smithi130 ceph-mon[32417]: pgmap v930: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:54.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:54 smithi116 ceph-mon[31828]: pgmap v930: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:54 smithi082 ceph-mon[28404]: pgmap v930: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:30:56.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:56 smithi130 ceph-mon[32417]: pgmap v931: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:56 smithi116 ceph-mon[31828]: pgmap v931: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:56.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:56 smithi082 ceph-mon[28404]: pgmap v931: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:30:58.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:30:58 smithi130 ceph-mon[32417]: pgmap v932: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:58.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:30:58 smithi116 ceph-mon[31828]: pgmap v932: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:30:58.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:30:58 smithi082 ceph-mon[28404]: pgmap v932: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:00.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:00 smithi130 ceph-mon[32417]: pgmap v933: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:00.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:00 smithi116 ceph-mon[31828]: pgmap v933: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:00.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:00 smithi082 ceph-mon[28404]: pgmap v933: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:02.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:02 smithi116 ceph-mon[31828]: pgmap v934: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:02.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:02 smithi082 ceph-mon[28404]: pgmap v934: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:02.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:02 smithi130 ceph-mon[32417]: pgmap v934: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:04.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:04 smithi116 ceph-mon[31828]: pgmap v935: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:04.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:04 smithi082 ceph-mon[28404]: pgmap v935: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:04.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:04 smithi130 ceph-mon[32417]: pgmap v935: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:06 smithi116 ceph-mon[31828]: pgmap v936: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:06.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:06 smithi082 ceph-mon[28404]: pgmap v936: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:06 smithi130 ceph-mon[32417]: pgmap v936: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:08 smithi116 ceph-mon[31828]: pgmap v937: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:08.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:08 smithi082 ceph-mon[28404]: pgmap v937: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:08.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:08 smithi130 ceph-mon[32417]: pgmap v937: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:10 smithi116 ceph-mon[31828]: pgmap v938: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:10 smithi082 ceph-mon[28404]: pgmap v938: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:10 smithi130 ceph-mon[32417]: pgmap v938: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:12 smithi116 ceph-mon[31828]: pgmap v939: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:12 smithi082 ceph-mon[28404]: pgmap v939: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:12.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:12 smithi130 ceph-mon[32417]: pgmap v939: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:14.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:14 smithi116 ceph-mon[31828]: pgmap v940: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:14 smithi082 ceph-mon[28404]: pgmap v940: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:14.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:14 smithi130 ceph-mon[32417]: pgmap v940: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:16.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:16 smithi116 ceph-mon[31828]: pgmap v941: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:16 smithi082 ceph-mon[28404]: pgmap v941: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:16.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:16 smithi130 ceph-mon[32417]: pgmap v941: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:17.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:17 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:17.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:17 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:17.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:17 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:18.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: pgmap v942: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:18.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:18.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:18.687 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: pgmap v942: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:18.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:31:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: pgmap v942: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:18.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:18.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:18.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:18.779 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:31:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:19 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi116 to 176.4M 2024-05-03T22:31:19.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:19 smithi116 ceph-mon[31828]: Unable to set osd_memory_target on smithi116 to 185061990: error parsing value: Value '185061990' is below minimum 939524096 2024-05-03T22:31:19.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:19 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-03T22:31:19.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:19 smithi116 ceph-mon[31828]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-03T22:31:19.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:19 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi116 to 176.4M 2024-05-03T22:31:19.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:19 smithi082 ceph-mon[28404]: Unable to set osd_memory_target on smithi116 to 185061990: error parsing value: Value '185061990' is below minimum 939524096 2024-05-03T22:31:19.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:19 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-03T22:31:19.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:19 smithi082 ceph-mon[28404]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-03T22:31:19.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:19 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi116 to 176.4M 2024-05-03T22:31:19.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:19 smithi130 ceph-mon[32417]: Unable to set osd_memory_target on smithi116 to 185061990: error parsing value: Value '185061990' is below minimum 939524096 2024-05-03T22:31:19.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:19 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-03T22:31:19.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:19 smithi130 ceph-mon[32417]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-03T22:31:20.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:20 smithi116 ceph-mon[31828]: pgmap v943: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:20.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:20 smithi082 ceph-mon[28404]: pgmap v943: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:20 smithi130 ceph-mon[32417]: pgmap v943: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:22.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:22 smithi116 ceph-mon[31828]: pgmap v944: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:22.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:22 smithi082 ceph-mon[28404]: pgmap v944: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:22.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:22 smithi130 ceph-mon[32417]: pgmap v944: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:24 smithi116 ceph-mon[31828]: pgmap v945: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:24.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:24 smithi082 ceph-mon[28404]: pgmap v945: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:24.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:24 smithi130 ceph-mon[32417]: pgmap v945: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:26.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:26 smithi116 ceph-mon[31828]: pgmap v946: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:26.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:26 smithi082 ceph-mon[28404]: pgmap v946: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:26.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:26 smithi130 ceph-mon[32417]: pgmap v946: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:28.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:28 smithi116 ceph-mon[31828]: pgmap v947: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:28 smithi082 ceph-mon[28404]: pgmap v947: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:28.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:28 smithi130 ceph-mon[32417]: pgmap v947: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:30.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:30 smithi116 ceph-mon[31828]: pgmap v948: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:30.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:30 smithi082 ceph-mon[28404]: pgmap v948: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:30.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:30 smithi130 ceph-mon[32417]: pgmap v948: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:32 smithi116 ceph-mon[31828]: pgmap v949: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:31:32.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:32 smithi082 ceph-mon[28404]: pgmap v949: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:31:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:32 smithi130 ceph-mon[32417]: pgmap v949: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:31:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:34 smithi116 ceph-mon[31828]: pgmap v950: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:31:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:34 smithi082 ceph-mon[28404]: pgmap v950: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:31:34.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:34 smithi130 ceph-mon[32417]: pgmap v950: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:31:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:36 smithi116 ceph-mon[31828]: pgmap v951: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:31:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:36 smithi082 ceph-mon[28404]: pgmap v951: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:31:36.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:36 smithi130 ceph-mon[32417]: pgmap v951: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:31:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:38 smithi116 ceph-mon[31828]: pgmap v952: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:31:38.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:38 smithi082 ceph-mon[28404]: pgmap v952: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:31:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:38 smithi130 ceph-mon[32417]: pgmap v952: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:31:40.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:40 smithi116 ceph-mon[31828]: pgmap v953: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:31:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:40 smithi082 ceph-mon[28404]: pgmap v953: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:31:40.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:40 smithi130 ceph-mon[32417]: pgmap v953: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:31:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:42 smithi116 ceph-mon[31828]: pgmap v954: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:31:42.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:42 smithi082 ceph-mon[28404]: pgmap v954: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:31:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:42 smithi130 ceph-mon[32417]: pgmap v954: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:31:44.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:44 smithi082 ceph-mon[28404]: pgmap v955: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:44.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:44 smithi130 ceph-mon[32417]: pgmap v955: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:44.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:44 smithi116 ceph-mon[31828]: pgmap v955: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:46 smithi082 ceph-mon[28404]: pgmap v956: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:46.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:46 smithi130 ceph-mon[32417]: pgmap v956: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:46.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:46 smithi116 ceph-mon[31828]: pgmap v956: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:48.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:48 smithi082 ceph-mon[28404]: pgmap v957: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:48.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:48 smithi130 ceph-mon[32417]: pgmap v957: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:48.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:48 smithi116 ceph-mon[31828]: pgmap v957: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:50 smithi082 ceph-mon[28404]: pgmap v958: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:50.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:50 smithi130 ceph-mon[32417]: pgmap v958: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:50.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:50 smithi116 ceph-mon[31828]: pgmap v958: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:52.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:52 smithi082 ceph-mon[28404]: pgmap v959: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:52 smithi130 ceph-mon[32417]: pgmap v959: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:52.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:52 smithi116 ceph-mon[31828]: pgmap v959: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:31:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:54 smithi082 ceph-mon[28404]: pgmap v960: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:54.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:54 smithi130 ceph-mon[32417]: pgmap v960: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:54.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:54 smithi116 ceph-mon[31828]: pgmap v960: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:31:56.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:56 smithi082 ceph-mon[28404]: pgmap v961: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:56 smithi130 ceph-mon[32417]: pgmap v961: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:56.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:56 smithi116 ceph-mon[31828]: pgmap v961: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:31:58.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:31:58 smithi130 ceph-mon[32417]: pgmap v962: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:58.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:31:58 smithi116 ceph-mon[31828]: pgmap v962: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:31:58.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:31:58 smithi082 ceph-mon[28404]: pgmap v962: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:00.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:00 smithi130 ceph-mon[32417]: pgmap v963: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:00.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:00 smithi116 ceph-mon[31828]: pgmap v963: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:00.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:00 smithi082 ceph-mon[28404]: pgmap v963: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:02.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:02 smithi130 ceph-mon[32417]: pgmap v964: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:02.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:02 smithi116 ceph-mon[31828]: pgmap v964: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:02.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:02 smithi082 ceph-mon[28404]: pgmap v964: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:04.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:04 smithi130 ceph-mon[32417]: pgmap v965: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:04.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:04 smithi116 ceph-mon[31828]: pgmap v965: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:04.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:04 smithi082 ceph-mon[28404]: pgmap v965: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:06 smithi130 ceph-mon[32417]: pgmap v966: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:06.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:06 smithi116 ceph-mon[31828]: pgmap v966: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:06.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:06 smithi082 ceph-mon[28404]: pgmap v966: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:08.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:08 smithi130 ceph-mon[32417]: pgmap v967: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:08.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:08 smithi116 ceph-mon[31828]: pgmap v967: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:08.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:08 smithi082 ceph-mon[28404]: pgmap v967: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:10 smithi130 ceph-mon[32417]: pgmap v968: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:10.779 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:10 smithi082 ceph-mon[28404]: pgmap v968: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:10.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:10 smithi116 ceph-mon[31828]: pgmap v968: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:12.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:12 smithi130 ceph-mon[32417]: pgmap v969: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:12.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:12 smithi116 ceph-mon[31828]: pgmap v969: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:12.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:12 smithi082 ceph-mon[28404]: pgmap v969: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:14.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:14 smithi116 ceph-mon[31828]: pgmap v970: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:14.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:14 smithi082 ceph-mon[28404]: pgmap v970: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:15.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:14 smithi130 ceph-mon[32417]: pgmap v970: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:16.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:16 smithi116 ceph-mon[31828]: pgmap v971: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:16.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:16 smithi082 ceph-mon[28404]: pgmap v971: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:17.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:16 smithi130 ceph-mon[32417]: pgmap v971: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:18.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:18 smithi116 ceph-mon[31828]: pgmap v972: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:18.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:18 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:18.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:18 smithi082 ceph-mon[28404]: pgmap v972: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:18.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:18 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:19.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:18 smithi130 ceph-mon[32417]: pgmap v972: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:19.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:18 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:20.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:20 smithi116 ceph-mon[31828]: pgmap v973: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:20.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:20.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:20.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:20.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:20.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:20.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:20.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:32:20.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:20 smithi082 ceph-mon[28404]: pgmap v973: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:20.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:20.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:20.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:20.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:20.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:20.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:20.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:32:21.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:20 smithi130 ceph-mon[32417]: pgmap v973: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:21.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:21.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:21.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:21.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:21.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:21.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:21.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:32:21.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:21 smithi116 ceph-mon[31828]: Adjusting osd_memory_target on smithi130 to 176.4M 2024-05-03T22:32:21.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:21 smithi116 ceph-mon[31828]: Unable to set osd_memory_target on smithi130 to 185046937: error parsing value: Value '185046937' is below minimum 939524096 2024-05-03T22:32:21.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:21 smithi082 ceph-mon[28404]: Adjusting osd_memory_target on smithi130 to 176.4M 2024-05-03T22:32:21.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:21 smithi082 ceph-mon[28404]: Unable to set osd_memory_target on smithi130 to 185046937: error parsing value: Value '185046937' is below minimum 939524096 2024-05-03T22:32:22.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:21 smithi130 ceph-mon[32417]: Adjusting osd_memory_target on smithi130 to 176.4M 2024-05-03T22:32:22.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:21 smithi130 ceph-mon[32417]: Unable to set osd_memory_target on smithi130 to 185046937: error parsing value: Value '185046937' is below minimum 939524096 2024-05-03T22:32:22.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:22 smithi116 ceph-mon[31828]: pgmap v974: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:22 smithi082 ceph-mon[28404]: pgmap v974: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:23.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:22 smithi130 ceph-mon[32417]: pgmap v974: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:24.830 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:24 smithi130 ceph-mon[32417]: pgmap v975: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:24.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:24 smithi116 ceph-mon[31828]: pgmap v975: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:24.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:24 smithi082 ceph-mon[28404]: pgmap v975: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:26.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:26 smithi116 ceph-mon[31828]: pgmap v976: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:26.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:26 smithi082 ceph-mon[28404]: pgmap v976: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:27.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:26 smithi130 ceph-mon[32417]: pgmap v976: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:28.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:28 smithi116 ceph-mon[31828]: pgmap v977: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:28.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:28 smithi082 ceph-mon[28404]: pgmap v977: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:29.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:28 smithi130 ceph-mon[32417]: pgmap v977: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:29.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:29 smithi116 ceph-mon[31828]: pgmap v978: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:29.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:29 smithi082 ceph-mon[28404]: pgmap v978: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:30.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:29 smithi130 ceph-mon[32417]: pgmap v978: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:32.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:32 smithi130 ceph-mon[32417]: pgmap v979: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:32.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:32 smithi116 ceph-mon[31828]: pgmap v979: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:32.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:32 smithi082 ceph-mon[28404]: pgmap v979: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:34.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:34 smithi116 ceph-mon[31828]: pgmap v980: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:34 smithi082 ceph-mon[28404]: pgmap v980: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:34.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:34 smithi130 ceph-mon[32417]: pgmap v980: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:36.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:36 smithi116 ceph-mon[31828]: pgmap v981: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:36 smithi082 ceph-mon[28404]: pgmap v981: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:36.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:36 smithi130 ceph-mon[32417]: pgmap v981: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:38.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:38 smithi116 ceph-mon[31828]: pgmap v982: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:32:38.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:38 smithi082 ceph-mon[28404]: pgmap v982: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:32:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:38 smithi130 ceph-mon[32417]: pgmap v982: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:32:40.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:40 smithi116 ceph-mon[31828]: pgmap v983: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:32:40.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:40 smithi082 ceph-mon[28404]: pgmap v983: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:32:40.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:40 smithi130 ceph-mon[32417]: pgmap v983: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:32:42.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:42 smithi116 ceph-mon[31828]: pgmap v984: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T22:32:42.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:42 smithi082 ceph-mon[28404]: pgmap v984: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T22:32:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:42 smithi130 ceph-mon[32417]: pgmap v984: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T22:32:44.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:44 smithi116 ceph-mon[31828]: pgmap v985: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:32:44.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:44 smithi082 ceph-mon[28404]: pgmap v985: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:32:44.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:44 smithi130 ceph-mon[32417]: pgmap v985: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:32:46.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:46 smithi116 ceph-mon[31828]: pgmap v986: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:32:46.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:46 smithi082 ceph-mon[28404]: pgmap v986: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:32:46.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:46 smithi130 ceph-mon[32417]: pgmap v986: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:32:48.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:48 smithi116 ceph-mon[31828]: pgmap v987: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:32:48.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:48 smithi082 ceph-mon[28404]: pgmap v987: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:32:48.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:48 smithi130 ceph-mon[32417]: pgmap v987: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:32:50.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:50 smithi116 ceph-mon[31828]: pgmap v988: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:50.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:50 smithi082 ceph-mon[28404]: pgmap v988: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:50.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:50 smithi130 ceph-mon[32417]: pgmap v988: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:52.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:52 smithi116 ceph-mon[31828]: pgmap v989: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:52.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:52 smithi082 ceph-mon[28404]: pgmap v989: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:52.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:52 smithi130 ceph-mon[32417]: pgmap v989: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:32:54.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:54 smithi116 ceph-mon[31828]: pgmap v990: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:54.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:54 smithi082 ceph-mon[28404]: pgmap v990: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:54.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:54 smithi130 ceph-mon[32417]: pgmap v990: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:32:56.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:56 smithi116 ceph-mon[31828]: pgmap v991: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:56.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:56 smithi082 ceph-mon[28404]: pgmap v991: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:56.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:56 smithi130 ceph-mon[32417]: pgmap v991: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:32:58.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:32:58 smithi116 ceph-mon[31828]: pgmap v992: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:58.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:32:58 smithi082 ceph-mon[28404]: pgmap v992: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:32:58.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:32:58 smithi130 ceph-mon[32417]: pgmap v992: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:33:00.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:00 smithi116 ceph-mon[31828]: pgmap v993: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:00.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:00 smithi082 ceph-mon[28404]: pgmap v993: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:00.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:00 smithi130 ceph-mon[32417]: pgmap v993: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:02.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:02 smithi116 ceph-mon[31828]: pgmap v994: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:33:02.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:02 smithi082 ceph-mon[28404]: pgmap v994: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:33:02.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:02 smithi130 ceph-mon[32417]: pgmap v994: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:33:04.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:04 smithi116 ceph-mon[31828]: pgmap v995: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:04.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:04 smithi082 ceph-mon[28404]: pgmap v995: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:04.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:04 smithi130 ceph-mon[32417]: pgmap v995: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:06.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:06 smithi116 ceph-mon[31828]: pgmap v996: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:33:06.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:06 smithi082 ceph-mon[28404]: pgmap v996: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:33:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:06 smithi130 ceph-mon[32417]: pgmap v996: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:33:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:08 smithi116 ceph-mon[31828]: pgmap v997: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:33:08.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:08 smithi082 ceph-mon[28404]: pgmap v997: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:33:08.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:08 smithi130 ceph-mon[32417]: pgmap v997: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:33:10.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:10 smithi116 ceph-mon[31828]: pgmap v998: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:10.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:10 smithi082 ceph-mon[28404]: pgmap v998: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:10.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:10 smithi130 ceph-mon[32417]: pgmap v998: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:12 smithi116 ceph-mon[31828]: pgmap v999: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:33:12.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:12 smithi082 ceph-mon[28404]: pgmap v999: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:33:12.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:12 smithi130 ceph-mon[32417]: pgmap v999: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:33:14.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:14 smithi116 ceph-mon[31828]: pgmap v1000: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:14.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:14 smithi082 ceph-mon[28404]: pgmap v1000: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:14.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:14 smithi130 ceph-mon[32417]: pgmap v1000: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:16.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:16 smithi116 ceph-mon[31828]: pgmap v1001: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:33:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:16 smithi082 ceph-mon[28404]: pgmap v1001: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:33:16.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:16 smithi130 ceph-mon[32417]: pgmap v1001: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:33:18.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:18 smithi116 ceph-mon[31828]: pgmap v1002: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:33:18.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:18 smithi082 ceph-mon[28404]: pgmap v1002: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:33:18.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:18 smithi130 ceph-mon[32417]: pgmap v1002: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:33:20.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:20 smithi082 ceph-mon[28404]: pgmap v1003: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:20.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:20 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:20 smithi130 ceph-mon[32417]: pgmap v1003: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:20.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:20 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:20.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:20 smithi116 ceph-mon[31828]: pgmap v1003: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:20.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:20 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:21.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:21.196+0000 7ffbbd000640 1 -- 172.21.15.82:0/2330129485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb9c0b29a0 msgr2=0x7ffb9c0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900029334) for more than 900000000 us, fault. 2024-05-03T22:33:21.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:21.196+0000 7ffbbd000640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb9c0b29a0 0x7ffb9c0b4e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffba8005fd0 tx=0x7ffba8005850 comp rx=0 tx=0).stop 2024-05-03T22:33:21.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:21.196+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb9c0b29a0 msgr2=0x7ffb9c0b4e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-03T22:33:21.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:21.196+0000 7ffbb6000640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb9c0b29a0 0x7ffb9c0b4e60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:21.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:21.196+0000 7ffbb6000640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb9c0be0d0 0x7ffb9c0c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:21.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:21.196+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7ffb9c0c0aa0 con 0x7ffb9c0be0d0 2024-05-03T22:33:21.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:21.196+0000 7ffbbd000640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb9c0be0d0 0x7ffb9c0c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:21.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:21.197+0000 7ffbbd000640 1 --2- 172.21.15.82:0/2330129485 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7ffb9c0be0d0 0x7ffb9c0c04c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffba800bbd0 tx=0x7ffba8014000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:21.302+0000 7ffbb4c00640 1 -- 172.21.15.82:0/2330129485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb90006360 con 0x7ffbb81067e0 2024-05-03T22:33:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:21.302+0000 7ffbb6000640 1 -- 172.21.15.82:0/2330129485 <== mon.0 v2:172.21.15.82:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7ffb90006360 con 0x7ffbb81067e0 2024-05-03T22:33:21.413 INFO:teuthology.orchestra.run.smithi082.stderr:Error ETIMEDOUT: Connection timed out. Please check the client's permission and connection. 2024-05-03T22:33:21.436 DEBUG:teuthology.orchestra.run:got remote process result: 110 2024-05-03T22:33:21.437 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/exec.py", line 66, in task remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 110: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10'" 2024-05-03T22:33:21.677 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=fe2bbb74be73486c81d9d6b476f6e580 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/exec.py", line 66, in task remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 110: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10'" 2024-05-03T22:33:21.679 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-03T22:33:21.688 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-03T22:33:21.688 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:33:21.689 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T22:33:21.741 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:33:21.741 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T22:33:21.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T22:33:22.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:21 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:22.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:21 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:22.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:21 smithi082 ceph-mon[28404]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:33:22.226 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:21 smithi082 ceph-mon[28404]: pgmap v1004: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:33:22.263 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:33:22.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:21 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:22.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:21 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:22.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:21 smithi130 ceph-mon[32417]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:33:22.277 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:21 smithi130 ceph-mon[32417]: pgmap v1004: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:33:22.435 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:21 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:22.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:21 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:22.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:21 smithi116 ceph-mon[31828]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:33:22.436 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:21 smithi116 ceph-mon[31828]: pgmap v1004: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:33:23.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:23 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:23.528 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:23 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:23.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:23 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:23.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:23 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:23.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:23 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:23.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:23 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:24.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:24 smithi082 ceph-mon[28404]: pgmap v1005: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:24.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:24.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:24.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:24.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:33:24.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:24 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:24.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.645+0000 7f9a11e00700 1 -- 172.21.15.82:0/1894802819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c108850 msgr2=0x7f9a0c1103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:24.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.645+0000 7f9a11e00700 1 --2- 172.21.15.82:0/1894802819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c108850 0x7f9a0c1103d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400b0d0 tx=0x7f9a0400b3e0 comp rx=0 tx=0).stop 2024-05-03T22:33:24.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.645+0000 7f9a11e00700 1 -- 172.21.15.82:0/1894802819 shutdown_connections 2024-05-03T22:33:24.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.645+0000 7f9a11e00700 1 --2- 172.21.15.82:0/1894802819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c108850 0x7f9a0c1103d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:24.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.645+0000 7f9a11e00700 1 --2- 172.21.15.82:0/1894802819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a0c103750 0x7f9a0c103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:24.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.645+0000 7f9a11e00700 1 --2- 172.21.15.82:0/1894802819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a0c104100 0x7f9a0c108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:24.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.645+0000 7f9a11e00700 1 -- 172.21.15.82:0/1894802819 >> 172.21.15.82:0/1894802819 conn(0x7f9a0c07a600 msgr2=0x7f9a0c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:24.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.645+0000 7f9a11e00700 1 -- 172.21.15.82:0/1894802819 shutdown_connections 2024-05-03T22:33:24.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.645+0000 7f9a11e00700 1 -- 172.21.15.82:0/1894802819 wait complete. 2024-05-03T22:33:24.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.647+0000 7f9a11e00700 1 Processor -- start 2024-05-03T22:33:24.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.647+0000 7f9a11e00700 1 -- start start 2024-05-03T22:33:24.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.647+0000 7f9a11e00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a0c103750 0x7f9a0c1a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:24.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.647+0000 7f9a11e00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a0c104100 0x7f9a0c1a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:24.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.647+0000 7f9a11e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c108850 0x7f9a0c19b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:24.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.647+0000 7f9a11e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c1134f0 con 0x7f9a0c108850 2024-05-03T22:33:24.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.647+0000 7f9a11e00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c113370 con 0x7f9a0c104100 2024-05-03T22:33:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.647+0000 7f9a11e00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c113670 con 0x7f9a0c103750 2024-05-03T22:33:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c108850 0x7f9a0c19b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c108850 0x7f9a0c19b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33010/0 (socket says 172.21.15.82:33010) 2024-05-03T22:33:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0b400700 1 -- 172.21.15.82:0/456281004 learned_addr learned my addr 172.21.15.82:0/456281004 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:33:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0aa00700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a0c103750 0x7f9a0c1a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0a000700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a0c104100 0x7f9a0c1a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0b400700 1 -- 172.21.15.82:0/456281004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a0c103750 msgr2=0x7f9a0c1a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0b400700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a0c103750 0x7f9a0c1a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:24.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0b400700 1 -- 172.21.15.82:0/456281004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a0c104100 msgr2=0x7f9a0c1a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:24.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0b400700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a0c104100 0x7f9a0c1a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:24.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0b400700 1 -- 172.21.15.82:0/456281004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c19c150 con 0x7f9a0c108850 2024-05-03T22:33:24.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0a000700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a0c104100 0x7f9a0c1a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:33:24.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.648+0000 7f9a0b400700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c108850 0x7f9a0c19b9f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009850 tx=0x7f9a04007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:24.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.649+0000 7f9a10a00700 1 -- 172.21.15.82:0/456281004 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0401f030 con 0x7f9a0c108850 2024-05-03T22:33:24.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.649+0000 7f9a10a00700 1 -- 172.21.15.82:0/456281004 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a0401bad0 con 0x7f9a0c108850 2024-05-03T22:33:24.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.649+0000 7f9a10a00700 1 -- 172.21.15.82:0/456281004 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04012bb0 con 0x7f9a0c108850 2024-05-03T22:33:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.649+0000 7f9a11e00700 1 -- 172.21.15.82:0/456281004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0c19c3e0 con 0x7f9a0c108850 2024-05-03T22:33:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.649+0000 7f9a11e00700 1 -- 172.21.15.82:0/456281004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0c1a8700 con 0x7f9a0c108850 2024-05-03T22:33:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.650+0000 7f9a11e00700 1 -- 172.21.15.82:0/456281004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0c104be0 con 0x7f9a0c108850 2024-05-03T22:33:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.652+0000 7f9a10a00700 1 -- 172.21.15.82:0/456281004 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9a04022030 con 0x7f9a0c108850 2024-05-03T22:33:24.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.654+0000 7f9a10a00700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f99f00b2990 0x7f99f00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:24.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.654+0000 7f9a10a00700 1 -- 172.21.15.82:0/456281004 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f9a040e3460 con 0x7f9a0c108850 2024-05-03T22:33:24.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.654+0000 7f9a0aa00700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f99f00b2990 0x7f99f00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:24.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.655+0000 7f9a0aa00700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f99f00b2990 0x7f99f00b4e50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99fc005950 tx=0x7f99fc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:24.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.660+0000 7f9a10a00700 1 -- 172.21.15.82:0/456281004 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9a040aac90 con 0x7f9a0c108850 2024-05-03T22:33:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:24 smithi116 ceph-mon[31828]: pgmap v1005: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:24.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:24.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:33:24.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:24 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:24.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:24 smithi130 ceph-mon[32417]: pgmap v1005: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:24.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:24.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:24.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:24.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:33:24.778 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:24 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' 2024-05-03T22:33:24.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.912+0000 7f9a11e00700 1 -- 172.21.15.82:0/456281004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9a0c1a88d0 con 0x7f9a0c108850 2024-05-03T22:33:24.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.913+0000 7f9a10a00700 1 -- 172.21.15.82:0/456281004 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v92) ==== 81+0+590 (secure 0 0 0) 0x7f9a040aa590 con 0x7f9a0c108850 2024-05-03T22:33:24.915 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1970560625 2024-05-04T22:02:36.416695+0000 2024-05-03T22:33:24.916 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/167294547 2024-05-04T22:02:36.416695+0000 2024-05-03T22:33:24.916 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/2219604538 2024-05-04T22:02:36.416695+0000 2024-05-03T22:33:24.916 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/2219604538 2024-05-04T22:02:36.416695+0000 2024-05-03T22:33:24.916 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3288839212 2024-05-04T22:02:00.707069+0000 2024-05-03T22:33:24.916 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1944232139 2024-05-04T22:02:00.707069+0000 2024-05-03T22:33:24.916 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/484754820 2024-05-04T22:02:00.707069+0000 2024-05-03T22:33:24.916 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1157601153 2024-05-04T22:02:00.707069+0000 2024-05-03T22:33:24.916 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1944232139 2024-05-04T22:02:00.707069+0000 2024-05-03T22:33:24.916 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2702343171 2024-05-04T22:02:36.416695+0000 2024-05-03T22:33:24.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.917+0000 7f9a11e00700 1 -- 172.21.15.82:0/456281004 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f99f00b2990 msgr2=0x7f99f00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:24.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.917+0000 7f9a11e00700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f99f00b2990 0x7f99f00b4e50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99fc005950 tx=0x7f99fc0058e0 comp rx=0 tx=0).stop 2024-05-03T22:33:24.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.917+0000 7f9a11e00700 1 -- 172.21.15.82:0/456281004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c108850 msgr2=0x7f9a0c19b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:24.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.917+0000 7f9a11e00700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c108850 0x7f9a0c19b9f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009850 tx=0x7f9a04007e40 comp rx=0 tx=0).stop 2024-05-03T22:33:24.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.918+0000 7f9a11e00700 1 -- 172.21.15.82:0/456281004 shutdown_connections 2024-05-03T22:33:24.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.918+0000 7f9a11e00700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f99f00b2990 0x7f99f00b4e50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:24.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.918+0000 7f9a11e00700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0c108850 0x7f9a0c19b9f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:24.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.918+0000 7f9a11e00700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a0c103750 0x7f9a0c1a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:24.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.918+0000 7f9a11e00700 1 --2- 172.21.15.82:0/456281004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a0c104100 0x7f9a0c1a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:24.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.918+0000 7f9a11e00700 1 -- 172.21.15.82:0/456281004 >> 172.21.15.82:0/456281004 conn(0x7f9a0c07a600 msgr2=0x7f9a0c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:24.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.918+0000 7f9a11e00700 1 -- 172.21.15.82:0/456281004 shutdown_connections 2024-05-03T22:33:24.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:24.918+0000 7f9a11e00700 1 -- 172.21.15.82:0/456281004 wait complete. 2024-05-03T22:33:24.922 INFO:teuthology.orchestra.run.smithi082.stderr:listed 10 entries 2024-05-03T22:33:25.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:25 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/456281004' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:33:25.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:25 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/456281004' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:33:25.728 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-03T22:33:25.728 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T22:33:25.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:25 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/456281004' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:33:25.780 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T22:33:26.248 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:33:26.608 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:26 smithi082 ceph-mon[28404]: pgmap v1006: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:33:26.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:26 smithi116 ceph-mon[31828]: pgmap v1006: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:33:26.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:26 smithi130 ceph-mon[32417]: pgmap v1006: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:33:28.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.481+0000 7f986a400700 1 -- 172.21.15.82:0/4171226592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f986410b6c0 msgr2=0x7f986410baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.481+0000 7f986a400700 1 --2- 172.21.15.82:0/4171226592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f986410b6c0 0x7f986410baa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9854009990 tx=0x7f9854009ca0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.481+0000 7f986a400700 1 -- 172.21.15.82:0/4171226592 shutdown_connections 2024-05-03T22:33:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.481+0000 7f986a400700 1 --2- 172.21.15.82:0/4171226592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f986410b6c0 0x7f986410baa0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.481+0000 7f986a400700 1 --2- 172.21.15.82:0/4171226592 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9864106080 0x7f9864112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.481+0000 7f986a400700 1 --2- 172.21.15.82:0/4171226592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98641056c0 0x7f9864105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.481+0000 7f986a400700 1 -- 172.21.15.82:0/4171226592 >> 172.21.15.82:0/4171226592 conn(0x7f98641011b0 msgr2=0x7f98641035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:28.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.481+0000 7f986a400700 1 -- 172.21.15.82:0/4171226592 shutdown_connections 2024-05-03T22:33:28.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.481+0000 7f986a400700 1 -- 172.21.15.82:0/4171226592 wait complete. 2024-05-03T22:33:28.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.483+0000 7f986a400700 1 Processor -- start 2024-05-03T22:33:28.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.483+0000 7f986a400700 1 -- start start 2024-05-03T22:33:28.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.483+0000 7f986a400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98641056c0 0x7f98641a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:28.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f986a400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9864106080 0x7f98641a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:28.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f986a400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f986410b6c0 0x7f986419bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:28.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f986a400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f98641157c0 con 0x7f9864106080 2024-05-03T22:33:28.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f986a400700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9864115640 con 0x7f98641056c0 2024-05-03T22:33:28.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f986a400700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9864115940 con 0x7f986410b6c0 2024-05-03T22:33:28.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f9862a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9864106080 0x7f98641a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:28.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f9862a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9864106080 0x7f98641a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33040/0 (socket says 172.21.15.82:33040) 2024-05-03T22:33:28.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f9862a00700 1 -- 172.21.15.82:0/1567307542 learned_addr learned my addr 172.21.15.82:0/1567307542 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:33:28.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f9863400700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98641056c0 0x7f98641a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:28.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f9863e00700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f986410b6c0 0x7f986419bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:28.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f9862a00700 1 -- 172.21.15.82:0/1567307542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f986410b6c0 msgr2=0x7f986419bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:28.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f9862a00700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f986410b6c0 0x7f986419bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f9862a00700 1 -- 172.21.15.82:0/1567307542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98641056c0 msgr2=0x7f98641a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:28.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.484+0000 7f9862a00700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98641056c0 0x7f98641a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.485+0000 7f9862a00700 1 -- 172.21.15.82:0/1567307542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986419c400 con 0x7f9864106080 2024-05-03T22:33:28.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.485+0000 7f9863400700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98641056c0 0x7f98641a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:33:28.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.485+0000 7f9862a00700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9864106080 0x7f98641a1f90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f985000c920 tx=0x7f985000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:28.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.485+0000 7f985be00700 1 -- 172.21.15.82:0/1567307542 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850007b00 con 0x7f9864106080 2024-05-03T22:33:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.485+0000 7f985be00700 1 -- 172.21.15.82:0/1567307542 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9850004cc0 con 0x7f9864106080 2024-05-03T22:33:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.485+0000 7f985be00700 1 -- 172.21.15.82:0/1567307542 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98500054f0 con 0x7f9864106080 2024-05-03T22:33:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.485+0000 7f986a400700 1 -- 172.21.15.82:0/1567307542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986419c6f0 con 0x7f9864106080 2024-05-03T22:33:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.485+0000 7f986a400700 1 -- 172.21.15.82:0/1567307542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98641a89d0 con 0x7f9864106080 2024-05-03T22:33:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.486+0000 7f986a400700 1 -- 172.21.15.82:0/1567307542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9864106e00 con 0x7f9864106080 2024-05-03T22:33:28.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.490+0000 7f985be00700 1 -- 172.21.15.82:0/1567307542 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9850007ca0 con 0x7f9864106080 2024-05-03T22:33:28.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.491+0000 7f985be00700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98480b2990 0x7f98480b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:28.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.491+0000 7f985be00700 1 -- 172.21.15.82:0/1567307542 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f98500e2770 con 0x7f9864106080 2024-05-03T22:33:28.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.491+0000 7f9863400700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98480b2990 0x7f98480b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.492+0000 7f9863400700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98480b2990 0x7f98480b4e50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f985400b5c0 tx=0x7f985401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.492+0000 7f985be00700 1 -- 172.21.15.82:0/1567307542 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9850014030 con 0x7f9864106080 2024-05-03T22:33:28.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:28 smithi116 ceph-mon[31828]: pgmap v1007: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:33:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:28 smithi082 ceph-mon[28404]: pgmap v1007: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:33:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.745+0000 7f986a400700 1 -- 172.21.15.82:0/1567307542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f986419cfe0 con 0x7f9864106080 2024-05-03T22:33:28.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.746+0000 7f985be00700 1 -- 172.21.15.82:0/1567307542 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v92) ==== 81+0+590 (secure 0 0 0) 0x7f98500a9f90 con 0x7f9864106080 2024-05-03T22:33:28.748 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1970560625 2024-05-04T22:02:36.416695+0000 2024-05-03T22:33:28.748 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/167294547 2024-05-04T22:02:36.416695+0000 2024-05-03T22:33:28.749 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/2219604538 2024-05-04T22:02:36.416695+0000 2024-05-03T22:33:28.749 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/2219604538 2024-05-04T22:02:36.416695+0000 2024-05-03T22:33:28.749 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3288839212 2024-05-04T22:02:00.707069+0000 2024-05-03T22:33:28.749 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1944232139 2024-05-04T22:02:00.707069+0000 2024-05-03T22:33:28.749 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/484754820 2024-05-04T22:02:00.707069+0000 2024-05-03T22:33:28.749 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1157601153 2024-05-04T22:02:00.707069+0000 2024-05-03T22:33:28.749 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1944232139 2024-05-04T22:02:00.707069+0000 2024-05-03T22:33:28.749 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2702343171 2024-05-04T22:02:36.416695+0000 2024-05-03T22:33:28.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 -- 172.21.15.82:0/1567307542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98480b2990 msgr2=0x7f98480b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:28.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98480b2990 0x7f98480b4e50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f985400b5c0 tx=0x7f985401a040 comp rx=0 tx=0).stop 2024-05-03T22:33:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 -- 172.21.15.82:0/1567307542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9864106080 msgr2=0x7f98641a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9864106080 0x7f98641a1f90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f985000c920 tx=0x7f985000cce0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 -- 172.21.15.82:0/1567307542 shutdown_connections 2024-05-03T22:33:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f98480b2990 0x7f98480b4e50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f986410b6c0 0x7f986419bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98641056c0 0x7f98641a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 --2- 172.21.15.82:0/1567307542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9864106080 0x7f98641a1f90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 -- 172.21.15.82:0/1567307542 >> 172.21.15.82:0/1567307542 conn(0x7f98641011b0 msgr2=0x7f98641019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 -- 172.21.15.82:0/1567307542 shutdown_connections 2024-05-03T22:33:28.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:28.749+0000 7f986a400700 1 -- 172.21.15.82:0/1567307542 wait complete. 2024-05-03T22:33:28.753 INFO:teuthology.orchestra.run.smithi082.stderr:listed 10 entries 2024-05-03T22:33:28.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:28 smithi130 ceph-mon[32417]: pgmap v1007: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:33:29.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:29 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1567307542' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:33:29.611 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-05-03T22:33:29.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:33:29.611 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-03T22:33:29.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:29 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1567307542' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:33:29.696 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[85900]: fuse finished with error 0 and tester_r 0 2024-05-03T22:33:29.700 INFO:teuthology.orchestra.run:waiting for 300 2024-05-03T22:33:29.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:29 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1567307542' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:33:30.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:30 smithi082 ceph-mon[28404]: pgmap v1008: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:30.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:30 smithi130 ceph-mon[32417]: pgmap v1008: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:30.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:30 smithi116 ceph-mon[31828]: pgmap v1008: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:33:32.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:32 smithi082 ceph-mon[28404]: pgmap v1009: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-03T22:33:32.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:32 smithi130 ceph-mon[32417]: pgmap v1009: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-03T22:33:32.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:32 smithi116 ceph-mon[31828]: pgmap v1009: 129 pgs: 129 active+clean; 647 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-03T22:33:34.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:34 smithi082 ceph-mon[28404]: pgmap v1010: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-03T22:33:34.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:34 smithi130 ceph-mon[32417]: pgmap v1010: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-03T22:33:34.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:34 smithi116 ceph-mon[31828]: pgmap v1010: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-03T22:33:35.801 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-05-03T22:33:35.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:33:35.802 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-03T22:33:35.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:33:35.862 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-03T22:33:35.911 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-03T22:33:35.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:33:35.913 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:33:36.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:33:36.044 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-03T22:33:36.155 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-03T22:33:36.167 INFO:tasks.cephadm:Teardown begin 2024-05-03T22:33:36.167 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-03T22:33:36.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:33:36.588 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:33:36.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:36 smithi082 ceph-mon[28404]: pgmap v1011: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T22:33:36.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:36 smithi130 ceph-mon[32417]: pgmap v1011: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T22:33:36.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:36 smithi116 ceph-mon[31828]: pgmap v1011: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T22:33:38.637 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:38 smithi082 ceph-mon[28404]: pgmap v1012: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-05-03T22:33:38.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:38 smithi130 ceph-mon[32417]: pgmap v1012: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-05-03T22:33:38.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.803+0000 7fe908800700 1 -- 172.21.15.82:0/998253295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006c3d0 msgr2=0x7fe900110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:38.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.803+0000 7fe908800700 1 --2- 172.21.15.82:0/998253295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006c3d0 0x7fe900110320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00b0a0 tx=0x7fe8fc00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:33:38.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.804+0000 7fe908800700 1 -- 172.21.15.82:0/998253295 shutdown_connections 2024-05-03T22:33:38.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.804+0000 7fe908800700 1 --2- 172.21.15.82:0/998253295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006c3d0 0x7fe900110320 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:38.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.804+0000 7fe908800700 1 --2- 172.21.15.82:0/998253295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe900109500 0x7fe9001098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:38.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.804+0000 7fe908800700 1 --2- 172.21.15.82:0/998253295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe90006ba10 0x7fe90006be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:38.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.804+0000 7fe908800700 1 -- 172.21.15.82:0/998253295 >> 172.21.15.82:0/998253295 conn(0x7fe900079310 msgr2=0x7fe900079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:38.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.804+0000 7fe908800700 1 -- 172.21.15.82:0/998253295 shutdown_connections 2024-05-03T22:33:38.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.804+0000 7fe908800700 1 -- 172.21.15.82:0/998253295 wait complete. 2024-05-03T22:33:38.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.805+0000 7fe908800700 1 Processor -- start 2024-05-03T22:33:38.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.805+0000 7fe908800700 1 -- start start 2024-05-03T22:33:38.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.805+0000 7fe908800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006ba10 0x7fe9001a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:38.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.805+0000 7fe908800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe90006c3d0 0x7fe9001a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:38.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.805+0000 7fe908800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe900109500 0x7fe90019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:38.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.805+0000 7fe908800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe900113530 con 0x7fe90006ba10 2024-05-03T22:33:38.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.805+0000 7fe908800700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe9001133b0 con 0x7fe90006c3d0 2024-05-03T22:33:38.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.805+0000 7fe908800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9001136b0 con 0x7fe900109500 2024-05-03T22:33:38.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe905e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006ba10 0x7fe9001a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:38.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe905e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006ba10 0x7fe9001a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44164/0 (socket says 172.21.15.82:44164) 2024-05-03T22:33:38.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe905e00700 1 -- 172.21.15.82:0/3770989606 learned_addr learned my addr 172.21.15.82:0/3770989606 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:33:38.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe905400700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe90006c3d0 0x7fe9001a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:38.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe906800700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe900109500 0x7fe90019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:38.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe905e00700 1 -- 172.21.15.82:0/3770989606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe900109500 msgr2=0x7fe90019bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:38.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe905e00700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe900109500 0x7fe90019bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:38.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe905e00700 1 -- 172.21.15.82:0/3770989606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe90006c3d0 msgr2=0x7fe9001a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:38.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe905e00700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe90006c3d0 0x7fe9001a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:38.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe905e00700 1 -- 172.21.15.82:0/3770989606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90019c410 con 0x7fe90006ba10 2024-05-03T22:33:38.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe905400700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe90006c3d0 0x7fe9001a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:33:38.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.806+0000 7fe906800700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe900109500 0x7fe90019bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:33:38.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.807+0000 7fe905e00700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006ba10 0x7fe9001a1a60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400d980 tx=0x7fe8f400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:38.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.807+0000 7fe8faa00700 1 -- 172.21.15.82:0/3770989606 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4017070 con 0x7fe90006ba10 2024-05-03T22:33:38.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.807+0000 7fe8faa00700 1 -- 172.21.15.82:0/3770989606 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8f4004830 con 0x7fe90006ba10 2024-05-03T22:33:38.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.807+0000 7fe908800700 1 -- 172.21.15.82:0/3770989606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90019c6a0 con 0x7fe90006ba10 2024-05-03T22:33:38.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.807+0000 7fe8faa00700 1 -- 172.21.15.82:0/3770989606 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40053a0 con 0x7fe90006ba10 2024-05-03T22:33:38.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.807+0000 7fe908800700 1 -- 172.21.15.82:0/3770989606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9001a8810 con 0x7fe90006ba10 2024-05-03T22:33:38.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.808+0000 7fe908800700 1 -- 172.21.15.82:0/3770989606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe900104bc0 con 0x7fe90006ba10 2024-05-03T22:33:38.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.810+0000 7fe8faa00700 1 -- 172.21.15.82:0/3770989606 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe8f40049e0 con 0x7fe90006ba10 2024-05-03T22:33:38.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.813+0000 7fe8faa00700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe8e80b2910 0x7fe8e80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:38.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.813+0000 7fe8faa00700 1 -- 172.21.15.82:0/3770989606 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fe8f40e2b10 con 0x7fe90006ba10 2024-05-03T22:33:38.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.813+0000 7fe905400700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe8e80b2910 0x7fe8e80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:38.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.814+0000 7fe905400700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe8e80b2910 0x7fe8e80b4dd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0005fd0 tx=0x7fe8f0005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:38.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:38.816+0000 7fe8faa00700 1 -- 172.21.15.82:0/3770989606 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe8f4020020 con 0x7fe90006ba10 2024-05-03T22:33:38.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:38 smithi116 ceph-mon[31828]: pgmap v1012: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-05-03T22:33:39.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.099+0000 7fe908800700 1 -- 172.21.15.82:0/3770989606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe90006a190 con 0x7fe90006ba10 2024-05-03T22:33:39.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.101+0000 7fe8faa00700 1 -- 172.21.15.82:0/3770989606 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11941 (secure 0 0 0) 0x7fe8f40aa2b0 con 0x7fe90006ba10 2024-05-03T22:33:39.103 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:33:39.103 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:12:39.270198+0000","modified":"2024-05-03T22:18:20.406297+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34460,"mds_1":34433,"mds_2":34412,"mds_3":34403,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":40,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34412":{"gid":34412,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6839/3254019270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3254019270},{"type":"v1","addr":"172.21.15.116:6839","nonce":3254019270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34460,"qdb_cluster":[34412,34433,34460,24469,34403]},"id":1}]} 2024-05-03T22:33:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 -- 172.21.15.82:0/3770989606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe8e80b2910 msgr2=0x7fe8e80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe8e80b2910 0x7fe8e80b4dd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0005fd0 tx=0x7fe8f0005ee0 comp rx=0 tx=0).stop 2024-05-03T22:33:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 -- 172.21.15.82:0/3770989606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006ba10 msgr2=0x7fe9001a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:39.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006ba10 0x7fe9001a1a60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400d980 tx=0x7fe8f400dd40 comp rx=0 tx=0).stop 2024-05-03T22:33:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 -- 172.21.15.82:0/3770989606 shutdown_connections 2024-05-03T22:33:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe8e80b2910 0x7fe8e80b4dd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006ba10 0x7fe9001a1a60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe900109500 0x7fe90019bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 --2- 172.21.15.82:0/3770989606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe90006c3d0 0x7fe9001a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 -- 172.21.15.82:0/3770989606 >> 172.21.15.82:0/3770989606 conn(0x7fe900079310 msgr2=0x7fe90010e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 -- 172.21.15.82:0/3770989606 shutdown_connections 2024-05-03T22:33:39.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:39.104+0000 7fe908800700 1 -- 172.21.15.82:0/3770989606 wait complete. 2024-05-03T22:33:39.108 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2024-05-03T22:33:39.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:39 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/3770989606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:33:39.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:39 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/3770989606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:33:39.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:39 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/3770989606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:33:40.002 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:33:40.464 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:33:40.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:40 smithi130 ceph-mon[32417]: pgmap v1013: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T22:33:40.801 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:40 smithi082 ceph-mon[28404]: pgmap v1013: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T22:33:40.837 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:40 smithi116 ceph-mon[31828]: pgmap v1013: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-03T22:33:42.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.662+0000 7fe0c0000700 1 -- 172.21.15.82:0/4158918224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b806ba10 msgr2=0x7fe0b806be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:42.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.662+0000 7fe0c0000700 1 --2- 172.21.15.82:0/4158918224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b806ba10 0x7fe0b806be90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009990 tx=0x7fe0a4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:33:42.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.662+0000 7fe0c0000700 1 -- 172.21.15.82:0/4158918224 shutdown_connections 2024-05-03T22:33:42.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.662+0000 7fe0c0000700 1 --2- 172.21.15.82:0/4158918224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0b806c3d0 0x7fe0b8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:42.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.662+0000 7fe0c0000700 1 --2- 172.21.15.82:0/4158918224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0b8109500 0x7fe0b81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:42.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.662+0000 7fe0c0000700 1 --2- 172.21.15.82:0/4158918224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b806ba10 0x7fe0b806be90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:42.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.662+0000 7fe0c0000700 1 -- 172.21.15.82:0/4158918224 >> 172.21.15.82:0/4158918224 conn(0x7fe0b8079310 msgr2=0x7fe0b8079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:42.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.662+0000 7fe0c0000700 1 -- 172.21.15.82:0/4158918224 shutdown_connections 2024-05-03T22:33:42.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.662+0000 7fe0c0000700 1 -- 172.21.15.82:0/4158918224 wait complete. 2024-05-03T22:33:42.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.663+0000 7fe0c0000700 1 Processor -- start 2024-05-03T22:33:42.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.663+0000 7fe0c0000700 1 -- start start 2024-05-03T22:33:42.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.664+0000 7fe0c0000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0b806ba10 0x7fe0b819f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:42.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.664+0000 7fe0c0000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0b806c3d0 0x7fe0b819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:42.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.664+0000 7fe0c0000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b8109500 0x7fe0b81998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:42.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.664+0000 7fe0c0000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81134e0 con 0x7fe0b8109500 2024-05-03T22:33:42.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.664+0000 7fe0c0000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b8113360 con 0x7fe0b806c3d0 2024-05-03T22:33:42.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.664+0000 7fe0c0000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b8113660 con 0x7fe0b806ba10 2024-05-03T22:33:42.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.664+0000 7fe0be000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b8109500 0x7fe0b81998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:42.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.664+0000 7fe0be000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b8109500 0x7fe0b81998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44174/0 (socket says 172.21.15.82:44174) 2024-05-03T22:33:42.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.664+0000 7fe0be000700 1 -- 172.21.15.82:0/2779349656 learned_addr learned my addr 172.21.15.82:0/2779349656 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:33:42.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.664+0000 7fe0bd600700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0b806ba10 0x7fe0b819f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:42.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.664+0000 7fe0bcc00700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0b806c3d0 0x7fe0b819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:42.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.665+0000 7fe0be000700 1 -- 172.21.15.82:0/2779349656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0b806ba10 msgr2=0x7fe0b819f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:42.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.665+0000 7fe0be000700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0b806ba10 0x7fe0b819f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:42.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.665+0000 7fe0be000700 1 -- 172.21.15.82:0/2779349656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0b806c3d0 msgr2=0x7fe0b819fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:42.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.665+0000 7fe0be000700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0b806c3d0 0x7fe0b819fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:42.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.665+0000 7fe0be000700 1 -- 172.21.15.82:0/2779349656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b819a000 con 0x7fe0b8109500 2024-05-03T22:33:42.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.665+0000 7fe0be000700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b8109500 0x7fe0b81998a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0007ee0 tx=0x7fe0b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:42.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.665+0000 7fe0b6000700 1 -- 172.21.15.82:0/2779349656 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0004bb0 con 0x7fe0b8109500 2024-05-03T22:33:42.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.665+0000 7fe0b6000700 1 -- 172.21.15.82:0/2779349656 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0b0004d50 con 0x7fe0b8109500 2024-05-03T22:33:42.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.665+0000 7fe0b6000700 1 -- 172.21.15.82:0/2779349656 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00058b0 con 0x7fe0b8109500 2024-05-03T22:33:42.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.665+0000 7fe0c0000700 1 -- 172.21.15.82:0/2779349656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b819a2f0 con 0x7fe0b8109500 2024-05-03T22:33:42.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.666+0000 7fe0c0000700 1 -- 172.21.15.82:0/2779349656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b81a65b0 con 0x7fe0b8109500 2024-05-03T22:33:42.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.667+0000 7fe0c0000700 1 -- 172.21.15.82:0/2779349656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b8104bc0 con 0x7fe0b8109500 2024-05-03T22:33:42.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.669+0000 7fe0b6000700 1 -- 172.21.15.82:0/2779349656 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe0b001a020 con 0x7fe0b8109500 2024-05-03T22:33:42.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.671+0000 7fe0b6000700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0a00b2990 0x7fe0a00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:42.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.672+0000 7fe0b6000700 1 -- 172.21.15.82:0/2779349656 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fe0b00e2440 con 0x7fe0b8109500 2024-05-03T22:33:42.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.672+0000 7fe0bd600700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0a00b2990 0x7fe0a00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:42.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.672+0000 7fe0bd600700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0a00b2990 0x7fe0a00b4e50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe0b819a9e0 tx=0x7fe0ac00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:42.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.674+0000 7fe0b6000700 1 -- 172.21.15.82:0/2779349656 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe0b0010070 con 0x7fe0b8109500 2024-05-03T22:33:42.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:42 smithi130 ceph-mon[32417]: pgmap v1014: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-03T22:33:42.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:42 smithi116 ceph-mon[31828]: pgmap v1014: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-03T22:33:42.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.958+0000 7fe0c0000700 1 -- 172.21.15.82:0/2779349656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0b819add0 con 0x7fe0b8109500 2024-05-03T22:33:42.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:42 smithi082 ceph-mon[28404]: pgmap v1014: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-03T22:33:42.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.959+0000 7fe0b6000700 1 -- 172.21.15.82:0/2779349656 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11941 (secure 0 0 0) 0x7fe0b00a9be0 con 0x7fe0b8109500 2024-05-03T22:33:42.962 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:33:42.962 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/288630872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":288630872},{"type":"v1","addr":"172.21.15.82:6835","nonce":288630872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14535,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2933152339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2933152339},{"type":"v1","addr":"172.21.15.82:6837","nonce":2933152339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:12:39.270198+0000","modified":"2024-05-03T22:18:20.406297+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34460,"mds_1":34433,"mds_2":34412,"mds_3":34403,"mds_4":24469},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/4287485607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":4287485607},{"type":"v1","addr":"172.21.15.82:6839","nonce":4287485607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/1188447125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":1188447125},{"type":"v1","addr":"172.21.15.82:6841","nonce":1188447125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/2041703143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2041703143},{"type":"v1","addr":"172.21.15.130:6833","nonce":2041703143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/710741525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":710741525},{"type":"v1","addr":"172.21.15.130:6835","nonce":710741525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6837/4246597354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":4246597354},{"type":"v1","addr":"172.21.15.130:6837","nonce":4246597354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":32,"addr":"172.21.15.130:6839/944732551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":944732551},{"type":"v1","addr":"172.21.15.130:6839","nonce":944732551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":40,"addr":"172.21.15.116:6833/1484646572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1484646572},{"type":"v1","addr":"172.21.15.116:6833","nonce":1484646572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34412":{"gid":34412,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.116:6835/1544765094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1544765094},{"type":"v1","addr":"172.21.15.116:6835","nonce":1544765094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.116:6837/2428901446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2428901446},{"type":"v1","addr":"172.21.15.116:6837","nonce":2428901446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.116:6839/3254019270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":3254019270},{"type":"v1","addr":"172.21.15.116:6839","nonce":3254019270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34460,"qdb_cluster":[34412,34433,34460,24469,34403]},"id":1}]} 2024-05-03T22:33:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.962+0000 7fe0c0000700 1 -- 172.21.15.82:0/2779349656 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0a00b2990 msgr2=0x7fe0a00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.962+0000 7fe0c0000700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0a00b2990 0x7fe0a00b4e50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe0b819a9e0 tx=0x7fe0ac00b410 comp rx=0 tx=0).stop 2024-05-03T22:33:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.962+0000 7fe0c0000700 1 -- 172.21.15.82:0/2779349656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b8109500 msgr2=0x7fe0b81998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:42.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.962+0000 7fe0c0000700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b8109500 0x7fe0b81998a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0007ee0 tx=0x7fe0b000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:33:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.962+0000 7fe0c0000700 1 -- 172.21.15.82:0/2779349656 shutdown_connections 2024-05-03T22:33:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.962+0000 7fe0c0000700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0a00b2990 0x7fe0a00b4e50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:42.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.962+0000 7fe0c0000700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b8109500 0x7fe0b81998a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:42.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.962+0000 7fe0c0000700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0b806ba10 0x7fe0b819f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:42.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.962+0000 7fe0c0000700 1 --2- 172.21.15.82:0/2779349656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0b806c3d0 0x7fe0b819fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:42.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.962+0000 7fe0c0000700 1 -- 172.21.15.82:0/2779349656 >> 172.21.15.82:0/2779349656 conn(0x7fe0b8079310 msgr2=0x7fe0b8101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:42.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.963+0000 7fe0c0000700 1 -- 172.21.15.82:0/2779349656 shutdown_connections 2024-05-03T22:33:42.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:42.963+0000 7fe0c0000700 1 -- 172.21.15.82:0/2779349656 wait complete. 2024-05-03T22:33:42.966 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2024-05-03T22:33:43.603 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:43 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2779349656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:33:43.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:43 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2779349656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:33:43.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:33:43.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:43 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2779349656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:33:44.236 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:33:44.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:44 smithi082 ceph-mon[28404]: pgmap v1015: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-03T22:33:44.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:44 smithi130 ceph-mon[32417]: pgmap v1015: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-03T22:33:44.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:44 smithi116 ceph-mon[31828]: pgmap v1015: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-03T22:33:46.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.488+0000 7f0d86800700 1 -- 172.21.15.82:0/1748751346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80104100 msgr2=0x7f0d80108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:46.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.488+0000 7f0d86800700 1 --2- 172.21.15.82:0/1748751346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80104100 0x7f0d80108120 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0d680099c0 tx=0x7f0d68009cd0 comp rx=0 tx=0).stop 2024-05-03T22:33:46.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.488+0000 7f0d86800700 1 -- 172.21.15.82:0/1748751346 shutdown_connections 2024-05-03T22:33:46.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.489+0000 7f0d86800700 1 --2- 172.21.15.82:0/1748751346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d80108850 0x7f0d801103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:46.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.489+0000 7f0d86800700 1 --2- 172.21.15.82:0/1748751346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d80103750 0x7f0d80103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:46.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.489+0000 7f0d86800700 1 --2- 172.21.15.82:0/1748751346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80104100 0x7f0d80108120 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:46.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.489+0000 7f0d86800700 1 -- 172.21.15.82:0/1748751346 >> 172.21.15.82:0/1748751346 conn(0x7f0d8007a600 msgr2=0x7f0d8007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:46.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.489+0000 7f0d86800700 1 -- 172.21.15.82:0/1748751346 shutdown_connections 2024-05-03T22:33:46.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.489+0000 7f0d86800700 1 -- 172.21.15.82:0/1748751346 wait complete. 2024-05-03T22:33:46.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.490+0000 7f0d86800700 1 Processor -- start 2024-05-03T22:33:46.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.490+0000 7f0d86800700 1 -- start start 2024-05-03T22:33:46.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.490+0000 7f0d86800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103750 0x7f0d801a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:46.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.490+0000 7f0d86800700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d80104100 0x7f0d801a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:46.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.490+0000 7f0d86800700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d80108850 0x7f0d8019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:46.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.490+0000 7f0d86800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d80113510 con 0x7f0d80103750 2024-05-03T22:33:46.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.490+0000 7f0d86800700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0d80113390 con 0x7f0d80104100 2024-05-03T22:33:46.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.490+0000 7f0d86800700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0d80113690 con 0x7f0d80108850 2024-05-03T22:33:46.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.491+0000 7f0d7f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103750 0x7f0d801a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:46.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.491+0000 7f0d7f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103750 0x7f0d801a1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45594/0 (socket says 172.21.15.82:45594) 2024-05-03T22:33:46.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.491+0000 7f0d7f400700 1 -- 172.21.15.82:0/1979270156 learned_addr learned my addr 172.21.15.82:0/1979270156 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:33:46.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.491+0000 7f0d77e00700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d80104100 0x7f0d801a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:46.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.491+0000 7f0d7fe00700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d80108850 0x7f0d8019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:46.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.491+0000 7f0d7f400700 1 -- 172.21.15.82:0/1979270156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d80108850 msgr2=0x7f0d8019b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:46.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.491+0000 7f0d7f400700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d80108850 0x7f0d8019b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:46.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.491+0000 7f0d7f400700 1 -- 172.21.15.82:0/1979270156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d80104100 msgr2=0x7f0d801a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.491+0000 7f0d7f400700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d80104100 0x7f0d801a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.491+0000 7f0d7f400700 1 -- 172.21.15.82:0/1979270156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8019c130 con 0x7f0d80103750 2024-05-03T22:33:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.491+0000 7f0d7f400700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103750 0x7f0d801a1810 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c920 tx=0x7f0d7000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.492+0000 7f0d7cc00700 1 -- 172.21.15.82:0/1979270156 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70007b00 con 0x7f0d80103750 2024-05-03T22:33:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.492+0000 7f0d7cc00700 1 -- 172.21.15.82:0/1979270156 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d70004cc0 con 0x7f0d80103750 2024-05-03T22:33:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.492+0000 7f0d86800700 1 -- 172.21.15.82:0/1979270156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8019c420 con 0x7f0d80103750 2024-05-03T22:33:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.492+0000 7f0d7cc00700 1 -- 172.21.15.82:0/1979270156 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d700054f0 con 0x7f0d80103750 2024-05-03T22:33:46.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.492+0000 7f0d86800700 1 -- 172.21.15.82:0/1979270156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d801a86e0 con 0x7f0d80103750 2024-05-03T22:33:46.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.493+0000 7f0d86800700 1 -- 172.21.15.82:0/1979270156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8006a190 con 0x7f0d80103750 2024-05-03T22:33:46.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.496+0000 7f0d7cc00700 1 -- 172.21.15.82:0/1979270156 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0d70007ca0 con 0x7f0d80103750 2024-05-03T22:33:46.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.497+0000 7f0d7cc00700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0d640b2990 0x7f0d640b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:46.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.497+0000 7f0d7cc00700 1 -- 172.21.15.82:0/1979270156 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7f0d700e2770 con 0x7f0d80103750 2024-05-03T22:33:46.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.497+0000 7f0d77e00700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0d640b2990 0x7f0d640b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:46.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.498+0000 7f0d77e00700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0d640b2990 0x7f0d640b4e50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000c00 tx=0x7f0d6801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:46.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.500+0000 7f0d7cc00700 1 -- 172.21.15.82:0/1979270156 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0d70014030 con 0x7f0d80103750 2024-05-03T22:33:46.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.737+0000 7f0d86800700 1 -- 172.21.15.82:0/1979270156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d8019cf00 con 0x7f0d80103750 2024-05-03T22:33:46.744 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:46 smithi082 ceph-mon[28404]: pgmap v1016: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:33:46.744 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-03T22:33:46.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.741+0000 7f0d7cc00700 1 -- 172.21.15.82:0/1979270156 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24803 (secure 0 0 0) 0x7f0d700a9f90 con 0x7f0d80103750 2024-05-03T22:33:46.745 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"fsid":"81cd0262-0998-11ef-bc97-c7b262605968","created":"2024-05-03T22:01:26.555248+0000","modified":"2024-05-03T22:14:38.277415+0000","last_up_change":"2024-05-03T22:11:09.237803+0000","last_in_change":"2024-05-03T22:10:44.265014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:05:52.600038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:12:30.512363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:12:34.936483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:12:50.095758+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"636c5286-4826-4d3b-a79c-cf7abe97433f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6803","nonce":1505062646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6805","nonce":1505062646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6809","nonce":1505062646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1505062646},{"type":"v1","addr":"172.21.15.82:6807","nonce":1505062646}]},"public_addr":"172.21.15.82:6803/1505062646","cluster_addr":"172.21.15.82:6805/1505062646","heartbeat_back_addr":"172.21.15.82:6809/1505062646","heartbeat_front_addr":"172.21.15.82:6807/1505062646","state":["exists","up"]},{"osd":1,"uuid":"41174bd4-ab44-4c4d-9da9-bb2df85f6fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6801","nonce":1867277608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6803","nonce":1867277608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6807","nonce":1867277608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1867277608},{"type":"v1","addr":"172.21.15.116:6805","nonce":1867277608}]},"public_addr":"172.21.15.116:6801/1867277608","cluster_addr":"172.21.15.116:6803/1867277608","heartbeat_back_addr":"172.21.15.116:6807/1867277608","heartbeat_front_addr":"172.21.15.116:6805/1867277608","state":["exists","up"]},{"osd":2,"uuid":"5574fae9-c3b9-48ce-9707-77a85389fded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6801","nonce":2477946365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6803","nonce":2477946365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6807","nonce":2477946365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2477946365},{"type":"v1","addr":"172.21.15.130:6805","nonce":2477946365}]},"public_addr":"172.21.15.130:6801/2477946365","cluster_addr":"172.21.15.130:6803/2477946365","heartbeat_back_addr":"172.21.15.130:6807/2477946365","heartbeat_front_addr":"172.21.15.130:6805/2477946365","state":["exists","up"]},{"osd":3,"uuid":"6729dc19-766c-480a-ac53-3bf94391fef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6811","nonce":3661604809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6813","nonce":3661604809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6817","nonce":3661604809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3661604809},{"type":"v1","addr":"172.21.15.82:6815","nonce":3661604809}]},"public_addr":"172.21.15.82:6811/3661604809","cluster_addr":"172.21.15.82:6813/3661604809","heartbeat_back_addr":"172.21.15.82:6817/3661604809","heartbeat_front_addr":"172.21.15.82:6815/3661604809","state":["exists","up"]},{"osd":4,"uuid":"6f1a58f6-d55b-4ea5-895c-68109a8e02ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6809","nonce":3493188667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6811","nonce":3493188667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6815","nonce":3493188667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3493188667},{"type":"v1","addr":"172.21.15.116:6813","nonce":3493188667}]},"public_addr":"172.21.15.116:6809/3493188667","cluster_addr":"172.21.15.116:6811/3493188667","heartbeat_back_addr":"172.21.15.116:6815/3493188667","heartbeat_front_addr":"172.21.15.116:6813/3493188667","state":["exists","up"]},{"osd":5,"uuid":"0445007b-3edb-4501-b9b6-9e6a5ccfc2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6809","nonce":378786455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6811","nonce":378786455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6815","nonce":378786455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":378786455},{"type":"v1","addr":"172.21.15.130:6813","nonce":378786455}]},"public_addr":"172.21.15.130:6809/378786455","cluster_addr":"172.21.15.130:6811/378786455","heartbeat_back_addr":"172.21.15.130:6815/378786455","heartbeat_front_addr":"172.21.15.130:6813/378786455","state":["exists","up"]},{"osd":6,"uuid":"7bc2258f-990b-485d-baef-9bd16b39d4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6819","nonce":426224315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6821","nonce":426224315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6825","nonce":426224315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":426224315},{"type":"v1","addr":"172.21.15.82:6823","nonce":426224315}]},"public_addr":"172.21.15.82:6819/426224315","cluster_addr":"172.21.15.82:6821/426224315","heartbeat_back_addr":"172.21.15.82:6825/426224315","heartbeat_front_addr":"172.21.15.82:6823/426224315","state":["exists","up"]},{"osd":7,"uuid":"06aedaa7-11ea-4bfc-b2b7-1897c26376fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6817","nonce":918923056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6819","nonce":918923056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6823","nonce":918923056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":918923056},{"type":"v1","addr":"172.21.15.116:6821","nonce":918923056}]},"public_addr":"172.21.15.116:6817/918923056","cluster_addr":"172.21.15.116:6819/918923056","heartbeat_back_addr":"172.21.15.116:6823/918923056","heartbeat_front_addr":"172.21.15.116:6821/918923056","state":["exists","up"]},{"osd":8,"uuid":"eb8716a6-18d0-4b0a-ba8f-0809254e8982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6817","nonce":135638581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6819","nonce":135638581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6823","nonce":135638581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":135638581},{"type":"v1","addr":"172.21.15.130:6821","nonce":135638581}]},"public_addr":"172.21.15.130:6817/135638581","cluster_addr":"172.21.15.130:6819/135638581","heartbeat_back_addr":"172.21.15.130:6823/135638581","heartbeat_front_addr":"172.21.15.130:6821/135638581","state":["exists","up"]},{"osd":9,"uuid":"63a902a4-e216-4a8e-b994-f328086a584d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6827","nonce":3321139669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6829","nonce":3321139669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6833","nonce":3321139669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3321139669},{"type":"v1","addr":"172.21.15.82:6831","nonce":3321139669}]},"public_addr":"172.21.15.82:6827/3321139669","cluster_addr":"172.21.15.82:6829/3321139669","heartbeat_back_addr":"172.21.15.82:6833/3321139669","heartbeat_front_addr":"172.21.15.82:6831/3321139669","state":["exists","up"]},{"osd":10,"uuid":"2c49c2ad-a223-4996-aa9b-c44f37a029b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6825","nonce":2019218329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6827","nonce":2019218329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6831","nonce":2019218329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2019218329},{"type":"v1","addr":"172.21.15.116:6829","nonce":2019218329}]},"public_addr":"172.21.15.116:6825/2019218329","cluster_addr":"172.21.15.116:6827/2019218329","heartbeat_back_addr":"172.21.15.116:6831/2019218329","heartbeat_front_addr":"172.21.15.116:6829/2019218329","state":["exists","up"]},{"osd":11,"uuid":"43b98e6d-fba6-4cea-99fc-b3f0027fc693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6825","nonce":2407047775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6827","nonce":2407047775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6831","nonce":2407047775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2407047775},{"type":"v1","addr":"172.21.15.130:6829","nonce":2407047775}]},"public_addr":"172.21.15.130:6825/2407047775","cluster_addr":"172.21.15.130:6827/2407047775","heartbeat_back_addr":"172.21.15.130:6831/2407047775","heartbeat_front_addr":"172.21.15.130:6829/2407047775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:04:43.616705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:16.481576+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:05:49.075124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:24.706042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:06:59.323386+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:07:32.911472+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:09.553736+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:08:44.363978+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:19.340617+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:09:56.695011+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:10:32.255617+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:11:07.261514+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8},{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1970560625":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/167294547":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6801/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:6800/2219604538":"2024-05-04T22:02:36.416695+0000","172.21.15.82:0/3288839212":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6800/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/484754820":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/1157601153":"2024-05-04T22:02:00.707069+0000","172.21.15.82:6801/1944232139":"2024-05-04T22:02:00.707069+0000","172.21.15.82:0/2702343171":"2024-05-04T22:02:36.416695+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:33:46.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.745+0000 7f0d86800700 1 -- 172.21.15.82:0/1979270156 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0d640b2990 msgr2=0x7f0d640b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:46.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.745+0000 7f0d86800700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0d640b2990 0x7f0d640b4e50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000c00 tx=0x7f0d6801a040 comp rx=0 tx=0).stop 2024-05-03T22:33:46.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.745+0000 7f0d86800700 1 -- 172.21.15.82:0/1979270156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103750 msgr2=0x7f0d801a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:46.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.745+0000 7f0d86800700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103750 0x7f0d801a1810 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c920 tx=0x7f0d7000cce0 comp rx=0 tx=0).stop 2024-05-03T22:33:46.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.746+0000 7f0d86800700 1 -- 172.21.15.82:0/1979270156 shutdown_connections 2024-05-03T22:33:46.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.746+0000 7f0d86800700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f0d640b2990 0x7f0d640b4e50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:46.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.746+0000 7f0d86800700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d80103750 0x7f0d801a1810 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:46.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.746+0000 7f0d86800700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0d80108850 0x7f0d8019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:46.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.746+0000 7f0d86800700 1 --2- 172.21.15.82:0/1979270156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d80104100 0x7f0d801a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:46.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.746+0000 7f0d86800700 1 -- 172.21.15.82:0/1979270156 >> 172.21.15.82:0/1979270156 conn(0x7f0d8007a600 msgr2=0x7f0d80101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:46.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.746+0000 7f0d86800700 1 -- 172.21.15.82:0/1979270156 shutdown_connections 2024-05-03T22:33:46.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:46.746+0000 7f0d86800700 1 -- 172.21.15.82:0/1979270156 wait complete. 2024-05-03T22:33:46.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:46 smithi130 ceph-mon[32417]: pgmap v1016: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:33:46.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:46 smithi116 ceph-mon[31828]: pgmap v1016: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:33:47.604 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs fail cephfs 2024-05-03T22:33:47.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:47 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/1979270156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:33:47.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:47 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/1979270156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:33:47.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:47 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/1979270156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:33:48.045 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:33:48.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:48 smithi130 ceph-mon[32417]: pgmap v1017: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-05-03T22:33:48.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:48 smithi116 ceph-mon[31828]: pgmap v1017: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-05-03T22:33:48.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:48 smithi082 ceph-mon[28404]: pgmap v1017: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-05-03T22:33:50.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.149+0000 7fe075c00700 1 -- 172.21.15.82:0/4147388567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe07010b6e0 msgr2=0x7fe07010bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:50.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.149+0000 7fe075c00700 1 --2- 172.21.15.82:0/4147388567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe07010b6e0 0x7fe07010bac0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe060009990 tx=0x7fe060009ca0 comp rx=0 tx=0).stop 2024-05-03T22:33:50.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.149+0000 7fe075c00700 1 -- 172.21.15.82:0/4147388567 shutdown_connections 2024-05-03T22:33:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.149+0000 7fe075c00700 1 --2- 172.21.15.82:0/4147388567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe07010b6e0 0x7fe07010bac0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.149+0000 7fe075c00700 1 --2- 172.21.15.82:0/4147388567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0701060a0 0x7fe0701125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.149+0000 7fe075c00700 1 --2- 172.21.15.82:0/4147388567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0701056e0 0x7fe070105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.149+0000 7fe075c00700 1 -- 172.21.15.82:0/4147388567 >> 172.21.15.82:0/4147388567 conn(0x7fe0701011d0 msgr2=0x7fe0701035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:50.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.149+0000 7fe075c00700 1 -- 172.21.15.82:0/4147388567 shutdown_connections 2024-05-03T22:33:50.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.149+0000 7fe075c00700 1 -- 172.21.15.82:0/4147388567 wait complete. 2024-05-03T22:33:50.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.150+0000 7fe075c00700 1 Processor -- start 2024-05-03T22:33:50.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.150+0000 7fe075c00700 1 -- start start 2024-05-03T22:33:50.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.150+0000 7fe075c00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0701056e0 0x7fe07019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:50.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.150+0000 7fe075c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0701060a0 0x7fe07019c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:50.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe075c00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07010b6e0 0x7fe0701a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:50.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe075c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe0701157e0 con 0x7fe0701060a0 2024-05-03T22:33:50.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe075c00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe070115660 con 0x7fe0701056e0 2024-05-03T22:33:50.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe075c00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe070115960 con 0x7fe07010b6e0 2024-05-03T22:33:50.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0701060a0 0x7fe07019c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:50.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0701060a0 0x7fe07019c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45606/0 (socket says 172.21.15.82:45606) 2024-05-03T22:33:50.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06e000700 1 -- 172.21.15.82:0/2987556869 learned_addr learned my addr 172.21.15.82:0/2987556869 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:33:50.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06ea00700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0701056e0 0x7fe07019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:50.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06f400700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07010b6e0 0x7fe0701a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:50.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06e000700 1 -- 172.21.15.82:0/2987556869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07010b6e0 msgr2=0x7fe0701a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06e000700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07010b6e0 0x7fe0701a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06e000700 1 -- 172.21.15.82:0/2987556869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0701056e0 msgr2=0x7fe07019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06e000700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0701056e0 0x7fe07019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06e000700 1 -- 172.21.15.82:0/2987556869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0701a0d20 con 0x7fe0701060a0 2024-05-03T22:33:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06f400700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07010b6e0 0x7fe0701a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:33:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.151+0000 7fe06ea00700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0701056e0 0x7fe07019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:33:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.152+0000 7fe06e000700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0701060a0 0x7fe07019c250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00d980 tx=0x7fe05c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.152+0000 7fe067400700 1 -- 172.21.15.82:0/2987556869 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c017070 con 0x7fe0701060a0 2024-05-03T22:33:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.152+0000 7fe067400700 1 -- 172.21.15.82:0/2987556869 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe05c004830 con 0x7fe0701060a0 2024-05-03T22:33:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.152+0000 7fe075c00700 1 -- 172.21.15.82:0/2987556869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0701a1010 con 0x7fe0701060a0 2024-05-03T22:33:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.152+0000 7fe067400700 1 -- 172.21.15.82:0/2987556869 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0053a0 con 0x7fe0701060a0 2024-05-03T22:33:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.152+0000 7fe075c00700 1 -- 172.21.15.82:0/2987556869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0701a8890 con 0x7fe0701060a0 2024-05-03T22:33:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.153+0000 7fe075c00700 1 -- 172.21.15.82:0/2987556869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07006a190 con 0x7fe0701060a0 2024-05-03T22:33:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.156+0000 7fe067400700 1 -- 172.21.15.82:0/2987556869 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe05c0049e0 con 0x7fe0701060a0 2024-05-03T22:33:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.158+0000 7fe067400700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0540b2910 0x7fe0540b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:50.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.158+0000 7fe067400700 1 -- 172.21.15.82:0/2987556869 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9187+0+0 (secure 0 0 0) 0x7fe05c0e2760 con 0x7fe0701060a0 2024-05-03T22:33:50.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.158+0000 7fe06ea00700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0540b2910 0x7fe0540b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:50.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.159+0000 7fe06ea00700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0540b2910 0x7fe0540b4dd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe06000b5c0 tx=0x7fe06001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:50.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.163+0000 7fe067400700 1 -- 172.21.15.82:0/2987556869 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe05c020020 con 0x7fe0701060a0 2024-05-03T22:33:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.442+0000 7fe075c00700 1 -- 172.21.15.82:0/2987556869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe07002e510 con 0x7fe0701060a0 2024-05-03T22:33:50.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.447+0000 7fe067400700 1 -- 172.21.15.82:0/2987556869 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7fe05c0a9f00 con 0x7fe0701060a0 2024-05-03T22:33:50.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.452+0000 7fe075c00700 1 -- 172.21.15.82:0/2987556869 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0540b2910 msgr2=0x7fe0540b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:50.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.452+0000 7fe075c00700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0540b2910 0x7fe0540b4dd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe06000b5c0 tx=0x7fe06001a040 comp rx=0 tx=0).stop 2024-05-03T22:33:50.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.452+0000 7fe075c00700 1 -- 172.21.15.82:0/2987556869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0701060a0 msgr2=0x7fe07019c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:50.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.452+0000 7fe075c00700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0701060a0 0x7fe07019c250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00d980 tx=0x7fe05c00dd40 comp rx=0 tx=0).stop 2024-05-03T22:33:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.452+0000 7fe075c00700 1 -- 172.21.15.82:0/2987556869 shutdown_connections 2024-05-03T22:33:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.452+0000 7fe075c00700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7fe0540b2910 0x7fe0540b4dd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.452+0000 7fe075c00700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe07010b6e0 0x7fe0701a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.452+0000 7fe075c00700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0701056e0 0x7fe07019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.452+0000 7fe075c00700 1 --2- 172.21.15.82:0/2987556869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0701060a0 0x7fe07019c250 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.452+0000 7fe075c00700 1 -- 172.21.15.82:0/2987556869 >> 172.21.15.82:0/2987556869 conn(0x7fe0701011d0 msgr2=0x7fe0701019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.453+0000 7fe075c00700 1 -- 172.21.15.82:0/2987556869 shutdown_connections 2024-05-03T22:33:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:50.454+0000 7fe075c00700 1 -- 172.21.15.82:0/2987556869 wait complete. 2024-05-03T22:33:50.458 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-03T22:33:50.726 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a[68091]: ignoring --setuser ceph since I am not root 2024-05-03T22:33:50.727 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a[68091]: ignoring --setgroup ceph since I am not root 2024-05-03T22:33:50.727 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-mds[68095]: -- 172.21.15.82:0/3028987666 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55faedee5a40 con 0x55faedeb9000 2024-05-03T22:33:50.727 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a[68091]: starting mds.a at 2024-05-03T22:33:50.727 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:33:50 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g[67687]: ignoring --setuser ceph since I am not root 2024-05-03T22:33:50.728 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:33:50 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g[67687]: ignoring --setgroup ceph since I am not root 2024-05-03T22:33:50.728 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:33:50 smithi082 ceph-mds[67696]: -- 172.21.15.82:0/527811397 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c9f3511a40 con 0x55c9f34e4c00 2024-05-03T22:33:50.728 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:33:50 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g[67687]: starting mds.g at 2024-05-03T22:33:50.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a[28400]: 2024-05-03T22:33:50.444+0000 7fae7d400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T22:33:50.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-mon[28404]: pgmap v1018: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:33:50.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2987556869' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-03T22:33:50.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-mon[28404]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-03T22:33:50.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-mon[28404]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T22:33:50.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2987556869' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-03T22:33:50.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-mon[28404]: osdmap e93: 12 total, 12 up, 12 in 2024-05-03T22:33:50.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:50 smithi082 ceph-mon[28404]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-03T22:33:50.935 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k[61522]: ignoring --setuser ceph since I am not root 2024-05-03T22:33:50.936 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k[61522]: ignoring --setgroup ceph since I am not root 2024-05-03T22:33:50.936 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:33:50 smithi116 ceph-mds[61528]: -- 172.21.15.116:0/1014345147 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55794b839a40 con 0x55794b80c800 2024-05-03T22:33:50.936 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k[61522]: starting mds.k at 2024-05-03T22:33:50.936 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b[62451]: ignoring --setuser ceph since I am not root 2024-05-03T22:33:50.937 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b[62451]: ignoring --setgroup ceph since I am not root 2024-05-03T22:33:50.937 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:33:50 smithi116 ceph-mds[62455]: -- 172.21.15.116:0/3126505066 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563323c51a40 con 0x563323c24c00 2024-05-03T22:33:50.937 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b[62451]: starting mds.b at 2024-05-03T22:33:50.937 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h[62136]: ignoring --setuser ceph since I am not root 2024-05-03T22:33:50.937 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h[62136]: ignoring --setgroup ceph since I am not root 2024-05-03T22:33:50.937 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:33:50 smithi116 ceph-mds[62140]: -- 172.21.15.116:0/1467702993 <== mon.1 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562a72841a40 con 0x562a72814800 2024-05-03T22:33:50.938 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h[62136]: starting mds.h at 2024-05-03T22:33:50.938 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e[61830]: ignoring --setuser ceph since I am not root 2024-05-03T22:33:50.938 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e[61830]: ignoring --setgroup ceph since I am not root 2024-05-03T22:33:50.938 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:33:50 smithi116 ceph-mds[61834]: -- 172.21.15.116:0/1102429003 <== mon.1 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c51813a40 con 0x560c517e6800 2024-05-03T22:33:50.938 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:33:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e[61830]: starting mds.e at 2024-05-03T22:33:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:50 smithi116 ceph-mon[31828]: pgmap v1018: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:33:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:50 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2987556869' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-03T22:33:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:50 smithi116 ceph-mon[31828]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-03T22:33:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:50 smithi116 ceph-mon[31828]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T22:33:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:50 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2987556869' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-03T22:33:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:50 smithi116 ceph-mon[31828]: osdmap e93: 12 total, 12 up, 12 in 2024-05-03T22:33:50.939 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:50 smithi116 ceph-mon[31828]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-03T22:33:51.027 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c[63547]: ignoring --setuser ceph since I am not root 2024-05-03T22:33:51.028 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c[63547]: ignoring --setgroup ceph since I am not root 2024-05-03T22:33:51.028 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:33:50 smithi130 ceph-mds[63551]: -- 172.21.15.130:0/144924712 <== mon.1 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557c2ca47a40 con 0x557c2ca1ac00 2024-05-03T22:33:51.028 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c[63547]: starting mds.c at 2024-05-03T22:33:51.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:50 smithi130 ceph-mon[32417]: pgmap v1018: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:33:51.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:50 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2987556869' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-03T22:33:51.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:50 smithi130 ceph-mon[32417]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-03T22:33:51.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:50 smithi130 ceph-mon[32417]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T22:33:51.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:50 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2987556869' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-03T22:33:51.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:50 smithi130 ceph-mon[32417]: osdmap e93: 12 total, 12 up, 12 in 2024-05-03T22:33:51.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:50 smithi130 ceph-mon[32417]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-03T22:33:51.030 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f[63243]: ignoring --setuser ceph since I am not root 2024-05-03T22:33:51.030 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f[63243]: ignoring --setgroup ceph since I am not root 2024-05-03T22:33:51.030 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:33:50 smithi130 ceph-mds[63249]: -- 172.21.15.130:0/1721705784 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559176a5ba40 con 0x559176a2ec00 2024-05-03T22:33:51.030 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f[63243]: starting mds.f at 2024-05-03T22:33:51.031 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l[62933]: ignoring --setuser ceph since I am not root 2024-05-03T22:33:51.031 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l[62933]: ignoring --setgroup ceph since I am not root 2024-05-03T22:33:51.031 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:33:50 smithi130 ceph-mds[62937]: -- 172.21.15.130:0/3890358209 <== mon.1 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5584e21f9a40 con 0x5584e21ccc00 2024-05-03T22:33:51.031 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l[62933]: starting mds.l at 2024-05-03T22:33:51.031 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i[63850]: ignoring --setuser ceph since I am not root 2024-05-03T22:33:51.032 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i[63850]: ignoring --setgroup ceph since I am not root 2024-05-03T22:33:51.032 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:33:50 smithi130 ceph-mds[63854]: -- 172.21.15.130:0/1020361183 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bd59aa7a40 con 0x55bd59a7ac00 2024-05-03T22:33:51.032 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:33:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i[63850]: starting mds.i at 2024-05-03T22:33:51.325 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-03T22:33:51.769 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:33:52.804 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: pgmap v1020: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-03T22:33:52.805 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.82:6838/2679778530,v1:172.21.15.82:6839/2679778530] up:boot 2024-05-03T22:33:52.805 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.82:6840/332352437,v1:172.21.15.82:6841/332352437] up:boot 2024-05-03T22:33:52.805 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.130:6832/3358639459,v1:172.21.15.130:6833/3358639459] up:boot 2024-05-03T22:33:52.805 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6832/701510084,v1:172.21.15.116:6833/701510084] up:boot 2024-05-03T22:33:52.806 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.130:6834/61007110,v1:172.21.15.130:6835/61007110] up:boot 2024-05-03T22:33:52.806 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6834/1667442106,v1:172.21.15.116:6835/1667442106] up:boot 2024-05-03T22:33:52.806 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.130:6837/2958279666,v1:172.21.15.130:6838/2958279666] up:boot 2024-05-03T22:33:52.806 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.130:6836/4185825900,v1:172.21.15.130:6839/4185825900] up:boot 2024-05-03T22:33:52.806 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6836/3168252036,v1:172.21.15.116:6838/3168252036] up:boot 2024-05-03T22:33:52.806 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: mds.? [v2:172.21.15.116:6837/3437522297,v1:172.21.15.116:6839/3437522297] up:boot 2024-05-03T22:33:52.806 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-03T22:33:52.806 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T22:33:52.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T22:33:52.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T22:33:52.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T22:33:52.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T22:33:52.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T22:33:52.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T22:33:52.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T22:33:52.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T22:33:52.808 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:52 smithi082 ceph-mon[28404]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T22:33:52.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: pgmap v1020: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-03T22:33:52.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.82:6838/2679778530,v1:172.21.15.82:6839/2679778530] up:boot 2024-05-03T22:33:52.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.82:6840/332352437,v1:172.21.15.82:6841/332352437] up:boot 2024-05-03T22:33:52.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.130:6832/3358639459,v1:172.21.15.130:6833/3358639459] up:boot 2024-05-03T22:33:52.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6832/701510084,v1:172.21.15.116:6833/701510084] up:boot 2024-05-03T22:33:52.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.130:6834/61007110,v1:172.21.15.130:6835/61007110] up:boot 2024-05-03T22:33:52.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6834/1667442106,v1:172.21.15.116:6835/1667442106] up:boot 2024-05-03T22:33:52.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.130:6837/2958279666,v1:172.21.15.130:6838/2958279666] up:boot 2024-05-03T22:33:52.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.130:6836/4185825900,v1:172.21.15.130:6839/4185825900] up:boot 2024-05-03T22:33:52.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6836/3168252036,v1:172.21.15.116:6838/3168252036] up:boot 2024-05-03T22:33:52.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: mds.? [v2:172.21.15.116:6837/3437522297,v1:172.21.15.116:6839/3437522297] up:boot 2024-05-03T22:33:52.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-03T22:33:52.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T22:33:52.937 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T22:33:52.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T22:33:52.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T22:33:52.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T22:33:52.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T22:33:52.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T22:33:52.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T22:33:52.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T22:33:52.938 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:52 smithi116 ceph-mon[31828]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T22:33:53.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: pgmap v1020: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-03T22:33:53.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.82:6838/2679778530,v1:172.21.15.82:6839/2679778530] up:boot 2024-05-03T22:33:53.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.82:6840/332352437,v1:172.21.15.82:6841/332352437] up:boot 2024-05-03T22:33:53.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.130:6832/3358639459,v1:172.21.15.130:6833/3358639459] up:boot 2024-05-03T22:33:53.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6832/701510084,v1:172.21.15.116:6833/701510084] up:boot 2024-05-03T22:33:53.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.130:6834/61007110,v1:172.21.15.130:6835/61007110] up:boot 2024-05-03T22:33:53.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6834/1667442106,v1:172.21.15.116:6835/1667442106] up:boot 2024-05-03T22:33:53.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.130:6837/2958279666,v1:172.21.15.130:6838/2958279666] up:boot 2024-05-03T22:33:53.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.130:6836/4185825900,v1:172.21.15.130:6839/4185825900] up:boot 2024-05-03T22:33:53.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6836/3168252036,v1:172.21.15.116:6838/3168252036] up:boot 2024-05-03T22:33:53.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: mds.? [v2:172.21.15.116:6837/3437522297,v1:172.21.15.116:6839/3437522297] up:boot 2024-05-03T22:33:53.029 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-03T22:33:53.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T22:33:53.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T22:33:53.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T22:33:53.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T22:33:53.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T22:33:53.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T22:33:53.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T22:33:53.030 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T22:33:53.031 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T22:33:53.031 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:52 smithi130 ceph-mon[32417]: from='mgr.14152 172.21.15.82:0/3079014384' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T22:33:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.030+0000 7f418f400700 1 -- 172.21.15.82:0/718101777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4188109ad0 msgr2=0x7f4188109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.030+0000 7f418f400700 1 --2- 172.21.15.82:0/718101777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4188109ad0 0x7f4188109f50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4174009990 tx=0x7f4174009ca0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.031+0000 7f418f400700 1 -- 172.21.15.82:0/718101777 shutdown_connections 2024-05-03T22:33:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.031+0000 7f418f400700 1 --2- 172.21.15.82:0/718101777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f418810a490 0x7f41881169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.031+0000 7f418f400700 1 --2- 172.21.15.82:0/718101777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418810fb60 0x7f418810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.031+0000 7f418f400700 1 --2- 172.21.15.82:0/718101777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4188109ad0 0x7f4188109f50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.031+0000 7f418f400700 1 -- 172.21.15.82:0/718101777 >> 172.21.15.82:0/718101777 conn(0x7f4188076c70 msgr2=0x7f41881082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.031+0000 7f418f400700 1 -- 172.21.15.82:0/718101777 shutdown_connections 2024-05-03T22:33:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.031+0000 7f418f400700 1 -- 172.21.15.82:0/718101777 wait complete. 2024-05-03T22:33:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.032+0000 7f418f400700 1 Processor -- start 2024-05-03T22:33:54.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.032+0000 7f418f400700 1 -- start start 2024-05-03T22:33:54.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.032+0000 7f418f400700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4188109ad0 0x7f41881a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:54.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.032+0000 7f418f400700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418810a490 0x7f41881a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:54.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.032+0000 7f418f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f418810fb60 0x7f41881a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:54.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.033+0000 7f418f400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4188119bd0 con 0x7f418810fb60 2024-05-03T22:33:54.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.033+0000 7f418f400700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4188119a50 con 0x7f418810a490 2024-05-03T22:33:54.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.033+0000 7f418f400700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4188119d50 con 0x7f4188109ad0 2024-05-03T22:33:54.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.033+0000 7f418d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f418810fb60 0x7f41881a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:54.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.033+0000 7f418d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f418810fb60 0x7f41881a49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51222/0 (socket says 172.21.15.82:51222) 2024-05-03T22:33:54.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.033+0000 7f418d400700 1 -- 172.21.15.82:0/975641081 learned_addr learned my addr 172.21.15.82:0/975641081 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:33:54.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.033+0000 7f4187e00700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418810a490 0x7f41881a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:54.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.033+0000 7f418ca00700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4188109ad0 0x7f41881a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:54.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.034+0000 7f418d400700 1 -- 172.21.15.82:0/975641081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4188109ad0 msgr2=0x7f41881a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:54.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.034+0000 7f418d400700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4188109ad0 0x7f41881a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.034+0000 7f418d400700 1 -- 172.21.15.82:0/975641081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418810a490 msgr2=0x7f41881a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:54.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.034+0000 7f418d400700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418810a490 0x7f41881a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.034+0000 7f418d400700 1 -- 172.21.15.82:0/975641081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41881a50e0 con 0x7f418810fb60 2024-05-03T22:33:54.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.034+0000 7f418d400700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f418810fb60 0x7f41881a49a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4180007ee0 tx=0x7f418000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:54.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.034+0000 7f4185600700 1 -- 172.21.15.82:0/975641081 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180004bb0 con 0x7f418810fb60 2024-05-03T22:33:54.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.034+0000 7f4185600700 1 -- 172.21.15.82:0/975641081 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4180004d50 con 0x7f418810fb60 2024-05-03T22:33:54.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.034+0000 7f418f400700 1 -- 172.21.15.82:0/975641081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41881a53d0 con 0x7f418810fb60 2024-05-03T22:33:54.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.034+0000 7f4185600700 1 -- 172.21.15.82:0/975641081 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800058b0 con 0x7f418810fb60 2024-05-03T22:33:54.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.034+0000 7f418f400700 1 -- 172.21.15.82:0/975641081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41881acc50 con 0x7f418810fb60 2024-05-03T22:33:54.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.036+0000 7f418f400700 1 -- 172.21.15.82:0/975641081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418806a190 con 0x7f418810fb60 2024-05-03T22:33:54.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.038+0000 7f4185600700 1 -- 172.21.15.82:0/975641081 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f418001a020 con 0x7f418810fb60 2024-05-03T22:33:54.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.039+0000 7f4185600700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f41700b2990 0x7f41700b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:54.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.039+0000 7f4185600700 1 -- 172.21.15.82:0/975641081 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9617+0+0 (secure 0 0 0) 0x7f41800e1fb0 con 0x7f418810fb60 2024-05-03T22:33:54.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.040+0000 7f418ca00700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f41700b2990 0x7f41700b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:54.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.040+0000 7f418ca00700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f41700b2990 0x7f41700b4e50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f417c007b60 tx=0x7f417c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:54.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.045+0000 7f4185600700 1 -- 172.21.15.82:0/975641081 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4180010070 con 0x7f418810fb60 2024-05-03T22:33:54.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.326+0000 7f418f400700 1 -- 172.21.15.82:0/975641081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f418802e510 con 0x7f418810fb60 2024-05-03T22:33:54.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.555+0000 7f4185600700 1 -- 172.21.15.82:0/975641081 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7f41800a95a0 con 0x7f418810fb60 2024-05-03T22:33:54.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 -- 172.21.15.82:0/975641081 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f41700b2990 msgr2=0x7f41700b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:54.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f41700b2990 0x7f41700b4e50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f417c007b60 tx=0x7f417c0073d0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 -- 172.21.15.82:0/975641081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f418810fb60 msgr2=0x7f41881a49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:54.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f418810fb60 0x7f41881a49a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4180007ee0 tx=0x7f418000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 -- 172.21.15.82:0/975641081 shutdown_connections 2024-05-03T22:33:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f41700b2990 0x7f41700b4e50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f418810fb60 0x7f41881a49a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4188109ad0 0x7f41881a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 --2- 172.21.15.82:0/975641081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f418810a490 0x7f41881a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 -- 172.21.15.82:0/975641081 >> 172.21.15.82:0/975641081 conn(0x7f4188076c70 msgr2=0x7f41880772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 -- 172.21.15.82:0/975641081 shutdown_connections 2024-05-03T22:33:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:54.560+0000 7f418f400700 1 -- 172.21.15.82:0/975641081 wait complete. 2024-05-03T22:33:54.581 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:54 smithi082 ceph-mon[28404]: pgmap v1021: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-03T22:33:54.582 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:54 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/975641081' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:33:54.830 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:54 smithi130 ceph-mon[32417]: pgmap v1021: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-03T22:33:54.830 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:54 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/975641081' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:33:54.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:54 smithi116 ceph-mon[31828]: pgmap v1021: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-03T22:33:54.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:54 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/975641081' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:33:55.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-03T22:33:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:33:55.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:55 smithi116 ceph-mon[31828]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-03T22:33:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:55 smithi116 ceph-mon[31828]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-03T22:33:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:55 smithi116 ceph-mon[31828]: Cluster is now healthy 2024-05-03T22:33:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:55 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/975641081' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-03T22:33:55.936 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:55 smithi116 ceph-mon[31828]: fsmap 12 up:standby 2024-05-03T22:33:55.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:55 smithi082 ceph-mon[28404]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-03T22:33:55.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:55 smithi082 ceph-mon[28404]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-03T22:33:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:55 smithi082 ceph-mon[28404]: Cluster is now healthy 2024-05-03T22:33:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:55 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/975641081' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-03T22:33:55.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:55 smithi082 ceph-mon[28404]: fsmap 12 up:standby 2024-05-03T22:33:56.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:55 smithi130 ceph-mon[32417]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-03T22:33:56.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:55 smithi130 ceph-mon[32417]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-03T22:33:56.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:55 smithi130 ceph-mon[32417]: Cluster is now healthy 2024-05-03T22:33:56.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:55 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/975641081' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-03T22:33:56.028 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:55 smithi130 ceph-mon[32417]: fsmap 12 up:standby 2024-05-03T22:33:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:56 smithi082 ceph-mon[28404]: pgmap v1022: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:33:56.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:56 smithi116 ceph-mon[31828]: pgmap v1022: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:33:57.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:56 smithi130 ceph-mon[32417]: pgmap v1022: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:33:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.083+0000 7f8ddb600700 1 -- 172.21.15.82:0/1963074347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dd4109500 msgr2=0x7f8dd41098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.083+0000 7f8ddb600700 1 --2- 172.21.15.82:0/1963074347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dd4109500 0x7f8dd41098e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009990 tx=0x7f8dc8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:33:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.083+0000 7f8ddb600700 1 -- 172.21.15.82:0/1963074347 shutdown_connections 2024-05-03T22:33:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.083+0000 7f8ddb600700 1 --2- 172.21.15.82:0/1963074347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dd4109500 0x7f8dd41098e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.083+0000 7f8ddb600700 1 --2- 172.21.15.82:0/1963074347 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd406c3d0 0x7f8dd4110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.083+0000 7f8ddb600700 1 --2- 172.21.15.82:0/1963074347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd406ba10 0x7f8dd406be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.083+0000 7f8ddb600700 1 -- 172.21.15.82:0/1963074347 >> 172.21.15.82:0/1963074347 conn(0x7f8dd4079310 msgr2=0x7f8dd4079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.083+0000 7f8ddb600700 1 -- 172.21.15.82:0/1963074347 shutdown_connections 2024-05-03T22:33:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.083+0000 7f8ddb600700 1 -- 172.21.15.82:0/1963074347 wait complete. 2024-05-03T22:33:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.084+0000 7f8ddb600700 1 Processor -- start 2024-05-03T22:33:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.084+0000 7f8ddb600700 1 -- start start 2024-05-03T22:33:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.085+0000 7f8ddb600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dd406ba10 0x7f8dd41a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.085+0000 7f8ddb600700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd406c3d0 0x7f8dd41a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.085+0000 7f8ddb600700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd4109500 0x7f8dd419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.085+0000 7f8ddb600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4113510 con 0x7f8dd406ba10 2024-05-03T22:33:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.085+0000 7f8ddb600700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4113390 con 0x7f8dd406c3d0 2024-05-03T22:33:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.085+0000 7f8ddb600700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4113690 con 0x7f8dd4109500 2024-05-03T22:33:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.085+0000 7f8dd8c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dd406ba10 0x7f8dd41a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.085+0000 7f8dd8c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dd406ba10 0x7f8dd41a18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51234/0 (socket says 172.21.15.82:51234) 2024-05-03T22:33:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.085+0000 7f8dd8c00700 1 -- 172.21.15.82:0/2557488735 learned_addr learned my addr 172.21.15.82:0/2557488735 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:33:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.085+0000 7f8dd3e00700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd406c3d0 0x7f8dd41a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.086+0000 7f8dd8c00700 1 -- 172.21.15.82:0/2557488735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd4109500 msgr2=0x7f8dd419bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.086+0000 7f8dd8c00700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd4109500 0x7f8dd419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.086+0000 7f8dd8c00700 1 -- 172.21.15.82:0/2557488735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd406c3d0 msgr2=0x7f8dd41a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.086+0000 7f8dd8c00700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd406c3d0 0x7f8dd41a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.086+0000 7f8dd8c00700 1 -- 172.21.15.82:0/2557488735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd419c210 con 0x7f8dd406ba10 2024-05-03T22:33:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.086+0000 7f8dd8c00700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dd406ba10 0x7f8dd41a18f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8000c00 tx=0x7f8dc80057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.086+0000 7f8dd1600700 1 -- 172.21.15.82:0/2557488735 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8027070 con 0x7f8dd406ba10 2024-05-03T22:33:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.086+0000 7f8dd1600700 1 -- 172.21.15.82:0/2557488735 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8dc800fb00 con 0x7f8dd406ba10 2024-05-03T22:33:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.086+0000 7f8dd1600700 1 -- 172.21.15.82:0/2557488735 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8022b70 con 0x7f8dd406ba10 2024-05-03T22:33:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.087+0000 7f8ddb600700 1 -- 172.21.15.82:0/2557488735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd419c4a0 con 0x7f8dd406ba10 2024-05-03T22:33:58.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.087+0000 7f8ddb600700 1 -- 172.21.15.82:0/2557488735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd41a87c0 con 0x7f8dd406ba10 2024-05-03T22:33:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.088+0000 7f8ddb600700 1 -- 172.21.15.82:0/2557488735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd406a190 con 0x7f8dd406ba10 2024-05-03T22:33:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.090+0000 7f8dd1600700 1 -- 172.21.15.82:0/2557488735 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8dc8022d10 con 0x7f8dd406ba10 2024-05-03T22:33:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.091+0000 7f8dd1600700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8dbc0b2910 0x7f8dbc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.092+0000 7f8dd1600700 1 -- 172.21.15.82:0/2557488735 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9617+0+0 (secure 0 0 0) 0x7f8dc80e3910 con 0x7f8dd406ba10 2024-05-03T22:33:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.092+0000 7f8dd3e00700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8dbc0b2910 0x7f8dbc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.093+0000 7f8dd3e00700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8dbc0b2910 0x7f8dbc0b4dd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4104400 tx=0x7f8dc000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:58.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.096+0000 7f8dd1600700 1 -- 172.21.15.82:0/2557488735 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8dc8013070 con 0x7f8dd406ba10 2024-05-03T22:33:58.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.330+0000 7f8ddb600700 1 -- 172.21.15.82:0/2557488735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8dd41a8990 con 0x7f8dd406ba10 2024-05-03T22:33:58.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.586+0000 7f8dd1600700 1 -- 172.21.15.82:0/2557488735 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7f8dc80aaf90 con 0x7f8dd406ba10 2024-05-03T22:33:58.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.592+0000 7f8ddb600700 1 -- 172.21.15.82:0/2557488735 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8dbc0b2910 msgr2=0x7f8dbc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:58.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.592+0000 7f8ddb600700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8dbc0b2910 0x7f8dbc0b4dd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4104400 tx=0x7f8dc000a380 comp rx=0 tx=0).stop 2024-05-03T22:33:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.592+0000 7f8ddb600700 1 -- 172.21.15.82:0/2557488735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dd406ba10 msgr2=0x7f8dd41a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.592+0000 7f8ddb600700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dd406ba10 0x7f8dd41a18f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8000c00 tx=0x7f8dc80057a0 comp rx=0 tx=0).stop 2024-05-03T22:33:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.593+0000 7f8ddb600700 1 -- 172.21.15.82:0/2557488735 shutdown_connections 2024-05-03T22:33:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.593+0000 7f8ddb600700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f8dbc0b2910 0x7f8dbc0b4dd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.593+0000 7f8ddb600700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dd406ba10 0x7f8dd41a18f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.593+0000 7f8ddb600700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8dd4109500 0x7f8dd419bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.593+0000 7f8ddb600700 1 --2- 172.21.15.82:0/2557488735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dd406c3d0 0x7f8dd41a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.593+0000 7f8ddb600700 1 -- 172.21.15.82:0/2557488735 >> 172.21.15.82:0/2557488735 conn(0x7f8dd4079310 msgr2=0x7f8dd410e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.593+0000 7f8ddb600700 1 -- 172.21.15.82:0/2557488735 shutdown_connections 2024-05-03T22:33:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:33:58.594+0000 7f8ddb600700 1 -- 172.21.15.82:0/2557488735 wait complete. 2024-05-03T22:33:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2024-05-03T22:33:58.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:58 smithi116 ceph-mon[31828]: pgmap v1023: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-03T22:33:58.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:58 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2557488735' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T22:33:58.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:58 smithi082 ceph-mon[28404]: pgmap v1023: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-03T22:33:58.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:58 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2557488735' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T22:33:59.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:58 smithi130 ceph-mon[32417]: pgmap v1023: 129 pgs: 129 active+clean; 648 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-03T22:33:59.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:58 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2557488735' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T22:33:59.431 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-03T22:33:59.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:59 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2557488735' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T22:33:59.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:33:59 smithi082 ceph-mon[28404]: osdmap e94: 12 total, 12 up, 12 in 2024-05-03T22:33:59.877 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:33:59.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:59 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2557488735' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T22:33:59.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:33:59 smithi116 ceph-mon[31828]: osdmap e94: 12 total, 12 up, 12 in 2024-05-03T22:34:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:59 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2557488735' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T22:34:00.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:33:59 smithi130 ceph-mon[32417]: osdmap e94: 12 total, 12 up, 12 in 2024-05-03T22:34:00.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:00 smithi082 ceph-mon[28404]: pgmap v1025: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:00.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:00 smithi116 ceph-mon[31828]: pgmap v1025: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:01.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:00 smithi130 ceph-mon[32417]: pgmap v1025: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:01.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:01 smithi082 ceph-mon[28404]: pgmap v1026: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:01.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:01 smithi116 ceph-mon[31828]: pgmap v1026: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:02.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:01 smithi130 ceph-mon[32417]: pgmap v1026: 97 pgs: 97 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:02.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.103+0000 7f9348a00700 1 -- 172.21.15.82:0/1983056770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9344108700 msgr2=0x7f93441102d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:02.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.103+0000 7f9348a00700 1 --2- 172.21.15.82:0/1983056770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9344108700 0x7f93441102d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f933c00b0d0 tx=0x7f933c00b3e0 comp rx=0 tx=0).stop 2024-05-03T22:34:02.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.103+0000 7f9348a00700 1 -- 172.21.15.82:0/1983056770 shutdown_connections 2024-05-03T22:34:02.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.103+0000 7f9348a00700 1 --2- 172.21.15.82:0/1983056770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9344108700 0x7f93441102d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:02.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.103+0000 7f9348a00700 1 --2- 172.21.15.82:0/1983056770 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9344103620 0x7f9344103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:02.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.103+0000 7f9348a00700 1 --2- 172.21.15.82:0/1983056770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344103fd0 0x7f9344108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:02.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.103+0000 7f9348a00700 1 -- 172.21.15.82:0/1983056770 >> 172.21.15.82:0/1983056770 conn(0x7f93440feef0 msgr2=0x7f9344101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:34:02.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.104+0000 7f9348a00700 1 -- 172.21.15.82:0/1983056770 shutdown_connections 2024-05-03T22:34:02.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.104+0000 7f9348a00700 1 -- 172.21.15.82:0/1983056770 wait complete. 2024-05-03T22:34:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.105+0000 7f9348a00700 1 Processor -- start 2024-05-03T22:34:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.105+0000 7f9348a00700 1 -- start start 2024-05-03T22:34:02.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.105+0000 7f9348a00700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9344103620 0x7f93440757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:02.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.105+0000 7f9348a00700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344103fd0 0x7f9344075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:02.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.105+0000 7f9348a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9344108700 0x7f9344076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:02.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.105+0000 7f9348a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9344113470 con 0x7f9344108700 2024-05-03T22:34:02.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.105+0000 7f9348a00700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f93441132f0 con 0x7f9344103620 2024-05-03T22:34:02.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.105+0000 7f9348a00700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f93441135f0 con 0x7f9344103fd0 2024-05-03T22:34:02.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.106+0000 7f9343e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9344108700 0x7f9344076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:02.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.106+0000 7f9343e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9344108700 0x7f9344076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51242/0 (socket says 172.21.15.82:51242) 2024-05-03T22:34:02.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.106+0000 7f9343e00700 1 -- 172.21.15.82:0/2347757918 learned_addr learned my addr 172.21.15.82:0/2347757918 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:34:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.106+0000 7f9343400700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9344103620 0x7f93440757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.106+0000 7f9342a00700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344103fd0 0x7f9344075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.106+0000 7f9343e00700 1 -- 172.21.15.82:0/2347757918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344103fd0 msgr2=0x7f9344075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.106+0000 7f9343e00700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344103fd0 0x7f9344075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.106+0000 7f9343e00700 1 -- 172.21.15.82:0/2347757918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9344103620 msgr2=0x7f93440757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.106+0000 7f9343e00700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9344103620 0x7f93440757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.106+0000 7f9343e00700 1 -- 172.21.15.82:0/2347757918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93441a7e10 con 0x7f9344108700 2024-05-03T22:34:02.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.106+0000 7f9343e00700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9344108700 0x7f9344076220 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f933c009850 tx=0x7f933c007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:34:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.107+0000 7f933be00700 1 -- 172.21.15.82:0/2347757918 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c01f030 con 0x7f9344108700 2024-05-03T22:34:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.107+0000 7f933be00700 1 -- 172.21.15.82:0/2347757918 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f933c01bad0 con 0x7f9344108700 2024-05-03T22:34:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.107+0000 7f9348a00700 1 -- 172.21.15.82:0/2347757918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93441a80a0 con 0x7f9344108700 2024-05-03T22:34:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.107+0000 7f933be00700 1 -- 172.21.15.82:0/2347757918 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c012bb0 con 0x7f9344108700 2024-05-03T22:34:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.107+0000 7f9348a00700 1 -- 172.21.15.82:0/2347757918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93441a8550 con 0x7f9344108700 2024-05-03T22:34:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.108+0000 7f9348a00700 1 -- 172.21.15.82:0/2347757918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934406a190 con 0x7f9344108700 2024-05-03T22:34:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.110+0000 7f933be00700 1 -- 172.21.15.82:0/2347757918 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f933c022030 con 0x7f9344108700 2024-05-03T22:34:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.112+0000 7f933be00700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f93280b2910 0x7f93280b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:02.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.112+0000 7f933be00700 1 -- 172.21.15.82:0/2347757918 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9063+0+0 (secure 0 0 0) 0x7f933c00f020 con 0x7f9344108700 2024-05-03T22:34:02.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.112+0000 7f9343400700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f93280b2910 0x7f93280b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:02.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.113+0000 7f9343400700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f93280b2910 0x7f93280b4dd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9334005ea0 tx=0x7f9334005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:34:02.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.115+0000 7f933be00700 1 -- 172.21.15.82:0/2347757918 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f933c029020 con 0x7f9344108700 2024-05-03T22:34:02.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.347+0000 7f9348a00700 1 -- 172.21.15.82:0/2347757918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f934402e510 con 0x7f9344108700 2024-05-03T22:34:02.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.673+0000 7f933be00700 1 -- 172.21.15.82:0/2347757918 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7f933c0074e0 con 0x7f9344108700 2024-05-03T22:34:02.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.678+0000 7f9348a00700 1 -- 172.21.15.82:0/2347757918 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f93280b2910 msgr2=0x7f93280b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:02.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.678+0000 7f9348a00700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f93280b2910 0x7f93280b4dd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9334005ea0 tx=0x7f9334005e30 comp rx=0 tx=0).stop 2024-05-03T22:34:02.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.678+0000 7f9348a00700 1 -- 172.21.15.82:0/2347757918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9344108700 msgr2=0x7f9344076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:02.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.678+0000 7f9348a00700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9344108700 0x7f9344076220 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f933c009850 tx=0x7f933c007e40 comp rx=0 tx=0).stop 2024-05-03T22:34:02.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.679+0000 7f9348a00700 1 -- 172.21.15.82:0/2347757918 shutdown_connections 2024-05-03T22:34:02.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.679+0000 7f9348a00700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7f93280b2910 0x7f93280b4dd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:02.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.679+0000 7f9348a00700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9344108700 0x7f9344076220 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:02.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.679+0000 7f9348a00700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9344103620 0x7f93440757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:02.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.679+0000 7f9348a00700 1 --2- 172.21.15.82:0/2347757918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344103fd0 0x7f9344075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:02.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.679+0000 7f9348a00700 1 -- 172.21.15.82:0/2347757918 >> 172.21.15.82:0/2347757918 conn(0x7f93440feef0 msgr2=0x7f93440ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:34:02.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.680+0000 7f9348a00700 1 -- 172.21.15.82:0/2347757918 shutdown_connections 2024-05-03T22:34:02.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:02.681+0000 7f9348a00700 1 -- 172.21.15.82:0/2347757918 wait complete. 2024-05-03T22:34:02.685 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2024-05-03T22:34:02.935 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:02 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2347757918' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T22:34:02.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:02 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2347757918' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T22:34:03.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:02 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2347757918' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T22:34:03.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 81cd0262-0998-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-03T22:34:03.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:03 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/2347757918' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T22:34:03.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:03 smithi082 ceph-mon[28404]: osdmap e95: 12 total, 12 up, 12 in 2024-05-03T22:34:03.727 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:03 smithi082 ceph-mon[28404]: pgmap v1028: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:03.963 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:34:04.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:03 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/2347757918' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T22:34:04.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:03 smithi130 ceph-mon[32417]: osdmap e95: 12 total, 12 up, 12 in 2024-05-03T22:34:04.027 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:03 smithi130 ceph-mon[32417]: pgmap v1028: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:04.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:03 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/2347757918' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T22:34:04.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:03 smithi116 ceph-mon[31828]: osdmap e95: 12 total, 12 up, 12 in 2024-05-03T22:34:04.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:03 smithi116 ceph-mon[31828]: pgmap v1028: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:06.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.192+0000 7efeb7000700 1 -- 172.21.15.82:0/2620441734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb010a490 msgr2=0x7efeb01169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:06.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.192+0000 7efeb7000700 1 --2- 172.21.15.82:0/2620441734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb010a490 0x7efeb01169a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efea800b0a0 tx=0x7efea800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:34:06.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.192+0000 7efeb7000700 1 -- 172.21.15.82:0/2620441734 shutdown_connections 2024-05-03T22:34:06.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.192+0000 7efeb7000700 1 --2- 172.21.15.82:0/2620441734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb010a490 0x7efeb01169a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:06.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.192+0000 7efeb7000700 1 --2- 172.21.15.82:0/2620441734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeb010fb60 0x7efeb010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:06.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.192+0000 7efeb7000700 1 --2- 172.21.15.82:0/2620441734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb0109ad0 0x7efeb0109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:06.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.192+0000 7efeb7000700 1 -- 172.21.15.82:0/2620441734 >> 172.21.15.82:0/2620441734 conn(0x7efeb0076c70 msgr2=0x7efeb01082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:34:06.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.192+0000 7efeb7000700 1 -- 172.21.15.82:0/2620441734 shutdown_connections 2024-05-03T22:34:06.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.192+0000 7efeb7000700 1 -- 172.21.15.82:0/2620441734 wait complete. 2024-05-03T22:34:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.193+0000 7efeb7000700 1 Processor -- start 2024-05-03T22:34:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.194+0000 7efeb7000700 1 -- start start 2024-05-03T22:34:06.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.194+0000 7efeb7000700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb0109ad0 0x7efeb01a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.194+0000 7efeb7000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb010a490 0x7efeb01a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.194+0000 7efeb7000700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeb010fb60 0x7efeb01a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.194+0000 7efeb7000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0119b80 con 0x7efeb010a490 2024-05-03T22:34:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.194+0000 7efeb7000700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0119a00 con 0x7efeb0109ad0 2024-05-03T22:34:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.194+0000 7efeb7000700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0119d00 con 0x7efeb010fb60 2024-05-03T22:34:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.194+0000 7efeaf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb010a490 0x7efeb01a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:06.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.195+0000 7efeaf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb010a490 0x7efeb01a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36712/0 (socket says 172.21.15.82:36712) 2024-05-03T22:34:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.195+0000 7efeaf400700 1 -- 172.21.15.82:0/383861903 learned_addr learned my addr 172.21.15.82:0/383861903 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-03T22:34:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.195+0000 7efeafe00700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb0109ad0 0x7efeb01a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.195+0000 7efeb5000700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeb010fb60 0x7efeb01a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.195+0000 7efeaf400700 1 -- 172.21.15.82:0/383861903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeb010fb60 msgr2=0x7efeb01a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.195+0000 7efeaf400700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeb010fb60 0x7efeb01a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.195+0000 7efeaf400700 1 -- 172.21.15.82:0/383861903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb0109ad0 msgr2=0x7efeb01a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.195+0000 7efeaf400700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb0109ad0 0x7efeb01a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:06.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.195+0000 7efeaf400700 1 -- 172.21.15.82:0/383861903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb01a5060 con 0x7efeb010a490 2024-05-03T22:34:06.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.195+0000 7efeb5000700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeb010fb60 0x7efeb01a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:34:06.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.196+0000 7efeaf400700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb010a490 0x7efeb01a0590 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00d950 tx=0x7efe9c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:34:06.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.196+0000 7efeacc00700 1 -- 172.21.15.82:0/383861903 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c016070 con 0x7efeb010a490 2024-05-03T22:34:06.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.196+0000 7efeacc00700 1 -- 172.21.15.82:0/383861903 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe9c010460 con 0x7efeb010a490 2024-05-03T22:34:06.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.196+0000 7efeacc00700 1 -- 172.21.15.82:0/383861903 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00f620 con 0x7efeb010a490 2024-05-03T22:34:06.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.196+0000 7efeb7000700 1 -- 172.21.15.82:0/383861903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb01a52f0 con 0x7efeb010a490 2024-05-03T22:34:06.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.196+0000 7efeb7000700 1 -- 172.21.15.82:0/383861903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb01acbd0 con 0x7efeb010a490 2024-05-03T22:34:06.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.197+0000 7efeb7000700 1 -- 172.21.15.82:0/383861903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb006a190 con 0x7efeb010a490 2024-05-03T22:34:06.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.203+0000 7efeacc00700 1 -- 172.21.15.82:0/383861903 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7efe9c019070 con 0x7efeb010a490 2024-05-03T22:34:06.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.205+0000 7efeacc00700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efe940b2990 0x7efe940b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:06.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.205+0000 7efeacc00700 1 -- 172.21.15.82:0/383861903 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8475+0+0 (secure 0 0 0) 0x7efe9c0e2070 con 0x7efeb010a490 2024-05-03T22:34:06.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.205+0000 7efeafe00700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efe940b2990 0x7efe940b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:06.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.205+0000 7efeacc00700 1 -- 172.21.15.82:0/383861903 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7efe9c0e24f0 con 0x7efeb010a490 2024-05-03T22:34:06.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.206+0000 7efeafe00700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efe940b2990 0x7efe940b4e50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efea000bbb0 tx=0x7efea000b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:34:06.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:06.438+0000 7efeb7000700 1 -- 172.21.15.82:0/383861903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7efeb002e510 con 0x7efeb010a490 2024-05-03T22:34:06.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:06 smithi082 ceph-mon[28404]: pgmap v1029: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:06.686 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:06 smithi116 ceph-mon[31828]: pgmap v1029: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:06.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:06 smithi130 ceph-mon[32417]: pgmap v1029: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:07.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.328+0000 7efeacc00700 1 -- 172.21.15.82:0/383861903 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v96) ==== 178+0+0 (secure 0 0 0) 0x7efe9c0a9ae0 con 0x7efeb010a490 2024-05-03T22:34:07.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.333+0000 7efeb7000700 1 -- 172.21.15.82:0/383861903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efe940b2990 msgr2=0x7efe940b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:07.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.333+0000 7efeb7000700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efe940b2990 0x7efe940b4e50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efea000bbb0 tx=0x7efea000b590 comp rx=0 tx=0).stop 2024-05-03T22:34:07.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.333+0000 7efeb7000700 1 -- 172.21.15.82:0/383861903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb010a490 msgr2=0x7efeb01a0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:07.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.333+0000 7efeb7000700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb010a490 0x7efeb01a0590 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00d950 tx=0x7efe9c00dd10 comp rx=0 tx=0).stop 2024-05-03T22:34:07.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.333+0000 7efeb7000700 1 -- 172.21.15.82:0/383861903 shutdown_connections 2024-05-03T22:34:07.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.333+0000 7efeb7000700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.82:6800/3338115086,v1:172.21.15.82:6801/3338115086] conn(0x7efe940b2990 0x7efe940b4e50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:07.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.333+0000 7efeb7000700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efeb010fb60 0x7efeb01a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:07.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.333+0000 7efeb7000700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb0109ad0 0x7efeb01a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:07.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.333+0000 7efeb7000700 1 --2- 172.21.15.82:0/383861903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeb010a490 0x7efeb01a0590 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:07.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.333+0000 7efeb7000700 1 -- 172.21.15.82:0/383861903 >> 172.21.15.82:0/383861903 conn(0x7efeb0076c70 msgr2=0x7efeb0077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:34:07.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.335+0000 7efeb7000700 1 -- 172.21.15.82:0/383861903 shutdown_connections 2024-05-03T22:34:07.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-03T22:34:07.335+0000 7efeb7000700 1 -- 172.21.15.82:0/383861903 wait complete. 2024-05-03T22:34:07.339 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data_ec' removed 2024-05-03T22:34:07.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:07 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/383861903' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T22:34:07.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:07 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/383861903' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T22:34:07.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:07 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/383861903' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T22:34:08.199 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:34:08.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:34:08.384 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:34:08.476 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-03T22:34:08.477 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-03T22:34:08.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:08 smithi082 ceph-mon[28404]: pgmap v1030: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:08.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:08 smithi082 ceph-mon[28404]: from='client.? 172.21.15.82:0/383861903' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T22:34:08.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:08 smithi082 ceph-mon[28404]: osdmap e96: 12 total, 12 up, 12 in 2024-05-03T22:34:08.535 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-03T22:34:08.592 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-03T22:34:08.648 INFO:tasks.cephadm:Stopping all daemons... 2024-05-03T22:34:08.649 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-03T22:34:08.649 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.a 2024-05-03T22:34:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:08 smithi116 ceph-mon[31828]: pgmap v1030: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:08 smithi116 ceph-mon[31828]: from='client.? 172.21.15.82:0/383861903' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T22:34:08.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:08 smithi116 ceph-mon[31828]: osdmap e96: 12 total, 12 up, 12 in 2024-05-03T22:34:08.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:08 smithi130 ceph-mon[32417]: pgmap v1030: 33 pgs: 33 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:34:08.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:08 smithi130 ceph-mon[32417]: from='client.? 172.21.15.82:0/383861903' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T22:34:08.777 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:08 smithi130 ceph-mon[32417]: osdmap e96: 12 total, 12 up, 12 in 2024-05-03T22:34:08.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:08 smithi082 systemd[1]: Stopping Ceph mon.a for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:34:09.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:09 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a[28400]: 2024-05-03T22:34:09.217+0000 7fae84200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:34:09.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:09 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a[28400]: 2024-05-03T22:34:09.217+0000 7fae84200700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-03T22:34:09.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:09 smithi082 podman[90608]: 2024-05-03 22:34:09.465916871 +0000 UTC m=+0.403690955 container died 7441df8970a66781196012546ef2983836624e855e2ce8900d1a94679f3f25f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:34:10.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:09 smithi082 podman[90608]: 2024-05-03 22:34:09.910734017 +0000 UTC m=+0.848508094 container cleanup 7441df8970a66781196012546ef2983836624e855e2ce8900d1a94679f3f25f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:34:10.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:09 smithi082 bash[90608]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a 2024-05-03T22:34:10.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 03 22:34:10 smithi082 podman[90622]: 2024-05-03 22:34:10.186947595 +0000 UTC m=+0.702542986 container remove 7441df8970a66781196012546ef2983836624e855e2ce8900d1a94679f3f25f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-a, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:34:10.639 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.a.service' 2024-05-03T22:34:10.761 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:34:10.761 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-03T22:34:10.761 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-03T22:34:10.762 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.b 2024-05-03T22:34:11.185 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:10 smithi116 systemd[1]: Stopping Ceph mon.b for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:34:11.559 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:11 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-b[31824]: 2024-05-03T22:34:11.332+0000 7fc3cd600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:34:11.559 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:11 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-b[31824]: 2024-05-03T22:34:11.332+0000 7fc3cd600700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-03T22:34:11.897 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:11 smithi116 podman[67568]: 2024-05-03 22:34:11.620203502 +0000 UTC m=+0.438718840 container died 284277348d57b674c6e88182a605eb421c0ea66e4adc736e249c19e97c78b494 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-03T22:34:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:12 smithi116 podman[67568]: 2024-05-03 22:34:12.209425819 +0000 UTC m=+1.027941191 container cleanup 284277348d57b674c6e88182a605eb421c0ea66e4adc736e249c19e97c78b494 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-03T22:34:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:12 smithi116 bash[67568]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-b 2024-05-03T22:34:12.685 INFO:journalctl@ceph.mon.b.smithi116.stdout:May 03 22:34:12 smithi116 podman[67583]: 2024-05-03 22:34:12.410814481 +0000 UTC m=+0.778742430 container remove 284277348d57b674c6e88182a605eb421c0ea66e4adc736e249c19e97c78b494 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-03T22:34:12.864 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.b.service' 2024-05-03T22:34:12.964 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:34:12.964 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-03T22:34:12.965 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-03T22:34:12.965 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.c 2024-05-03T22:34:13.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:13 smithi130 systemd[1]: Stopping Ceph mon.c for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:34:13.981 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:13 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-c[32402]: 2024-05-03T22:34:13.544+0000 7f4102000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:34:13.981 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:13 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-c[32402]: 2024-05-03T22:34:13.544+0000 7f4102000700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-03T22:34:13.981 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:13 smithi130 podman[68890]: 2024-05-03 22:34:13.658075352 +0000 UTC m=+0.259636973 container died 66ca09a37d548889181a4c8390eb59a507d0954542aa2209452f7f4db2bbbd9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:34:14.247 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:14 smithi130 podman[68890]: 2024-05-03 22:34:14.213587316 +0000 UTC m=+0.815148930 container cleanup 66ca09a37d548889181a4c8390eb59a507d0954542aa2209452f7f4db2bbbd9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-c, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-03T22:34:14.247 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:14 smithi130 bash[68890]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-c 2024-05-03T22:34:14.527 INFO:journalctl@ceph.mon.c.smithi130.stdout:May 03 22:34:14 smithi130 podman[68904]: 2024-05-03 22:34:14.47378723 +0000 UTC m=+0.801767071 container remove 66ca09a37d548889181a4c8390eb59a507d0954542aa2209452f7f4db2bbbd9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mon-c, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-05-03T22:34:14.976 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mon.c.service' 2024-05-03T22:34:15.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:34:15.114 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-03T22:34:15.114 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-03T22:34:15.114 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.x 2024-05-03T22:34:15.476 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:34:15 smithi082 systemd[1]: Stopping Ceph mgr.x for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:34:15.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:34:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:34:15.670+0000 7f2bd9600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:34:15.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:34:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x[28633]: 2024-05-03T22:34:15.670+0000 7f2bd9600700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-03T22:34:15.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:34:15 smithi082 podman[90740]: 2024-05-03 22:34:15.775630574 +0000 UTC m=+0.234941465 container died 26e2b13a17ed719d4fda0b0459eaebebc205cbb4bca7aa9cebb239ae4cf51a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-03T22:34:16.476 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:34:16 smithi082 podman[90740]: 2024-05-03 22:34:16.281350781 +0000 UTC m=+0.740661648 container cleanup 26e2b13a17ed719d4fda0b0459eaebebc205cbb4bca7aa9cebb239ae4cf51a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:34:16.477 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:34:16 smithi082 bash[90740]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x 2024-05-03T22:34:16.976 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 03 22:34:16 smithi082 podman[90754]: 2024-05-03 22:34:16.507421516 +0000 UTC m=+0.726687050 container remove 26e2b13a17ed719d4fda0b0459eaebebc205cbb4bca7aa9cebb239ae4cf51a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:34:17.062 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-03T22:34:17.172 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:34:17.173 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-03T22:34:17.173 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-03T22:34:17.173 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.y 2024-05-03T22:34:17.685 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:34:17 smithi116 systemd[1]: Stopping Ceph mgr.y for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:34:18.185 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:34:17 smithi116 podman[67701]: 2024-05-03 22:34:17.840348547 +0000 UTC m=+0.238427967 container died 13c49b309a19b8f7a5b17af6c166188677e95c1d00e39900283baaceedd254a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS) 2024-05-03T22:34:18.610 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:34:18 smithi116 podman[67701]: 2024-05-03 22:34:18.3733809 +0000 UTC m=+0.771460323 container cleanup 13c49b309a19b8f7a5b17af6c166188677e95c1d00e39900283baaceedd254a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-03T22:34:18.610 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:34:18 smithi116 bash[67701]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y 2024-05-03T22:34:18.935 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:34:18 smithi116 podman[67716]: 2024-05-03 22:34:18.608286039 +0000 UTC m=+0.749130302 container remove 13c49b309a19b8f7a5b17af6c166188677e95c1d00e39900283baaceedd254a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-y, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-03T22:34:18.935 INFO:journalctl@ceph.mgr.y.smithi116.stdout:May 03 22:34:18 smithi116 systemd[1]: ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-03T22:34:19.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-03T22:34:19.253 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:34:19.254 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-03T22:34:19.254 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-03T22:34:19.254 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.z 2024-05-03T22:34:19.777 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:34:19 smithi130 systemd[1]: Stopping Ceph mgr.z for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:34:20.251 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:34:19 smithi130 podman[69025]: 2024-05-03 22:34:19.939509096 +0000 UTC m=+0.254534413 container died 18724542bbbdec7c7c32b4ac3099c4dc2ec630b97350e26d3d6f2859bc945d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-03T22:34:20.527 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:34:20 smithi130 podman[69025]: 2024-05-03 22:34:20.427967086 +0000 UTC m=+0.742992381 container cleanup 18724542bbbdec7c7c32b4ac3099c4dc2ec630b97350e26d3d6f2859bc945d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0) 2024-05-03T22:34:20.527 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:34:20 smithi130 bash[69025]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z 2024-05-03T22:34:21.027 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:34:20 smithi130 podman[69039]: 2024-05-03 22:34:20.637783067 +0000 UTC m=+0.685963601 container remove 18724542bbbdec7c7c32b4ac3099c4dc2ec630b97350e26d3d6f2859bc945d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=) 2024-05-03T22:34:21.027 INFO:journalctl@ceph.mgr.z.smithi130.stdout:May 03 22:34:20 smithi130 systemd[1]: ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-03T22:34:21.168 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mgr.z.service' 2024-05-03T22:34:21.281 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:34:21.281 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-03T22:34:21.282 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-03T22:34:21.282 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.0 2024-05-03T22:34:21.726 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:21 smithi082 systemd[1]: Stopping Ceph osd.0 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:34:22.227 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:21 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0[40702]: 2024-05-03T22:34:21.865+0000 7fd45ce00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:34:22.227 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:21 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0[40702]: 2024-05-03T22:34:21.866+0000 7fd45ce00700 -1 osd.0 96 *** Got signal Terminated *** 2024-05-03T22:34:22.227 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:21 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0[40702]: 2024-05-03T22:34:21.866+0000 7fd45ce00700 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:34:27.700 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:27 smithi082 podman[90861]: 2024-05-03 22:34:27.379407279 +0000 UTC m=+5.672370151 container died c1475ed3f020203a8ad97836d2f6965b3328fc26abfdae397ccb9bc84cf70024 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240430) 2024-05-03T22:34:27.976 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:27 smithi082 podman[90861]: 2024-05-03 22:34:27.84273798 +0000 UTC m=+6.135700855 container cleanup c1475ed3f020203a8ad97836d2f6965b3328fc26abfdae397ccb9bc84cf70024 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:34:27.977 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:27 smithi082 bash[90861]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0 2024-05-03T22:34:28.476 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:28 smithi082 podman[90880]: 2024-05-03 22:34:28.077621445 +0000 UTC m=+0.688799307 container remove c1475ed3f020203a8ad97836d2f6965b3328fc26abfdae397ccb9bc84cf70024 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5) 2024-05-03T22:34:29.227 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:28 smithi082 podman[90972]: 2024-05-03 22:34:28.819172191 +0000 UTC m=+0.032545116 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:34:29.227 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:28 smithi082 podman[90972]: 2024-05-03 22:34:28.953710673 +0000 UTC m=+0.167083650 container create 593e808381915d577cfd2a7dc8cfa1ecefb43b45ec43de31a519d835f064227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-03T22:34:29.726 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:29 smithi082 podman[90972]: 2024-05-03 22:34:29.274460501 +0000 UTC m=+0.487833462 container init 593e808381915d577cfd2a7dc8cfa1ecefb43b45ec43de31a519d835f064227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:34:29.727 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:29 smithi082 podman[90972]: 2024-05-03 22:34:29.285618992 +0000 UTC m=+0.498991980 container start 593e808381915d577cfd2a7dc8cfa1ecefb43b45ec43de31a519d835f064227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=) 2024-05-03T22:34:29.727 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:29 smithi082 podman[90972]: 2024-05-03 22:34:29.397928895 +0000 UTC m=+0.611301831 container attach 593e808381915d577cfd2a7dc8cfa1ecefb43b45ec43de31a519d835f064227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-03T22:34:30.140 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 03 22:34:29 smithi082 podman[90972]: 2024-05-03 22:34:29.7311537 +0000 UTC m=+0.944526618 container died 593e808381915d577cfd2a7dc8cfa1ecefb43b45ec43de31a519d835f064227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-0-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-05-03T22:34:30.584 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.0.service' 2024-05-03T22:34:30.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:34:30.681 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-03T22:34:30.681 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-03T22:34:30.682 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.1 2024-05-03T22:34:31.185 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:30 smithi116 systemd[1]: Stopping Ceph osd.1 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:34:31.685 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:31 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1[36414]: 2024-05-03T22:34:31.293+0000 7f73cb200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:34:31.685 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:31 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1[36414]: 2024-05-03T22:34:31.293+0000 7f73cb200700 -1 osd.1 96 *** Got signal Terminated *** 2024-05-03T22:34:31.685 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:31 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1[36414]: 2024-05-03T22:34:31.293+0000 7f73cb200700 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:34:36.935 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:36 smithi116 podman[67826]: 2024-05-03 22:34:36.6787523 +0000 UTC m=+5.533070371 container died 0b335bd86268404c5cef264650fb7b543e6f7710e73de9652993abea447015a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-03T22:34:37.365 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:37 smithi116 podman[67826]: 2024-05-03 22:34:37.128395021 +0000 UTC m=+5.982713078 container cleanup 0b335bd86268404c5cef264650fb7b543e6f7710e73de9652993abea447015a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-03T22:34:37.365 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:37 smithi116 bash[67826]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1 2024-05-03T22:34:37.685 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:37 smithi116 podman[67845]: 2024-05-03 22:34:37.36335107 +0000 UTC m=+0.668199860 container remove 0b335bd86268404c5cef264650fb7b543e6f7710e73de9652993abea447015a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:34:38.435 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:38 smithi116 podman[67932]: 2024-05-03 22:34:38.046125665 +0000 UTC m=+0.035939122 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:34:38.436 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:38 smithi116 podman[67932]: 2024-05-03 22:34:38.17257916 +0000 UTC m=+0.162392614 container create 7cb9e7682e74b9ba022ea8e25873d15b50d44faf51fdef9c29aac9b0c5d59ce7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD) 2024-05-03T22:34:38.926 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:38 smithi116 podman[67932]: 2024-05-03 22:34:38.469577915 +0000 UTC m=+0.459391502 container init 7cb9e7682e74b9ba022ea8e25873d15b50d44faf51fdef9c29aac9b0c5d59ce7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, ceph=True, io.buildah.version=1.33.5) 2024-05-03T22:34:38.926 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:38 smithi116 podman[67932]: 2024-05-03 22:34:38.48232162 +0000 UTC m=+0.472135074 container start 7cb9e7682e74b9ba022ea8e25873d15b50d44faf51fdef9c29aac9b0c5d59ce7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-03T22:34:38.926 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:38 smithi116 podman[67932]: 2024-05-03 22:34:38.592418995 +0000 UTC m=+0.582232509 container attach 7cb9e7682e74b9ba022ea8e25873d15b50d44faf51fdef9c29aac9b0c5d59ce7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:34:38.926 INFO:journalctl@ceph.osd.1.smithi116.stdout:May 03 22:34:38 smithi116 podman[67932]: 2024-05-03 22:34:38.924539436 +0000 UTC m=+0.914352940 container died 7cb9e7682e74b9ba022ea8e25873d15b50d44faf51fdef9c29aac9b0c5d59ce7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-03T22:34:39.703 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.1.service' 2024-05-03T22:34:39.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:34:39.816 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-03T22:34:39.816 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-03T22:34:39.816 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.2 2024-05-03T22:34:40.277 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:39 smithi130 systemd[1]: Stopping Ceph osd.2 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:34:40.778 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:40 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2[37675]: 2024-05-03T22:34:40.397+0000 7f9924400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:34:40.778 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:40 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2[37675]: 2024-05-03T22:34:40.397+0000 7f9924400700 -1 osd.2 96 *** Got signal Terminated *** 2024-05-03T22:34:40.778 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:40 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2[37675]: 2024-05-03T22:34:40.397+0000 7f9924400700 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:34:46.106 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:45 smithi130 podman[69148]: 2024-05-03 22:34:45.818631864 +0000 UTC m=+5.559738610 container died b91dcd4de9622a01d7362b4351bbaea22425989bef1a945f3e185019f95be9aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-03T22:34:46.527 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:46 smithi130 podman[69148]: 2024-05-03 22:34:46.19868507 +0000 UTC m=+5.939791853 container cleanup b91dcd4de9622a01d7362b4351bbaea22425989bef1a945f3e185019f95be9aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-03T22:34:46.527 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:46 smithi130 bash[69148]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2 2024-05-03T22:34:47.027 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:46 smithi130 podman[69166]: 2024-05-03 22:34:46.583697094 +0000 UTC m=+0.751185140 container remove b91dcd4de9622a01d7362b4351bbaea22425989bef1a945f3e185019f95be9aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-03T22:34:47.527 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:47 smithi130 podman[69254]: 2024-05-03 22:34:47.103479352 +0000 UTC m=+0.037780896 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:34:47.528 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:47 smithi130 podman[69254]: 2024-05-03 22:34:47.26802476 +0000 UTC m=+0.202326313 container create 39f03751c1c5aa0db47c691eed6722c19a21cfe3d04f82678af86bd626c46135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:34:48.019 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:47 smithi130 podman[69254]: 2024-05-03 22:34:47.556650669 +0000 UTC m=+0.490952220 container init 39f03751c1c5aa0db47c691eed6722c19a21cfe3d04f82678af86bd626c46135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-03T22:34:48.020 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:47 smithi130 podman[69254]: 2024-05-03 22:34:47.568664573 +0000 UTC m=+0.502966136 container start 39f03751c1c5aa0db47c691eed6722c19a21cfe3d04f82678af86bd626c46135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD) 2024-05-03T22:34:48.020 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:47 smithi130 podman[69254]: 2024-05-03 22:34:47.628727106 +0000 UTC m=+0.563028666 container attach 39f03751c1c5aa0db47c691eed6722c19a21cfe3d04f82678af86bd626c46135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:34:48.277 INFO:journalctl@ceph.osd.2.smithi130.stdout:May 03 22:34:48 smithi130 podman[69254]: 2024-05-03 22:34:48.018211937 +0000 UTC m=+0.952513458 container died 39f03751c1c5aa0db47c691eed6722c19a21cfe3d04f82678af86bd626c46135 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:34:48.321 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:48 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:48.023+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:48.727 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:48 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3[47328]: 2024-05-03T22:34:48.318+0000 7fd8a6400700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:24.467231+0000 front 2024-05-03T22:34:24.467404+0000 (oldest deadline 2024-05-03T22:34:47.967158+0000) 2024-05-03T22:34:48.781 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.2.service' 2024-05-03T22:34:48.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:34:48.883 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-03T22:34:48.884 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-03T22:34:48.884 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.3 2024-05-03T22:34:48.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:48 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:48.669+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:34:49.226 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:49.041+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:49.226 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:49 smithi082 systemd[1]: Stopping Ceph osd.3 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:34:49.229 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:34:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:34:49.079+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:34:49.726 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3[47328]: 2024-05-03T22:34:49.308+0000 7fd8a6400700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:24.467231+0000 front 2024-05-03T22:34:24.467404+0000 (oldest deadline 2024-05-03T22:34:47.967158+0000) 2024-05-03T22:34:49.727 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3[47328]: 2024-05-03T22:34:49.451+0000 7fd8aac00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:34:49.727 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3[47328]: 2024-05-03T22:34:49.451+0000 7fd8aac00700 -1 osd.3 96 *** Got signal Terminated *** 2024-05-03T22:34:49.727 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3[47328]: 2024-05-03T22:34:49.451+0000 7fd8aac00700 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:34:49.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:49 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:49.700+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:34:50.278 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:50 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:50.003+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:50.279 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:34:50 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:34:50.071+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:34:50.726 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:50 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3[47328]: 2024-05-03T22:34:50.277+0000 7fd8a6400700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:24.467231+0000 front 2024-05-03T22:34:24.467404+0000 (oldest deadline 2024-05-03T22:34:47.967158+0000) 2024-05-03T22:34:50.777 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:34:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:34:50.335+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:34:50.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:50.724+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:34:51.226 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:50 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:50.984+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:51.227 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:34:51 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:34:51.081+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:34:51.547 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:51 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3[47328]: 2024-05-03T22:34:51.226+0000 7fd8a6400700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:24.467231+0000 front 2024-05-03T22:34:24.467404+0000 (oldest deadline 2024-05-03T22:34:47.967158+0000) 2024-05-03T22:34:51.777 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:34:51 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:34:51.305+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:34:51.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:34:51 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:34:51.410+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:34:52.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:51 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:51.689+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:34:52.226 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:51 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:51.942+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:52.227 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:34:52 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:34:52.109+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:34:52.726 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:52 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3[47328]: 2024-05-03T22:34:52.241+0000 7fd8a6400700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:24.467231+0000 front 2024-05-03T22:34:24.467404+0000 (oldest deadline 2024-05-03T22:34:47.967158+0000) 2024-05-03T22:34:52.777 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:34:52 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:34:52.301+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:34:52.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:34:52 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:34:52.411+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:34:53.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:52 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:52.711+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:34:53.226 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:52 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:52.904+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:53.226 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:34:53 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:34:53.121+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:34:53.726 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:53 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3[47328]: 2024-05-03T22:34:53.272+0000 7fd8a6400700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:24.467231+0000 front 2024-05-03T22:34:24.467404+0000 (oldest deadline 2024-05-03T22:34:47.967158+0000) 2024-05-03T22:34:53.777 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:34:53 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:34:53.314+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:34:53.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:34:53 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:34:53.434+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:34:54.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:53 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:53.758+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:34:54.226 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:53 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:53.886+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:54.226 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:34:54 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:34:54.092+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:34:54.476 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:54 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3[47328]: 2024-05-03T22:34:54.223+0000 7fd8a6400700 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:24.467231+0000 front 2024-05-03T22:34:24.467404+0000 (oldest deadline 2024-05-03T22:34:47.967158+0000) 2024-05-03T22:34:54.777 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:34:54 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:34:54.292+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:34:54.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:34:54 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:34:54.399+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:34:55.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:54 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:54.747+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:34:55.226 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:54 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:54.920+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:55.227 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:34:55 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:34:55.108+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:34:55.227 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:55 smithi082 podman[91093]: 2024-05-03 22:34:55.048880756 +0000 UTC m=+5.740953374 container died 51aa294b761dfc1186913e9efceca6a59b148333854ef614330b7555365d3da0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-03T22:34:55.726 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:55 smithi082 podman[91093]: 2024-05-03 22:34:55.493020866 +0000 UTC m=+6.185093520 container cleanup 51aa294b761dfc1186913e9efceca6a59b148333854ef614330b7555365d3da0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:34:55.727 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:55 smithi082 bash[91093]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3 2024-05-03T22:34:55.777 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:34:55 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:34:55.291+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:34:55.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:34:55 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:34:55.367+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:34:56.105 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:55 smithi082 podman[91113]: 2024-05-03 22:34:55.760872399 +0000 UTC m=+0.698878918 container remove 51aa294b761dfc1186913e9efceca6a59b148333854ef614330b7555365d3da0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:34:56.105 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:55 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:55.968+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:56.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:55 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:55.794+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:34:56.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:34:56 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:34:56.102+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:34:56.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:34:56 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:34:56.271+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:34:56.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:34:56 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:34:56.358+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:34:56.928 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:56 smithi082 podman[91200]: 2024-05-03 22:34:56.489048695 +0000 UTC m=+0.045800650 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:34:56.928 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:56 smithi082 podman[91200]: 2024-05-03 22:34:56.636635496 +0000 UTC m=+0.193387411 container create 3445ef31c60e0f5cd198a0efa9ab2ab3c37950bdfa8d01452a59acb78680c1ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-05-03T22:34:56.928 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:56 smithi082 podman[91200]: 2024-05-03 22:34:56.926578665 +0000 UTC m=+0.483330627 container init 3445ef31c60e0f5cd198a0efa9ab2ab3c37950bdfa8d01452a59acb78680c1ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-05-03T22:34:57.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:56 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:56.749+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:34:57.226 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:56 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:56.976+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:57.227 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:34:57 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:34:57.092+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:34:57.227 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:56 smithi082 podman[91200]: 2024-05-03 22:34:56.938122046 +0000 UTC m=+0.494873939 container start 3445ef31c60e0f5cd198a0efa9ab2ab3c37950bdfa8d01452a59acb78680c1ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True) 2024-05-03T22:34:57.227 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:57 smithi082 podman[91200]: 2024-05-03 22:34:57.022613876 +0000 UTC m=+0.579365762 container attach 3445ef31c60e0f5cd198a0efa9ab2ab3c37950bdfa8d01452a59acb78680c1ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-03T22:34:57.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:34:57 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:34:57.222+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:34:57.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:34:57 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:34:57.402+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:34:57.726 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 03 22:34:57 smithi082 podman[91200]: 2024-05-03 22:34:57.396799157 +0000 UTC m=+0.953551052 container died 3445ef31c60e0f5cd198a0efa9ab2ab3c37950bdfa8d01452a59acb78680c1ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS) 2024-05-03T22:34:58.119 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:34:57 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:34:57.826+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:34:58.134 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:57 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:57.963+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:58.134 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:57 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:57.963+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:34:58.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:57 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:57.733+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:34:58.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.3.service' 2024-05-03T22:34:58.299 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:34:58.299 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-03T22:34:58.299 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-03T22:34:58.299 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.4 2024-05-03T22:34:58.449 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:34:58 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:34:58.190+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:34:58.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:34:58 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:34:58.131+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:34:58.685 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:34:58 smithi116 systemd[1]: Stopping Ceph osd.4 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:34:58.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:34:58 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:34:58.446+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:34:59.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:58.714+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:34:59.186 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:34:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4[43176]: 2024-05-03T22:34:58.905+0000 7fe304a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:34:59.186 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:34:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4[43176]: 2024-05-03T22:34:58.905+0000 7fe304a00700 -1 osd.4 96 *** Got signal Terminated *** 2024-05-03T22:34:59.186 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:34:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4[43176]: 2024-05-03T22:34:58.905+0000 7fe304a00700 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:34:59.217 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:34:58 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:34:58.816+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:34:59.333 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:34:59 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:34:59.137+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:34:59.334 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:59 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:59.001+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:34:59.334 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:59 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:59.001+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:34:59.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:34:59 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:34:59.214+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:34:59.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:34:59 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:34:59.449+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:34:59.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:34:59 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:34:59.449+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:34:59.685 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:34:59 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4[43176]: 2024-05-03T22:34:59.189+0000 7fe300200700 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.489063+0000 front 2024-05-03T22:34:34.490036+0000 (oldest deadline 2024-05-03T22:34:58.589021+0000) 2024-05-03T22:34:59.992 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:34:59 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:34:59.693+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:00.240 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:34:59 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:34:59.860+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:00.435 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:00 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4[43176]: 2024-05-03T22:35:00.156+0000 7fe300200700 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.489063+0000 front 2024-05-03T22:34:34.490036+0000 (oldest deadline 2024-05-03T22:34:58.589021+0000) 2024-05-03T22:35:00.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:00 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:00.135+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:00.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:59 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:59.984+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:00.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:34:59 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:34:59.984+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:00.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:00.238+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:00.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:00.487+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:00.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:00.487+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:00.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:00 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:00.686+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:01.222 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:00.885+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:01.226 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:00 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:00.997+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:01.226 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:00 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:00.997+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:01.226 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:01 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:01.106+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:01.227 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:01 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:01.106+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:01.435 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:01 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4[43176]: 2024-05-03T22:35:01.156+0000 7fe300200700 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.489063+0000 front 2024-05-03T22:34:34.490036+0000 (oldest deadline 2024-05-03T22:34:58.589021+0000) 2024-05-03T22:35:01.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:01.220+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:01.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:01.220+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:01.884 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:01.525+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:01.885 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:01.525+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:02.119 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:01 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:01.704+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:02.119 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:01 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:01.704+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:02.119 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:01 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:01.930+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:02.181 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:01.882+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:02.435 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:02 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4[43176]: 2024-05-03T22:35:02.116+0000 7fe300200700 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.489063+0000 front 2024-05-03T22:34:34.490036+0000 (oldest deadline 2024-05-03T22:34:58.589021+0000) 2024-05-03T22:35:02.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:02 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:02.037+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:02.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:02 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:02.037+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:02.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:02 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:02.069+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:02.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:02 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:02.069+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:02.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:02.178+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:02.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:02.178+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:02.914 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:02.545+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:02.914 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:02.545+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:02.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:02 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:02.676+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:02.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:02 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:02.676+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:03.209 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:02.912+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:03.435 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:03 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4[43176]: 2024-05-03T22:35:03.135+0000 7fe300200700 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.489063+0000 front 2024-05-03T22:34:34.490036+0000 (oldest deadline 2024-05-03T22:34:58.589021+0000) 2024-05-03T22:35:03.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:02 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:02.963+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:03.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:03 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:03.071+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:03.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:03 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:03.071+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:03.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:03 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:03.102+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:03.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:03 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:03.102+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:03.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:03.206+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:03.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:03.206+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:03.877 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:03.538+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:03.877 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:03.539+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:04.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:03 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:03.948+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:04.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:03 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:03.724+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:04.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:03 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:03.724+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:04.241 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:03.874+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:04.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:04 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:04.060+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:04.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:04 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:04.060+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:04.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:04 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:04.123+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:04.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:04 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:04.123+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:04.511 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:04.239+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:04.511 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:04.239+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:04.685 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:04 smithi116 podman[68048]: 2024-05-03 22:35:04.371788996 +0000 UTC m=+5.638814263 container died 43c9d7adb933708aa00a2b0e39c0e3ec920deddcb980f1d353f9389a3439164e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-03T22:35:04.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:04.509+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:04.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:04.509+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:05.035 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:04 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:04.719+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:05.036 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:04 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:04.719+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:05.036 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:04 smithi116 podman[68048]: 2024-05-03 22:35:04.840909766 +0000 UTC m=+6.107935073 container cleanup 43c9d7adb933708aa00a2b0e39c0e3ec920deddcb980f1d353f9389a3439164e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-03T22:35:05.036 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:04 smithi116 bash[68048]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4 2024-05-03T22:35:05.036 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:04 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:04.964+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:05.219 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:04.872+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:05.435 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:05 smithi116 podman[68068]: 2024-05-03 22:35:05.033759587 +0000 UTC m=+0.647530515 container remove 43c9d7adb933708aa00a2b0e39c0e3ec920deddcb980f1d353f9389a3439164e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-03T22:35:05.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:05 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:05.050+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:05.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:05 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:05.050+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:05.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:05 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:05.109+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:05.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:05 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:05.109+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:05.501 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:05.217+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:05.501 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:05.217+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:05.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:05.498+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:05.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:05.498+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:05.976 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:05 smithi116 podman[68159]: 2024-05-03 22:35:05.775365923 +0000 UTC m=+0.032711329 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:35:05.976 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:05 smithi116 podman[68159]: 2024-05-03 22:35:05.893063902 +0000 UTC m=+0.150409345 container create da3e8f49fb0e6d814966bfacc53e375c8d7c329c35c4efbbcbc1c5be166839ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-03T22:35:05.976 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:05 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:05.705+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:05.976 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:05 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:05.705+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:06.215 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:05.851+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:06.322 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:05 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:05.973+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:06.323 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:06 smithi116 podman[68159]: 2024-05-03 22:35:06.205232693 +0000 UTC m=+0.462578142 container init da3e8f49fb0e6d814966bfacc53e375c8d7c329c35c4efbbcbc1c5be166839ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-03T22:35:06.323 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:06 smithi116 podman[68159]: 2024-05-03 22:35:06.216290355 +0000 UTC m=+0.473635778 container start da3e8f49fb0e6d814966bfacc53e375c8d7c329c35c4efbbcbc1c5be166839ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-03T22:35:06.323 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:06 smithi116 podman[68159]: 2024-05-03 22:35:06.321014772 +0000 UTC m=+0.578360245 container attach da3e8f49fb0e6d814966bfacc53e375c8d7c329c35c4efbbcbc1c5be166839ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-03T22:35:06.465 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:06.213+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:06.466 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:06.213+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:06.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:06 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:06.023+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:06.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:06 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:06.023+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:06.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:06 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:06.095+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:06.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:06 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:06.095+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:06.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:06.463+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:06.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:06.463+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:06.935 INFO:journalctl@ceph.osd.4.smithi116.stdout:May 03 22:35:06 smithi116 podman[68159]: 2024-05-03 22:35:06.669754267 +0000 UTC m=+0.927099711 container died da3e8f49fb0e6d814966bfacc53e375c8d7c329c35c4efbbcbc1c5be166839ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:35:06.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:06 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:06.720+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:06.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:06 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:06.720+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:07.188 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:06.873+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:07.351 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:06 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:06.963+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:07.396 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.4.service' 2024-05-03T22:35:07.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:07.022+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:07.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:07.022+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:07.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:07.064+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:07.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:07 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:07.064+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:07.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:35:07.505 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-03T22:35:07.505 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-03T22:35:07.505 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.5 2024-05-03T22:35:07.506 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:07.186+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:07.506 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:07.186+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:07.777 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:07 smithi130 systemd[1]: Stopping Ceph osd.5 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:35:07.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:07.503+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:07.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:07.503+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:07.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:07.503+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:08.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:07 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:07.922+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:08.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:07 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:07.704+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:08.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:07 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:07.704+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:08.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:07 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:07.704+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:08.221 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:07.897+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:08.221 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:08.083+0000 7f38e6200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:35:08.221 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:08.083+0000 7f38e6200700 -1 osd.5 96 *** Got signal Terminated *** 2024-05-03T22:35:08.221 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:08.083+0000 7f38e6200700 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:35:08.221 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:08.140+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:08.222 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:08.140+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:08.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:08 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:08.040+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:08.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:08 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:08.040+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:08.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:08 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:08.074+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:08.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:08 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:08.074+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:08.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:08.512+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:08.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:08.512+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:08.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:08.512+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:09.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:08 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:08.942+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:09.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:08 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:08.718+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:09.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:08 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:08.718+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:09.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:08 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:08.718+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:09.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:08.946+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:09.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:08 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:08.946+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:09.277 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:09 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:09.175+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:09.278 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:09 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:09.175+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:09.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:09 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:09.063+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:09.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:09 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:09.063+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:09.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:09 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:09.100+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:09.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:09 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:09.100+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:09.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:09 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:09.511+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:09.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:09 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:09.511+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:09.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:09 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:09.511+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:10.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:09 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:09.917+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:10.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:09 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:09.917+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:10.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:09 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:09.742+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:10.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:09 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:09.742+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:10.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:09 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:09.742+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:10.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:09 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:09.924+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:10.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:09 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:09.924+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:10.277 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:10 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:10.158+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:10.277 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:10 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:10.158+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:10.278 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:10 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:10.158+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:43.519885+0000 front 2024-05-03T22:34:43.520000+0000 (oldest deadline 2024-05-03T22:35:09.420054+0000) 2024-05-03T22:35:10.353 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:10 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:10.145+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:10.354 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:10 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:10.145+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:10.354 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:10 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:10.043+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:10.354 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:10 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:10.043+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:10.354 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:10 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:10.043+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:10.951 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:10 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:10.550+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:10.952 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:10 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:10.550+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:10.952 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:10 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:10.550+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:10.969 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:10 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:10.966+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:10.969 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:10 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:10.966+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:10.969 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:10 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:10.716+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:10.970 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:10 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:10.716+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:10.970 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:10 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:10.716+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:11.226 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:11 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:11.067+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:11.227 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:11 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:11.067+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:11.227 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:11 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:11.067+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:11.227 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:11 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:11.153+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:11.227 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:11 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:11.153+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:11.227 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:11 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:11.153+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:11.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:10 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:10.949+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:11.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:10 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:10.949+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:11.277 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:11 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:11.191+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:11.277 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:11 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:11.191+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:11.278 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:11 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:11.191+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:43.519885+0000 front 2024-05-03T22:34:43.520000+0000 (oldest deadline 2024-05-03T22:35:09.420054+0000) 2024-05-03T22:35:11.952 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:11 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:11.525+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:11.953 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:11 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:11.525+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:11.953 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:11 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:11.525+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:11.988 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:11 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:11.689+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:11.988 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:11 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:11.689+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:11.988 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:11 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:11.689+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:12.214 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:11 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:11.950+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:12.214 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:11 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:11.950+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:12.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:11 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:11.985+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:12.436 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:11 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:11.985+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:12.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:12 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:12.031+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:12.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:12 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:12.031+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:12.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:12 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:12.031+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:12.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:12 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:12.173+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:12.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:12 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:12.173+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:12.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:12 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:12.173+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:12.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:12 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:12.211+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.615049+0000 front 2024-05-03T22:34:23.614885+0000 (oldest deadline 2024-05-03T22:34:49.514895+0000) 2024-05-03T22:35:12.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:12 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:12.211+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.318096+0000 front 2024-05-03T22:34:35.317753+0000 (oldest deadline 2024-05-03T22:35:01.217735+0000) 2024-05-03T22:35:12.527 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:12 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5[44678]: 2024-05-03T22:35:12.211+0000 7f38dca00700 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:43.519885+0000 front 2024-05-03T22:34:43.520000+0000 (oldest deadline 2024-05-03T22:35:09.420054+0000) 2024-05-03T22:35:12.927 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:12 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:12.569+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:12.928 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:12 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:12.569+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:12.928 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:12 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:12.569+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:12.948 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:12 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:12.686+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:12.948 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:12 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:12.686+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:12.948 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:12 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:12.686+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:13.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:12 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:12.924+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:13.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:12 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:12.924+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:13.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:12 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:12.946+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:13.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:12 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:12.946+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:13.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:13 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:13.062+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:13.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:13 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:13.062+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:13.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:13 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:13.062+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:13.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:13 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:13.157+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:13.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:13 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:13.157+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:13.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:13 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:13.157+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:13.777 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:13 smithi130 podman[69374]: 2024-05-03 22:35:13.480789612 +0000 UTC m=+5.542525926 container died ee8559bbb7c2ec5ba62b2512bd27cf5778560fc9eeba8254f9e19cb399ddf87e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-03T22:35:13.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:13 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:13.564+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:13.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:13 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:13.564+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:13.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:13 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:13.564+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:13.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:13 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:13.669+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:13.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:13 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:13.669+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:13.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:13 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:13.669+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:14.230 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:13 smithi130 podman[69374]: 2024-05-03 22:35:13.917920273 +0000 UTC m=+5.979656631 container cleanup ee8559bbb7c2ec5ba62b2512bd27cf5778560fc9eeba8254f9e19cb399ddf87e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.schema-version=1.0) 2024-05-03T22:35:14.230 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:13 smithi130 bash[69374]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5 2024-05-03T22:35:14.230 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:13 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:13.939+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:14.231 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:13 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:13.939+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:14.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:13 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:13.947+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:14.436 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:13 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:13.947+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:14.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:14 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:14.085+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:14.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:14 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:14.085+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:14.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:14 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:14.085+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:14.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:14 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:14.115+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:14.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:14 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:14.115+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:14.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:14 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:14.115+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:14.526 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:14 smithi130 podman[69395]: 2024-05-03 22:35:14.228001409 +0000 UTC m=+0.731001057 container remove ee8559bbb7c2ec5ba62b2512bd27cf5778560fc9eeba8254f9e19cb399ddf87e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430) 2024-05-03T22:35:14.904 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:14 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:14.533+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:14.904 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:14 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:14.533+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:14.905 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:14 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:14.533+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:14.998 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:14 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:14.718+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:14.998 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:14 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:14.718+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:14.998 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:14 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:14.718+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:15.277 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:15 smithi130 podman[69485]: 2024-05-03 22:35:14.951412489 +0000 UTC m=+0.032986448 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:35:15.277 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:15 smithi130 podman[69485]: 2024-05-03 22:35:15.120678055 +0000 UTC m=+0.202252051 container create bae05e17dc818ea62badcd1a27042fc8545d75f61269c40fb702371f303896ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-03T22:35:15.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:14 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:14.902+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:15.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:14 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:14.902+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:15.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:14 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:14.995+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:15.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:14 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:14.995+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:15.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:15.127+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:15.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:15.127+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:15.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:15.127+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:15.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:15.115+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:15.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:15.115+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:15.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:15 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:15.115+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:15.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:15 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:15.513+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:15.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:15 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:15.513+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:15.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:15 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:15.513+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:15.778 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:15 smithi130 podman[69485]: 2024-05-03 22:35:15.415784936 +0000 UTC m=+0.497358938 container init bae05e17dc818ea62badcd1a27042fc8545d75f61269c40fb702371f303896ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS) 2024-05-03T22:35:15.779 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:15 smithi130 podman[69485]: 2024-05-03 22:35:15.426960444 +0000 UTC m=+0.508534446 container start bae05e17dc818ea62badcd1a27042fc8545d75f61269c40fb702371f303896ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-03T22:35:15.779 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:15 smithi130 podman[69485]: 2024-05-03 22:35:15.531250486 +0000 UTC m=+0.612824512 container attach bae05e17dc818ea62badcd1a27042fc8545d75f61269c40fb702371f303896ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-03T22:35:16.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:15.736+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:16.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:15.736+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:16.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:15.736+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:16.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:15.736+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:16.186 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:15.950+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:16.186 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:15.950+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:16.186 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:15 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:15.950+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:16.242 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:15 smithi130 podman[69485]: 2024-05-03 22:35:15.882960975 +0000 UTC m=+0.964534977 container died bae05e17dc818ea62badcd1a27042fc8545d75f61269c40fb702371f303896ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-03T22:35:16.242 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:15 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:15.865+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:16.242 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:15 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:15.865+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:16.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:16 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:16.146+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:16.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:16 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:16.146+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:16.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:16 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:16.146+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:16.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:16 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:16.119+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:16.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:16 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:16.119+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:16.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:16 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:16.119+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:16.478 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:16 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:16.119+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:49.816297+0000 front 2024-05-03T22:34:49.816480+0000 (oldest deadline 2024-05-03T22:35:15.716631+0000) 2024-05-03T22:35:16.702 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.5.service' 2024-05-03T22:35:16.778 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:16 smithi130 podman[69511]: 2024-05-03 22:35:16.651754249 +0000 UTC m=+0.751478739 container remove bae05e17dc818ea62badcd1a27042fc8545d75f61269c40fb702371f303896ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-03T22:35:16.779 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:16 smithi130 systemd[1]: ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.5.service: Deactivated successfully. 2024-05-03T22:35:16.779 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:16 smithi130 systemd[1]: Stopped Ceph osd.5 for 81cd0262-0998-11ef-bc97-c7b262605968. 2024-05-03T22:35:16.779 INFO:journalctl@ceph.osd.5.smithi130.stdout:May 03 22:35:16 smithi130 systemd[1]: ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.5.service: Consumed 41.106s CPU time. 2024-05-03T22:35:16.779 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:16 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:16.530+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:16.779 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:16 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:16.530+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:16.779 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:16 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:16.530+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:16.814 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:35:16.814 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-03T22:35:16.815 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-03T22:35:16.815 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.6 2024-05-03T22:35:17.155 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:16 smithi082 systemd[1]: Stopping Ceph osd.6 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:35:17.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:16 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:16.940+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:17.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:16 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:16.940+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:17.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:16 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:16.940+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:17.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:16 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:16.695+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:17.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:16 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:16.695+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:17.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:16 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:16.695+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:17.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:16 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:16.695+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:17.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:16 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:16.869+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:17.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:16 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:16.869+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:17.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:16 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:16.869+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:17.409 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:17 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:17.171+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:17.409 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:17 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:17.171+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:17.409 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:17 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:17.171+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:17.409 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:17 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:17.171+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:17.409 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:17 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:17.153+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:17.410 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:17 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:17.153+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:17.410 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:17 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:17.153+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:17.410 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:17 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:17.153+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:49.816297+0000 front 2024-05-03T22:34:49.816480+0000 (oldest deadline 2024-05-03T22:35:15.716631+0000) 2024-05-03T22:35:17.410 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:17 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:17.406+0000 7f38d9000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:35:17.410 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:17 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:17.406+0000 7f38d9000700 -1 osd.6 96 *** Got signal Terminated *** 2024-05-03T22:35:17.410 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:17 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:17.406+0000 7f38d9000700 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:35:17.846 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:17 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:17.574+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:17.846 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:17 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:17.574+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:17.847 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:17 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:17.574+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:18.087 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:17 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:17.954+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:18.088 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:17 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:17.954+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:18.088 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:17 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:17.954+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:18.088 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:17 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:17.740+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:18.088 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:17 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:17.740+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:18.088 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:17 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:17.740+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:18.089 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:17 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:17.740+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:18.190 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:17 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:17.892+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:18.191 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:17 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:17.892+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:18.191 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:17 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:17.892+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:18.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:18 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:18.195+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:18.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:18 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:18.195+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:18.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:18 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:18.195+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:18.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:18 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:18.195+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:18.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:18 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:18.125+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:18.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:18 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:18.125+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:18.478 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:18 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:18.125+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:18.478 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:18 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:18.125+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:49.816297+0000 front 2024-05-03T22:34:49.816480+0000 (oldest deadline 2024-05-03T22:35:15.716631+0000) 2024-05-03T22:35:18.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:18 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:18.586+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:18.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:18 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:18.586+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:18.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:18 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:18.586+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:18.796 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:18 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:18.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:18.797 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:18 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:18.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:18.797 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:18 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:18.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:18.797 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:18 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:18.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:19.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:18 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:18.982+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:19.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:18 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:18.982+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:19.186 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:18 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:18.982+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:19.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:18 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:18.883+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:19.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:18 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:18.883+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:19.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:18 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:18.883+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:19.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:19 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:19.110+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:19.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:19 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:19.110+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:19.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:19 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:19.110+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:19.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:19 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:19.110+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:49.816297+0000 front 2024-05-03T22:34:49.816480+0000 (oldest deadline 2024-05-03T22:35:15.716631+0000) 2024-05-03T22:35:19.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:19 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:19.196+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:19.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:19 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:19.196+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:19.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:19 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:19.196+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:19.478 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:19 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:19.196+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:19.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:19 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:19.544+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:19.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:19 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:19.544+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:19.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:19 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:19.544+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:19.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:19 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:19.689+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:19.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:19 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:19.689+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:19.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:19 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:19.689+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:19.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:19 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:19.689+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:20.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:19 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:19.854+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:20.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:19 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:19.854+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:20.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:19 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:19.854+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:20.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:19 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:19.947+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:20.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:19 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:19.947+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:20.436 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:19 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:19.947+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:20.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:20 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:20.108+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:20.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:20 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:20.108+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:20.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:20 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:20.108+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:20.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:20 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:20.108+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:49.816297+0000 front 2024-05-03T22:34:49.816480+0000 (oldest deadline 2024-05-03T22:35:15.716631+0000) 2024-05-03T22:35:20.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:20 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:20.161+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:20.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:20 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:20.161+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:20.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:20 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:20.161+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:20.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:20 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:20.161+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:20.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:20 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:20.502+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:20.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:20 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:20.502+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:20.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:20 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:20.502+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:21.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:20 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:20.969+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:21.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:20 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:20.969+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:21.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:20 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:20.969+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:21.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:20 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:20.730+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:21.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:20 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:20.730+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:21.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:20 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:20.730+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:21.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:20 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:20.730+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:21.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:20 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:20.890+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:21.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:20 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:20.890+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:21.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:20 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:20.890+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:21.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:21 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:21.087+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:21.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:21 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:21.087+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:21.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:21 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:21.087+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:21.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:21 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:21.087+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:49.816297+0000 front 2024-05-03T22:34:49.816480+0000 (oldest deadline 2024-05-03T22:35:15.716631+0000) 2024-05-03T22:35:21.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:21 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:21.186+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:21.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:21 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:21.186+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:21.478 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:21 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:21.186+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:21.478 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:21 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:21.186+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:21.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:21 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:21.457+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:21.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:21 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:21.457+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:21.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:21 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:21.457+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:22.001 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:21 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:21.748+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:22.001 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:21 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:21.748+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:22.001 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:21 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:21.748+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:22.001 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:21 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:21.748+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:22.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:21 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:21.891+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:22.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:21 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:21.891+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:22.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:21 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:21.891+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:22.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:21 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:21.999+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:22.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:21 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:21.999+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:22.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:22 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:21.999+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:22.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:22 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:22.041+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.409911+0000 front 2024-05-03T22:34:23.410129+0000 (oldest deadline 2024-05-03T22:34:47.510184+0000) 2024-05-03T22:35:22.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:22 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:22.041+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:33.412599+0000 front 2024-05-03T22:34:33.412537+0000 (oldest deadline 2024-05-03T22:34:57.512302+0000) 2024-05-03T22:35:22.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:22 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:22.041+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:42.814912+0000 front 2024-05-03T22:34:42.814957+0000 (oldest deadline 2024-05-03T22:35:09.815292+0000) 2024-05-03T22:35:22.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:22 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6[54408]: 2024-05-03T22:35:22.041+0000 7f38cf800700 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:49.816297+0000 front 2024-05-03T22:34:49.816480+0000 (oldest deadline 2024-05-03T22:35:15.716631+0000) 2024-05-03T22:35:22.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:22 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:22.188+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:22.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:22 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:22.188+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:22.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:22 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:22.188+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:22.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:22 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:22.188+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:22.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:22 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:22.409+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:22.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:22 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:22.409+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:22.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:22 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:22.409+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:23.009 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:22 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:22.701+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:23.009 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:22 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:22.701+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:23.010 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:22 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:22.701+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:23.010 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:22 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:22.701+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:23.107 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:22 smithi082 podman[91319]: 2024-05-03 22:35:22.803529202 +0000 UTC m=+5.552181560 container died bdb7c660b638e7129443ea51fff694a41991948a4e2687b3263fc8805251ef31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-03T22:35:23.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:22 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:22.858+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:23.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:22 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:22.858+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:23.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:22 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:22.858+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:23.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:23.007+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:23.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:23.007+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:23.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:23.007+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:23.476 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:23 smithi082 podman[91319]: 2024-05-03 22:35:23.242302533 +0000 UTC m=+5.990954915 container cleanup bdb7c660b638e7129443ea51fff694a41991948a4e2687b3263fc8805251ef31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:35:23.477 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:23 smithi082 bash[91319]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6 2024-05-03T22:35:23.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:23 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:23.151+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:23.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:23 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:23.151+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:23.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:23 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:23.151+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:23.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:23 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:23.151+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:23.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:23 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:23.424+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:23.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:23 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:23.424+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:23.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:23 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:23.424+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:23.976 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:23 smithi082 podman[91337]: 2024-05-03 22:35:23.476642226 +0000 UTC m=+0.662950804 container remove bdb7c660b638e7129443ea51fff694a41991948a4e2687b3263fc8805251ef31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-05-03T22:35:24.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:23.977+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:24.186 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:23.977+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:24.186 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:23.977+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:24.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:23.737+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:24.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:23.737+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:24.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:23.737+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:24.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:23 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:23.737+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:24.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:23 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:23.906+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:24.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:23 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:23.906+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:24.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:23 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:23.906+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:24.467 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:24 smithi082 podman[91425]: 2024-05-03 22:35:24.168546309 +0000 UTC m=+0.033756140 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:35:24.467 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:24 smithi082 podman[91425]: 2024-05-03 22:35:24.302658514 +0000 UTC m=+0.167868402 container create c8495ff5e99007388589d84c60c70270b064d7dcc4d1206db61c99f277b0a4a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5) 2024-05-03T22:35:24.467 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:24 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:24.156+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:24.468 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:24 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:24.156+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:24.468 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:24 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:24.156+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:24.468 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:24 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:24.156+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:24.726 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:24 smithi082 podman[91425]: 2024-05-03 22:35:24.598148413 +0000 UTC m=+0.463358285 container init c8495ff5e99007388589d84c60c70270b064d7dcc4d1206db61c99f277b0a4a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430) 2024-05-03T22:35:24.727 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:24 smithi082 podman[91425]: 2024-05-03 22:35:24.609707557 +0000 UTC m=+0.474917411 container start c8495ff5e99007388589d84c60c70270b064d7dcc4d1206db61c99f277b0a4a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD) 2024-05-03T22:35:24.727 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:24 smithi082 podman[91425]: 2024-05-03 22:35:24.705035921 +0000 UTC m=+0.570245790 container attach c8495ff5e99007388589d84c60c70270b064d7dcc4d1206db61c99f277b0a4a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, io.buildah.version=1.33.5) 2024-05-03T22:35:24.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:24 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:24.383+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:24.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:24 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:24.383+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:24.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:24 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:24.383+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:25.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:24 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:24.940+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:25.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:24 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:24.940+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:25.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:24 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:24.940+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:25.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:24 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:24.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:25.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:24 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:24.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:25.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:24 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:24.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:25.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:24 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:24.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:25.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:24 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:24.929+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:25.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:24 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:24.929+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:25.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:24 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:24.929+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:25.432 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 03 22:35:25 smithi082 podman[91425]: 2024-05-03 22:35:25.070512134 +0000 UTC m=+0.935721986 container died c8495ff5e99007388589d84c60c70270b064d7dcc4d1206db61c99f277b0a4a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-03T22:35:25.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:25 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:25.117+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:25.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:25 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:25.117+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:25.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:25 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:25.117+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:25.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:25 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:25.117+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:25.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:25 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:25.408+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:25.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:25 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:25.408+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:25.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:25 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:25.408+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:25.882 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.6.service' 2024-05-03T22:35:25.935 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:25 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:25.904+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:25.936 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:25 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:25.904+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:25.936 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:25 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:25.904+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:25.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:25 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:25.658+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:25.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:25 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:25.658+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:25.937 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:25 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:25.658+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:25.937 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:25 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:25.658+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:25.989 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:35:25.989 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-03T22:35:25.989 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-03T22:35:25.989 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.7 2024-05-03T22:35:26.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:25 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:25.900+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:26.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:25 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:25.900+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:26.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:25 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:25.900+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:26.435 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:26 smithi116 systemd[1]: Stopping Ceph osd.7 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:35:26.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:26 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:26.097+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:26.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:26 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:26.097+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:26.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:26 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:26.097+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:26.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:26 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:26.097+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:26.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:26 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:26.428+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:26.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:26 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:26.428+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:26.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:26 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:26.428+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:26.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:26 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:26.428+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:26.887 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:26 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:26.609+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:26.887 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:26 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:26.609+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:26.887 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:26 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:26.609+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:26.888 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:26 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:26.609+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:26.888 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:26 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:26.599+0000 7f52ae800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:35:26.888 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:26 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:26.599+0000 7f52ae800700 -1 osd.7 96 *** Got signal Terminated *** 2024-05-03T22:35:26.888 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:26 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:26.599+0000 7f52ae800700 -1 osd.7 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:35:26.888 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:26 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:26.884+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:26.888 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:26 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:26.884+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:27.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:26 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:26.884+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:27.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:26 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:26.893+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:27.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:26 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:26.893+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:27.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:26 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:26.893+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:27.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:26 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:26.893+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:27.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:27 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:27.081+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:27.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:27 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:27.081+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:27.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:27 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:27.081+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:27.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:27 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:27.081+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:27.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:27 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:27.410+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:27.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:27 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:27.410+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:27.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:27 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:27.410+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:27.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:27 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:27.410+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:27.935 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:27 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:27.851+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:27.935 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:27 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:27.851+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:27.936 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:27 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:27.851+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:27.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:27 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:27.633+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:27.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:27 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:27.633+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:27.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:27 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:27.633+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:27.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:27 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:27.633+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:28.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:27 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:27.911+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:28.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:27 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:27.911+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:28.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:27 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:27.911+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:28.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:27 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:27.911+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:28.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:28 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:28.080+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:28.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:28 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:28.080+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:28.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:28 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:28.080+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:28.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:28 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:28.080+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:28.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:28 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:28.080+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:28.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:28 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:28.376+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:28.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:28 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:28.376+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:28.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:28 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:28.376+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:28.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:28 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:28.376+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:28.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:28 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:28.669+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:28.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:28 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:28.669+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:28.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:28 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:28.669+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:28.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:28 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:28.669+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:28.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:28 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:28.669+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:28.936 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:28 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:28.851+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:28.936 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:28 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:28.851+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:28.936 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:28 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:28.851+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:29.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:28 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:28.919+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:29.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:28 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:28.919+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:29.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:28 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:28.919+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:29.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:28 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:28.919+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:29.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:29 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:29.091+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:29.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:29 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:29.091+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:29.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:29 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:29.091+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:29.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:29 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:29.091+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:29.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:29 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:29.091+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:29.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:29 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:29.348+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:29.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:29 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:29.348+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:29.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:29 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:29.348+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:29.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:29 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:29.348+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:30.185 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:29 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:29.892+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:30.186 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:29 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:29.892+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:30.186 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:29 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:29.892+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:30.186 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:29 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:29.892+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.092329+0000 front 2024-05-03T22:35:01.093054+0000 (oldest deadline 2024-05-03T22:35:29.292859+0000) 2024-05-03T22:35:30.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:29 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:29.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:30.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:29 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:29.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:30.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:29 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:29.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:30.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:29 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:29.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:30.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:29 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:29.707+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:30.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:29 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:29.930+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:30.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:29 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:29.930+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:30.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:29 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:29.930+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:30.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:29 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:29.930+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:30.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:30 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:30.121+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:30.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:30 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:30.121+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:30.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:30 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:30.121+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:30.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:30 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:30.121+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:30.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:30 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:30.121+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:30.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:30 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:30.314+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:30.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:30 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:30.314+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:30.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:30 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:30.314+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:30.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:30 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:30.314+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:30.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:30 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:30.678+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:30.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:30 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:30.678+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:30.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:30 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:30.678+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:30.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:30 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:30.678+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:30.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:30 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:30.678+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:30.936 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:30 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:30.889+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.984213+0000 front 2024-05-03T22:34:35.984541+0000 (oldest deadline 2024-05-03T22:35:01.284457+0000) 2024-05-03T22:35:30.936 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:30 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:30.889+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.187107+0000 front 2024-05-03T22:34:44.186560+0000 (oldest deadline 2024-05-03T22:35:09.486486+0000) 2024-05-03T22:35:30.937 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:30 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:30.889+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.188948+0000 front 2024-05-03T22:34:54.189304+0000 (oldest deadline 2024-05-03T22:35:15.289199+0000) 2024-05-03T22:35:30.937 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:30 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7[49795]: 2024-05-03T22:35:30.889+0000 7f52a5000700 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.092329+0000 front 2024-05-03T22:35:01.093054+0000 (oldest deadline 2024-05-03T22:35:29.292859+0000) 2024-05-03T22:35:31.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:30 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:30.950+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:31.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:30 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:30.950+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:31.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:30 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:30.950+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:31.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:30 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:30.950+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:31.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:31 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:31.124+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:31.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:31 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:31.124+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:31.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:31 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:31.124+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:31.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:31 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:31.124+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:31.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:31 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:31.124+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:31.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:31 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:31.286+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:31.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:31 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:31.287+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:31.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:31 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:31.287+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:31.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:31 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:31.287+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:32.039 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:31 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:31.702+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:32.039 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:31 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:31.702+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:32.039 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:31 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:31.702+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:32.040 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:31 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:31.702+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:32.040 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:31 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:31.702+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:32.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:31 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:31.981+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:32.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:31 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:31.981+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:32.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:31 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:31.981+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:32.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:31 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:31.981+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:32.294 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:32 smithi116 podman[68275]: 2024-05-03 22:35:32.03807576 +0000 UTC m=+5.584358008 container died 88f561a549650518f01ec8410394ed8a8220a2ddbe8d32cca2dc8283548e89c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:35:32.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:32 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:32.121+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:32.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:32 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:32.121+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:32.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:32 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:32.121+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:32.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:32 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:32.121+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:32.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:32 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:32.121+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:32.648 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:32 smithi116 podman[68275]: 2024-05-03 22:35:32.436896548 +0000 UTC m=+5.983178833 container cleanup 88f561a549650518f01ec8410394ed8a8220a2ddbe8d32cca2dc8283548e89c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True) 2024-05-03T22:35:32.649 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:32 smithi116 bash[68275]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7 2024-05-03T22:35:32.649 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:32 smithi116 podman[68293]: 2024-05-03 22:35:32.646204474 +0000 UTC m=+0.588591021 container remove 88f561a549650518f01ec8410394ed8a8220a2ddbe8d32cca2dc8283548e89c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True) 2024-05-03T22:35:32.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:32 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:32.281+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:32.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:32 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:32.281+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:32.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:32 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:32.281+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:32.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:32 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:32.281+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:32.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:32 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:32.742+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:32.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:32 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:32.743+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:32.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:32 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:32.743+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:32.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:32 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:32.743+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:32.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:32 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:32.743+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:33.277 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:33.253+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:33.277 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:33.253+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:33.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:33.253+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:33.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:33.253+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:33.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:33.006+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:33.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:33.006+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:33.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:33.006+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:33.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:33.006+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:33.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:33 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:33.170+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:33.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:33 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:33.170+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:33.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:33 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:33.170+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:33.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:33 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:33.170+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:33.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:33 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:33.170+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:33.760 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:33 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:33.722+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:33.761 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:33 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:33.722+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:33.761 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:33 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:33.722+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:33.761 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:33 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:33.722+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:33.761 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:33 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:33.722+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:33.761 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:33 smithi116 podman[68380]: 2024-05-03 22:35:33.381088135 +0000 UTC m=+0.034113032 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:35:33.762 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:33 smithi116 podman[68380]: 2024-05-03 22:35:33.480232803 +0000 UTC m=+0.133257746 container create e6d1e9581f1f0f05a6408739539921babc8333dd5f65774f47282fe9d41fed72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-05-03T22:35:33.762 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:33 smithi116 podman[68380]: 2024-05-03 22:35:33.75874032 +0000 UTC m=+0.411765259 container init e6d1e9581f1f0f05a6408739539921babc8333dd5f65774f47282fe9d41fed72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-03T22:35:34.186 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:33 smithi116 podman[68380]: 2024-05-03 22:35:33.770212556 +0000 UTC m=+0.423237456 container start e6d1e9581f1f0f05a6408739539921babc8333dd5f65774f47282fe9d41fed72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:35:34.187 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:33 smithi116 podman[68380]: 2024-05-03 22:35:33.865955888 +0000 UTC m=+0.518980871 container attach e6d1e9581f1f0f05a6408739539921babc8333dd5f65774f47282fe9d41fed72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:35:34.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:33.970+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:34.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:33.970+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:34.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:33.970+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:34.278 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:33 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:33.970+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:34.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:34 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:34.211+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:34.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:34 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:34.211+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:34.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:34 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:34.211+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:34.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:34 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:34.211+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:34.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:34 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:34.175+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:34.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:34 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:34.175+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:34.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:34 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:34.175+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:34.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:34 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:34.175+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:34.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:34 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:34.175+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:34.620 INFO:journalctl@ceph.osd.7.smithi116.stdout:May 03 22:35:34 smithi116 podman[68406]: 2024-05-03 22:35:34.288083789 +0000 UTC m=+0.035996330 container died e6d1e9581f1f0f05a6408739539921babc8333dd5f65774f47282fe9d41fed72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430) 2024-05-03T22:35:34.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:34 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:34.715+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:34.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:34 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:34.715+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:34.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:34 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:34.715+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:34.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:34 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:34.715+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:34.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:34 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:34.715+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:35.019 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.7.service' 2024-05-03T22:35:35.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:35:35.131 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-03T22:35:35.131 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-03T22:35:35.131 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.8 2024-05-03T22:35:35.257 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:34 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:34.973+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:35.257 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:34 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:34.973+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:35.257 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:34 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:34.973+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:35.257 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:34 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:34.973+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:35.257 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:35.171+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:35.258 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:35.171+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:35.258 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:35.171+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:35.258 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:35.171+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:35.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:35 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:35.171+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:35.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:35 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:35.171+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:35.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:35 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:35.171+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:35.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:35 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:35.171+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:35.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:35 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:35.171+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:35.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:35 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:35.171+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:35.527 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:35 smithi130 systemd[1]: Stopping Ceph osd.8 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:35:36.028 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:35.726+0000 7fa0e8400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:35:36.028 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:35.726+0000 7fa0e8400700 -1 osd.8 96 *** Got signal Terminated *** 2024-05-03T22:35:36.028 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:35.726+0000 7fa0e8400700 -1 osd.8 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:35:36.028 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:35.924+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:36.028 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:35.924+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:36.028 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:35.924+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:36.029 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:35.924+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:36.029 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:35 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:35.924+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:11.521056+0000 front 2024-05-03T22:35:11.521158+0000 (oldest deadline 2024-05-03T22:35:35.021071+0000) 2024-05-03T22:35:36.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:35 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:35.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:36.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:35 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:35.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:36.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:35 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:35.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:36.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:35 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:35.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:36.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:35 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:35.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:36.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:35 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:35.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:36.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:36 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:36.158+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:36.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:36 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:36.158+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:36.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:36 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:36.158+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:36.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:36 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:36.158+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:36.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:36 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:36.158+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:36.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:36 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:36.158+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:36.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:36 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:36.182+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:36.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:36 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:36.182+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:36.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:36 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:36.182+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:36.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:36 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:36.182+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:36.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:36 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:36.182+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:37.174 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:36 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:36.900+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:37.174 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:36 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:36.901+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:37.174 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:36 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:36.901+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:37.174 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:36 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:36.901+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:37.174 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:36 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:36.901+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:11.521056+0000 front 2024-05-03T22:35:11.521158+0000 (oldest deadline 2024-05-03T22:35:35.021071+0000) 2024-05-03T22:35:37.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:36 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:36.720+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:37.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:36 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:36.720+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:37.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:36 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:36.720+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:37.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:36 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:36.720+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:37.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:36 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:36.720+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:37.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:36 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:36.720+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:37.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:37 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:37.187+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:37.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:37 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:37.187+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:37.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:37 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:37.187+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:37.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:37 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:37.187+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:37.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:37 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:37.187+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:37.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:37 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:37.187+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:37.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:37 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:37.172+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:37.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:37 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:37.172+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:37.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:37 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:37.172+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:37.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:37 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:37.172+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:37.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:37 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:37.172+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:37.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:37 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:37.678+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:37.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:37 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:37.678+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:37.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:37 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:37.678+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:37.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:37 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:37.678+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:37.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:37 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:37.678+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:37.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:37 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:37.678+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:38.218 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:37 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:37.873+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:38.219 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:37 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:37.873+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:38.219 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:37 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:37.873+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:38.219 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:37 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:37.873+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:38.219 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:37 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:37.873+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:11.521056+0000 front 2024-05-03T22:35:11.521158+0000 (oldest deadline 2024-05-03T22:35:35.021071+0000) 2024-05-03T22:35:38.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:38 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:38.201+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:38.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:38 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:38.201+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:38.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:38 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:38.201+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:38.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:38 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:38.201+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:38.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:38 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:38.201+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:38.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:38 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:38.201+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:38.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:38 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:38.216+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:38.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:38 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:38.216+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:38.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:38 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:38.216+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:38.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:38 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:38.216+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:38.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:38 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:38.216+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:38.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:38 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:38.659+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:38.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:38 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:38.659+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:38.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:38 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:38.659+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:38.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:38 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:38.659+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:38.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:38 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:38.659+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:38.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:38 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:38.659+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:39.233 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:38 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:38.824+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:39.233 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:38 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:38.824+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:39.233 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:38 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:38.824+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:39.233 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:38 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:38.824+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:39.233 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:38 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:38.824+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:11.521056+0000 front 2024-05-03T22:35:11.521158+0000 (oldest deadline 2024-05-03T22:35:35.021071+0000) 2024-05-03T22:35:39.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:39 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:39.174+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:39.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:39 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:39.174+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:39.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:39 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:39.174+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:39.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:39 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:39.174+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:39.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:39 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:39.174+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:39.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:39 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:39.174+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:39.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:39 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:39.231+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:39.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:39 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:39.231+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:39.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:39 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:39.231+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:39.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:39 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:39.231+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:39.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:39 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:39.231+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:39.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:39 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:39.656+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:39.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:39 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:39.656+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:39.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:39 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:39.656+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:39.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:39 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:39.656+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:39.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:39 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:39.656+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:39.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:39 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:39.656+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:40.271 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:39 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:39.862+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:34.908287+0000 front 2024-05-03T22:34:34.908441+0000 (oldest deadline 2024-05-03T22:34:57.208210+0000) 2024-05-03T22:35:40.271 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:39 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:39.862+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:44.712407+0000 front 2024-05-03T22:34:44.712212+0000 (oldest deadline 2024-05-03T22:35:08.812435+0000) 2024-05-03T22:35:40.271 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:39 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:39.862+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:54.015693+0000 front 2024-05-03T22:34:54.015479+0000 (oldest deadline 2024-05-03T22:35:16.315208+0000) 2024-05-03T22:35:40.271 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:39 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:39.862+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.617793+0000 front 2024-05-03T22:35:01.617485+0000 (oldest deadline 2024-05-03T22:35:26.317522+0000) 2024-05-03T22:35:40.271 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:39 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8[51387]: 2024-05-03T22:35:39.862+0000 7fa0e3c00700 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:11.521056+0000 front 2024-05-03T22:35:11.521158+0000 (oldest deadline 2024-05-03T22:35:35.021071+0000) 2024-05-03T22:35:40.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:40 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:40.216+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:40.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:40 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:40.216+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:40.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:40 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:40.216+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:40.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:40 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:40.216+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:40.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:40 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:40.216+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:40.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:40 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:40.216+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:40.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:40 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:40.269+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:40.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:40 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:40.269+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:40.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:40 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:40.269+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:40.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:40 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:40.269+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:40.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:40 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:40.269+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:40.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:40 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:40.609+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:40.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:40 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:40.609+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:40.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:40 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:40.609+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:40.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:40 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:40.609+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:40.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:40 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:40.609+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:40.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:40 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:40.609+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:41.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:41 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:41.215+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:41.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:41 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:41.215+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:41.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:41 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:41.215+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:41.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:41 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:41.215+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:41.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:41 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:41.215+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:41.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:41 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:41.215+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:41.527 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:41 smithi130 podman[69602]: 2024-05-03 22:35:41.305070827 +0000 UTC m=+5.721659047 container died 4441f443ad32476fd9642253a411c00297437ca8beac2716bfa811e92fb2e536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:35:41.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:41 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:41.250+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:41.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:41 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:41.250+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:41.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:41 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:41.250+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:41.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:41 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:41.250+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:41.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:41 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:41.250+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:41.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:41 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:41.589+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:41.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:41 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:41.589+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:41.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:41 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:41.589+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:41.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:41 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:41.589+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:41.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:41 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:41.589+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:41.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:41 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:41.589+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:41.997 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:41 smithi130 podman[69602]: 2024-05-03 22:35:41.686286413 +0000 UTC m=+6.102874616 container cleanup 4441f443ad32476fd9642253a411c00297437ca8beac2716bfa811e92fb2e536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-03T22:35:41.997 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:41 smithi130 bash[69602]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8 2024-05-03T22:35:42.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:41 smithi130 podman[69619]: 2024-05-03 22:35:41.995606849 +0000 UTC m=+0.685032330 container remove 4441f443ad32476fd9642253a411c00297437ca8beac2716bfa811e92fb2e536 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-05-03T22:35:42.633 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:42 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:42.276+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:42.633 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:42 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:42.276+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:42.633 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:42 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:42.276+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:42.633 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:42 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:42.276+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:42.633 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:42 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:42.276+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:42.726 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:42 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:42.244+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:42.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:42 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:42.244+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:42.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:42 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:42.245+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:42.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:42 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:42.245+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:42.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:42 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:42.245+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:42.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:42 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:42.245+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:42.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:42 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:42.627+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:42.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:42 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:42.627+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:42.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:42 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:42.627+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:42.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:42 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:42.627+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:42.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:42 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:42.627+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:42.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:42 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:42.627+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:43.005 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:42 smithi130 podman[69709]: 2024-05-03 22:35:42.536384475 +0000 UTC m=+0.032235228 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:35:43.005 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:42 smithi130 podman[69709]: 2024-05-03 22:35:42.654724584 +0000 UTC m=+0.150575369 container create bcf87ef93b3adc2d1347e61b4a0a7c9e31808dbba2b8a7423e5c1ae749de32d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:35:43.005 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:43 smithi130 podman[69709]: 2024-05-03 22:35:43.003002002 +0000 UTC m=+0.498852794 container init bcf87ef93b3adc2d1347e61b4a0a7c9e31808dbba2b8a7423e5c1ae749de32d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:35:43.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:43 smithi130 podman[69709]: 2024-05-03 22:35:43.014355294 +0000 UTC m=+0.510206096 container start bcf87ef93b3adc2d1347e61b4a0a7c9e31808dbba2b8a7423e5c1ae749de32d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:35:43.277 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:43 smithi130 podman[69709]: 2024-05-03 22:35:43.090693351 +0000 UTC m=+0.586544173 container attach bcf87ef93b3adc2d1347e61b4a0a7c9e31808dbba2b8a7423e5c1ae749de32d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430) 2024-05-03T22:35:43.726 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:43 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:43.247+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:43.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:43 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:43.247+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:43.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:43 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:43.247+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:43.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:43 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:43.247+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:43.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:43 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:43.247+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:43.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:43 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:43.247+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:43.778 INFO:journalctl@ceph.osd.8.smithi130.stdout:May 03 22:35:43 smithi130 podman[69709]: 2024-05-03 22:35:43.478239654 +0000 UTC m=+0.974090446 container died bcf87ef93b3adc2d1347e61b4a0a7c9e31808dbba2b8a7423e5c1ae749de32d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-03T22:35:43.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:43 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:43.292+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:43.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:43 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:43.292+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:43.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:43 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:43.292+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:43.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:43 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:43.292+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:43.779 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:43 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:43.292+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:43.779 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:43 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:43.292+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:43.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:43 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:43.620+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:43.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:43 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:43.620+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:43.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:43 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:43.620+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:43.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:43 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:43.620+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:43.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:43 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:43.620+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:43.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:43 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:43.620+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:43.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:43 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:43.620+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:44.236 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.8.service' 2024-05-03T22:35:44.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:35:44.349 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-03T22:35:44.349 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-03T22:35:44.350 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.9 2024-05-03T22:35:44.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:44 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:44.310+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:44.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:44 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:44.311+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:44.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:44 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:44.311+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:44.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:44 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:44.311+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:44.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:44 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:44.311+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:44.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:44 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:44.311+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:44.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:44.261+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:44.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:44.261+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:44.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:44.261+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:44.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:44.261+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:44.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:44.261+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:44.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:44.261+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:44.728 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:44 smithi082 systemd[1]: Stopping Ceph osd.9 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:35:44.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:44 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:44.622+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:44.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:44 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:44.622+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:44.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:44 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:44.622+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:44.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:44 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:44.622+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:44.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:44 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:44.622+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:44.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:44 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:44.622+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:44.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:44 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:44.622+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:45.217 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:44.916+0000 7fd9b2400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:35:45.218 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:44.916+0000 7fd9b2400700 -1 osd.9 96 *** Got signal Terminated *** 2024-05-03T22:35:45.218 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:44 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:44.916+0000 7fd9b2400700 -1 osd.9 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:35:45.218 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:45 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:45.214+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:45.218 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:45 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:45.214+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:45.218 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:45 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:45.214+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:45.218 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:45 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:45.214+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:45.218 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:45 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:45.214+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:45.219 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:45 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:45.214+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:45.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:45 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:45.329+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:45.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:45 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:45.329+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:45.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:45 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:45.329+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:45.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:45 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:45.329+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:45.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:45 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:45.329+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:45.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:45 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:45.329+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:45.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:45 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:45.663+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:45.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:45 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:45.663+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:45.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:45 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:45.663+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:45.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:45 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:45.663+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:45.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:45 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:45.663+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:45.937 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:45 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:45.663+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:45.937 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:45 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:45.663+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:46.726 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:46 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:46.226+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:46.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:46 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:46.226+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:46.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:46 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:46.226+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:46.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:46 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:46.226+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:46.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:46 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:46.226+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:46.727 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:46 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:46.226+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:46.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:46 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:46.333+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:46.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:46 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:46.333+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:46.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:46 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:46.333+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:46.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:46 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:46.333+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:46.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:46 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:46.333+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:46.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:46 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:46.333+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:46.935 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:46 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:46.660+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:46.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:46 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:46.660+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:46.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:46 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:46.660+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:46.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:46 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:46.660+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:46.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:46 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:46.660+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:46.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:46 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:46.660+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:46.936 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:46 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:46.660+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:47.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:47 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:47.184+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:47.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:47 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:47.184+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:47.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:47 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:47.184+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:47.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:47 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:47.184+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:47.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:47 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:47.184+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:47.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:47 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:47.184+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:47.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:47 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:47.344+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:47.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:47 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:47.344+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:47.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:47 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:47.344+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:47.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:47 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:47.344+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:47.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:47 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:47.344+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:47.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:47 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:47.344+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:48.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:47 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:47.703+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:48.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:47 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:47.703+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:48.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:47 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:47.703+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:48.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:47 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:47.703+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:48.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:47 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:47.703+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:48.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:47 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:47.703+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:48.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:47 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:47.703+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:48.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:48 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:48.196+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:48.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:48 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:48.196+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:48.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:48 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:48.196+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:48.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:48 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:48.196+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:48.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:48 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:48.196+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:48.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:48 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:48.196+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:48.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:48 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:48.297+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:48.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:48 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:48.297+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:48.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:48 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:48.297+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:48.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:48 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:48.297+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:48.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:48 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:48.297+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:48.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:48 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:48.297+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:49.087 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:48 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:48.747+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:49.088 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:48 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:48.747+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:49.088 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:48 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:48.747+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:49.088 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:48 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:48.747+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:49.088 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:48 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:48.747+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:49.088 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:48 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:48.747+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:49.088 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:48 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:48.747+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:49.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:49.175+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.963912+0000 front 2024-05-03T22:34:23.964197+0000 (oldest deadline 2024-05-03T22:34:48.663420+0000) 2024-05-03T22:35:49.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:49.175+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:36.265690+0000 front 2024-05-03T22:34:36.266025+0000 (oldest deadline 2024-05-03T22:35:00.365648+0000) 2024-05-03T22:35:49.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:49.175+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:40.366547+0000 front 2024-05-03T22:34:40.367003+0000 (oldest deadline 2024-05-03T22:35:10.967365+0000) 2024-05-03T22:35:49.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:49.175+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:50.968533+0000 front 2024-05-03T22:34:50.968349+0000 (oldest deadline 2024-05-03T22:35:16.868284+0000) 2024-05-03T22:35:49.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:49.175+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:01.570279+0000 front 2024-05-03T22:35:01.569927+0000 (oldest deadline 2024-05-03T22:35:27.469907+0000) 2024-05-03T22:35:49.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:49 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9[61115]: 2024-05-03T22:35:49.175+0000 7fd9adc00700 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:07.470806+0000 front 2024-05-03T22:35:07.471246+0000 (oldest deadline 2024-05-03T22:35:34.471995+0000) 2024-05-03T22:35:49.777 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:49 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:49.315+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:49.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:49 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:49.316+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:49.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:49 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:49.316+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:49.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:49 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:49.316+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:49.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:49 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:49.316+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:49.778 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:49 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:49.316+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:50.121 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:49 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:49.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:50.121 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:49 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:49.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:50.121 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:49 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:49.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:50.122 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:49 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:49.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:50.122 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:49 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:49.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:50.122 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:49 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:49.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:50.122 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:49 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:49.753+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:50.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:50.267+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:50.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:50.267+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:50.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:50.267+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:50.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:50.267+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:50.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:50.267+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:50.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:50 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:50.267+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:50.708 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:50 smithi082 podman[91531]: 2024-05-03 22:35:50.421401857 +0000 UTC m=+5.638559573 container died 59292543ea366434d3ec466d13b646f5ed60055c0ec686757259a35759ef4eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:35:50.977 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:50 smithi082 podman[91531]: 2024-05-03 22:35:50.826678524 +0000 UTC m=+6.043836187 container cleanup 59292543ea366434d3ec466d13b646f5ed60055c0ec686757259a35759ef4eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux ) 2024-05-03T22:35:50.977 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:50 smithi082 bash[91531]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9 2024-05-03T22:35:51.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:50.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:51.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:50.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:51.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:50.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:51.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:50.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:51.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:50.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:51.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:50.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:51.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:50 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:50.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:51.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:51 smithi082 podman[91550]: 2024-05-03 22:35:51.119162663 +0000 UTC m=+0.687927090 container remove 59292543ea366434d3ec466d13b646f5ed60055c0ec686757259a35759ef4eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:35:51.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:51 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:51.242+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:51.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:51 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:51.242+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:51.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:51 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:51.242+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:51.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:51 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:51.242+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:51.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:51 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:51.242+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:51.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:51 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:51.242+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:52.183 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:51 smithi082 podman[91645]: 2024-05-03 22:35:51.784581314 +0000 UTC m=+0.038467766 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:35:52.183 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:51 smithi082 podman[91645]: 2024-05-03 22:35:51.911600509 +0000 UTC m=+0.165486993 container create d62b49e7121ae5fa8794592a4f7bd3fc1e435495e3457d3230d9524a65d451c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_CLEAN=True) 2024-05-03T22:35:52.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:51 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:51.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:52.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:51 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:51.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:52.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:51 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:51.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:52.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:51 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:51.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:52.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:51 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:51.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:52.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:51 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:51.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:52.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:51 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:51.785+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:52.476 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:52 smithi082 podman[91645]: 2024-05-03 22:35:52.181723739 +0000 UTC m=+0.435610229 container init d62b49e7121ae5fa8794592a4f7bd3fc1e435495e3457d3230d9524a65d451c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:35:52.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:52 smithi082 podman[91645]: 2024-05-03 22:35:52.193886094 +0000 UTC m=+0.447772551 container start d62b49e7121ae5fa8794592a4f7bd3fc1e435495e3457d3230d9524a65d451c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-03T22:35:52.477 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:52 smithi082 podman[91645]: 2024-05-03 22:35:52.289173465 +0000 UTC m=+0.543059939 container attach d62b49e7121ae5fa8794592a4f7bd3fc1e435495e3457d3230d9524a65d451c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-03T22:35:52.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:52 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:52.244+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:52.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:52 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:52.244+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:52.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:52 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:52.244+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:52.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:52 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:52.244+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:52.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:52 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:52.244+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:52.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:52 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:52.244+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:52.976 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 03 22:35:52 smithi082 podman[91645]: 2024-05-03 22:35:52.640646679 +0000 UTC m=+0.894533157 container died d62b49e7121ae5fa8794592a4f7bd3fc1e435495e3457d3230d9524a65d451c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-03T22:35:53.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:52 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:52.797+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:53.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:52 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:52.797+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:53.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:52 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:52.797+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:53.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:52 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:52.797+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:53.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:52 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:52.797+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:53.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:52 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:52.797+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:53.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:52 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:52.797+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:53.360 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.9.service' 2024-05-03T22:35:53.464 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:35:53.464 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-03T22:35:53.465 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-03T22:35:53.465 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.10 2024-05-03T22:35:53.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:53 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:53.201+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:53.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:53 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:53.201+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:53.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:53 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:53.201+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:53.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:53 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:53.201+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:53.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:53 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:53.201+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:53.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:53 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:53.201+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:53.828 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:53 smithi116 systemd[1]: Stopping Ceph osd.10 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:35:54.079 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:53 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:53.824+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:54.079 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:53 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:53.824+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:54.079 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:53 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:53.824+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:54.080 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:53 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:53.824+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:54.080 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:53 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:53.824+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:54.080 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:53 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:53.824+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:54.080 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:53 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:53.824+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:54.080 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:54 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:54.077+0000 7fb369c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:35:54.080 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:54 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:54.077+0000 7fb369c00700 -1 osd.10 96 *** Got signal Terminated *** 2024-05-03T22:35:54.080 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:54 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:54.077+0000 7fb369c00700 -1 osd.10 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:35:54.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:54 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:54.222+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:54.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:54 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:54.222+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:54.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:54 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:54.222+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:54.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:54 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:54.222+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:54.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:54 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:54.222+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:54.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:54 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:54.222+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:55.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:54 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:54.853+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:55.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:54 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:54.853+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:55.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:54 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:54.853+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:55.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:54 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:54.853+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:55.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:54 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:54.853+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:55.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:54 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:54.853+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:55.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:54 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:54.853+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:55.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:55 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:55.247+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:55.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:55 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:55.247+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:55.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:55 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:55.247+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:55.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:55 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:55.247+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:55.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:55 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:55.247+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:55.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:55 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:55.247+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:56.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:55 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:55.860+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:56.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:55 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:55.860+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:56.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:55 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:55.860+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:56.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:55 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:55.860+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:56.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:55 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:55.860+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:56.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:55 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:55.860+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:56.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:55 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:55.860+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:56.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:56 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:56.219+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:56.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:56 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:56.219+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:56.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:56 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:56.219+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:56.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:56 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:56.219+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:56.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:56 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:56.219+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:56.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:56 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:56.219+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:56.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:56 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:56.219+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:35:57.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:56 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:56.890+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:57.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:56 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:56.890+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:57.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:56 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:56.890+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:57.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:56 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:56.890+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:57.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:56 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:56.890+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:57.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:56 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:56.890+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:57.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:56 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:56.890+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:57.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:57 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:57.232+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:57.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:57 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:57.232+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:57.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:57 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:57.232+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:57.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:57 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:57.232+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:57.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:57 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:57.232+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:57.529 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:57 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:57.232+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:57.529 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:57 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:57.232+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:35:58.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:57 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:57.893+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:58.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:57 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:57.893+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:58.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:57 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:57.893+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:58.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:57 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:57.893+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:58.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:57 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:57.893+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:58.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:57 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:57.893+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:58.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:57 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:57.893+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:58.277 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:58 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:58.206+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:58.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:58 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:58.206+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:58.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:58 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:58.206+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:58.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:58 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:58.206+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:58.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:58 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:58.206+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:58.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:58 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:58.206+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:58.278 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:58 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:58.206+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:35:59.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:58.848+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:23.064419+0000 front 2024-05-03T22:34:23.064126+0000 (oldest deadline 2024-05-03T22:34:47.763820+0000) 2024-05-03T22:35:59.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:58.848+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:35.868313+0000 front 2024-05-03T22:34:35.868443+0000 (oldest deadline 2024-05-03T22:35:01.168573+0000) 2024-05-03T22:35:59.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:58.848+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:41.169948+0000 front 2024-05-03T22:34:41.169840+0000 (oldest deadline 2024-05-03T22:35:07.070133+0000) 2024-05-03T22:35:59.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:58.848+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-03T22:34:51.673485+0000 front 2024-05-03T22:34:51.673647+0000 (oldest deadline 2024-05-03T22:35:15.173534+0000) 2024-05-03T22:35:59.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:58.848+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:03.777872+0000 front 2024-05-03T22:35:03.778143+0000 (oldest deadline 2024-05-03T22:35:28.478062+0000) 2024-05-03T22:35:59.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:58.848+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.480950+0000 front 2024-05-03T22:35:12.480817+0000 (oldest deadline 2024-05-03T22:35:34.780752+0000) 2024-05-03T22:35:59.187 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:58 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10[56807]: 2024-05-03T22:35:58.848+0000 7fb360400700 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:22.284250+0000 front 2024-05-03T22:35:22.284628+0000 (oldest deadline 2024-05-03T22:35:43.384140+0000) 2024-05-03T22:35:59.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:59 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:59.193+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:35:59.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:59 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:59.193+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:35:59.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:59 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:59.193+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:35:59.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:59 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:59.193+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:35:59.529 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:59 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:59.193+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:35:59.529 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:59 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:59.193+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:35:59.529 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:35:59 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:35:59.193+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:35:59.846 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:59 smithi116 podman[68497]: 2024-05-03 22:35:59.5892799 +0000 UTC m=+5.654797514 container died f41267355dc9c4727ebcb8f457aa0f49440af6f49de8a37dcdc78527c20921b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-05-03T22:36:00.131 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:59 smithi116 podman[68497]: 2024-05-03 22:35:59.95353096 +0000 UTC m=+6.019048571 container cleanup f41267355dc9c4727ebcb8f457aa0f49440af6f49de8a37dcdc78527c20921b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-03T22:36:00.132 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:35:59 smithi116 bash[68497]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10 2024-05-03T22:36:00.435 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:36:00 smithi116 podman[68518]: 2024-05-03 22:36:00.129650062 +0000 UTC m=+0.523360465 container remove f41267355dc9c4727ebcb8f457aa0f49440af6f49de8a37dcdc78527c20921b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-05-03T22:36:00.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:00.161+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:36:00.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:00.161+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:36:00.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:00.161+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:36:00.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:00.161+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:36:00.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:00.161+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:36:00.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:00.161+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:36:00.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:00.161+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:36:01.185 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:36:00 smithi116 podman[68606]: 2024-05-03 22:36:00.834373369 +0000 UTC m=+0.036156317 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:36:01.186 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:36:00 smithi116 podman[68606]: 2024-05-03 22:36:00.939007949 +0000 UTC m=+0.140790898 container create dd6a15acab37c2c52079c4547a494f44fd4bb5cd4abb77738ab888d81e1635fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430) 2024-05-03T22:36:01.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:01.173+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:36:01.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:01.173+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:36:01.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:01.173+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:36:01.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:01.173+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:36:01.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:01.173+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:36:01.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:01.173+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:36:01.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:01 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:01.173+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:36:01.685 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:36:01 smithi116 podman[68606]: 2024-05-03 22:36:01.243038643 +0000 UTC m=+0.444821646 container init dd6a15acab37c2c52079c4547a494f44fd4bb5cd4abb77738ab888d81e1635fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-03T22:36:01.685 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:36:01 smithi116 podman[68606]: 2024-05-03 22:36:01.25364384 +0000 UTC m=+0.455426772 container start dd6a15acab37c2c52079c4547a494f44fd4bb5cd4abb77738ab888d81e1635fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-03T22:36:01.685 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:36:01 smithi116 podman[68606]: 2024-05-03 22:36:01.324784584 +0000 UTC m=+0.526567587 container attach dd6a15acab37c2c52079c4547a494f44fd4bb5cd4abb77738ab888d81e1635fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:36:01.974 INFO:journalctl@ceph.osd.10.smithi116.stdout:May 03 22:36:01 smithi116 podman[68606]: 2024-05-03 22:36:01.702640973 +0000 UTC m=+0.904423969 container died dd6a15acab37c2c52079c4547a494f44fd4bb5cd4abb77738ab888d81e1635fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-03T22:36:02.386 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.10.service' 2024-05-03T22:36:02.491 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:02.492 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-03T22:36:02.492 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-03T22:36:02.492 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.11 2024-05-03T22:36:02.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:02.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:36:02.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:02.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:36:02.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:02.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:36:02.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:02.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:36:02.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:02.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:36:02.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:02.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:36:02.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:02 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:02.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:36:03.027 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:02 smithi130 systemd[1]: Stopping Ceph osd.11 for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:03.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:03.030+0000 7f553f200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:03.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:03.030+0000 7f553f200700 -1 osd.11 96 *** Got signal Terminated *** 2024-05-03T22:36:03.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:03.030+0000 7f553f200700 -1 osd.11 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T22:36:03.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:03.189+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:36:03.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:03.189+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:36:03.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:03.189+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:36:03.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:03.189+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:36:03.529 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:03.189+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:36:03.529 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:03.189+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:36:03.529 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:03 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:03.189+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:36:04.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:04.158+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:36:04.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:04.158+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:36:04.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:04.158+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:36:04.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:04.158+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:36:04.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:04.158+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:36:04.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:04.158+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:36:04.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:04 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:04.158+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:36:05.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:05.150+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:36:05.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:05.150+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:36:05.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:05.150+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:36:05.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:05.150+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:36:05.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:05.150+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:36:05.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:05.150+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:36:05.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:05 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:05.150+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:36:06.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:06.136+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:36:06.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:06.136+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:36:06.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:06.136+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:36:06.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:06.136+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:36:06.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:06.136+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:36:06.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:06.136+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:36:06.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:06.136+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:36:06.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:06 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:06.136+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6820 osd.8 since back 2024-05-03T22:35:39.915577+0000 front 2024-05-03T22:35:39.915629+0000 (oldest deadline 2024-05-03T22:36:05.815475+0000) 2024-05-03T22:36:07.464 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:07.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-03T22:34:25.995511+0000 front 2024-05-03T22:34:25.995770+0000 (oldest deadline 2024-05-03T22:34:51.295220+0000) 2024-05-03T22:36:07.464 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:07.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-05-03T22:34:32.997690+0000 front 2024-05-03T22:34:32.997505+0000 (oldest deadline 2024-05-03T22:34:58.897588+0000) 2024-05-03T22:36:07.464 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:07.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6804 osd.2 since back 2024-05-03T22:34:45.300824+0000 front 2024-05-03T22:34:45.300043+0000 (oldest deadline 2024-05-03T22:35:07.000035+0000) 2024-05-03T22:36:07.464 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:07.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-05-03T22:35:00.905987+0000 front 2024-05-03T22:35:00.905945+0000 (oldest deadline 2024-05-03T22:35:26.205692+0000) 2024-05-03T22:36:07.464 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:07.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6812 osd.5 since back 2024-05-03T22:35:12.608559+0000 front 2024-05-03T22:35:12.608489+0000 (oldest deadline 2024-05-03T22:35:35.508626+0000) 2024-05-03T22:36:07.465 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:07.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-03T22:35:20.711001+0000 front 2024-05-03T22:35:20.710960+0000 (oldest deadline 2024-05-03T22:35:42.911869+0000) 2024-05-03T22:36:07.465 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:07.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-05-03T22:35:29.914327+0000 front 2024-05-03T22:35:29.914164+0000 (oldest deadline 2024-05-03T22:35:55.813979+0000) 2024-05-03T22:36:07.465 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:07 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11[58388]: 2024-05-03T22:36:07.183+0000 7f553aa00700 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.130:6820 osd.8 since back 2024-05-03T22:35:39.915577+0000 front 2024-05-03T22:35:39.915629+0000 (oldest deadline 2024-05-03T22:36:05.815475+0000) 2024-05-03T22:36:08.644 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:08 smithi130 podman[69825]: 2024-05-03 22:36:08.385492319 +0000 UTC m=+5.502869117 container died 3a03bee4099bd335de70c5d6ec90ac15d198c66c1d2758e3bb5220500d3b24f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-03T22:36:08.982 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:08 smithi130 podman[69825]: 2024-05-03 22:36:08.795790602 +0000 UTC m=+5.913167407 container cleanup 3a03bee4099bd335de70c5d6ec90ac15d198c66c1d2758e3bb5220500d3b24f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-03T22:36:08.983 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:08 smithi130 bash[69825]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11 2024-05-03T22:36:09.277 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:08 smithi130 podman[69845]: 2024-05-03 22:36:08.97968794 +0000 UTC m=+0.574424270 container remove 3a03bee4099bd335de70c5d6ec90ac15d198c66c1d2758e3bb5220500d3b24f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-05-03T22:36:10.106 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:09 smithi130 podman[69933]: 2024-05-03 22:36:09.721278233 +0000 UTC m=+0.036127754 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:36:10.106 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:09 smithi130 podman[69933]: 2024-05-03 22:36:09.872218857 +0000 UTC m=+0.187068426 container create f18740166738fed8b11d38dcaf0130275e9a5db2c4b57dcf715d39611ba12c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:36:10.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:10 smithi130 podman[69933]: 2024-05-03 22:36:10.101487931 +0000 UTC m=+0.416337490 container init f18740166738fed8b11d38dcaf0130275e9a5db2c4b57dcf715d39611ba12c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-03T22:36:10.527 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:10 smithi130 podman[69933]: 2024-05-03 22:36:10.114632515 +0000 UTC m=+0.429482074 container start f18740166738fed8b11d38dcaf0130275e9a5db2c4b57dcf715d39611ba12c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:36:10.528 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:10 smithi130 podman[69933]: 2024-05-03 22:36:10.190777336 +0000 UTC m=+0.505626931 container attach f18740166738fed8b11d38dcaf0130275e9a5db2c4b57dcf715d39611ba12c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5) 2024-05-03T22:36:10.899 INFO:journalctl@ceph.osd.11.smithi130.stdout:May 03 22:36:10 smithi130 podman[69933]: 2024-05-03 22:36:10.558960961 +0000 UTC m=+0.873810518 container died f18740166738fed8b11d38dcaf0130275e9a5db2c4b57dcf715d39611ba12c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:36:11.243 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@osd.11.service' 2024-05-03T22:36:11.379 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:11.380 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-03T22:36:11.380 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-03T22:36:11.380 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.a 2024-05-03T22:36:11.726 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:36:11 smithi082 systemd[1]: Stopping Ceph mds.a for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:12.426 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:36:11 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a[68091]: 2024-05-03T22:36:11.980+0000 7efc7aa00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:12.427 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:36:11 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a[68091]: 2024-05-03T22:36:11.980+0000 7efc7aa00700 -1 mds.a *** got signal Terminated *** 2024-05-03T22:36:14.889 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:36:14 smithi082 podman[91750]: 2024-05-03 22:36:14.572717719 +0000 UTC m=+2.739171914 container died 2a132cfa614bc468f7216b45da35a4a4c2c5377e7a4343f7a8c76932642fec3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-03T22:36:15.226 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:36:14 smithi082 podman[91750]: 2024-05-03 22:36:14.999343979 +0000 UTC m=+3.165798200 container cleanup 2a132cfa614bc468f7216b45da35a4a4c2c5377e7a4343f7a8c76932642fec3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:36:15.227 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:36:14 smithi082 bash[91750]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a 2024-05-03T22:36:15.726 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 03 22:36:15 smithi082 podman[91775]: 2024-05-03 22:36:15.283631228 +0000 UTC m=+0.699878868 container remove 2a132cfa614bc468f7216b45da35a4a4c2c5377e7a4343f7a8c76932642fec3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-a, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-05-03T22:36:15.803 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.a.service' 2024-05-03T22:36:15.911 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:15.912 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-03T22:36:15.912 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-03T22:36:15.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.d 2024-05-03T22:36:16.226 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:36:16 smithi082 systemd[1]: Stopping Ceph mds.d for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:16.726 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:36:16 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-d[66745]: 2024-05-03T22:36:16.459+0000 7f1db1800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:16.726 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:36:16 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-d[66745]: 2024-05-03T22:36:16.459+0000 7f1db1800700 -1 mds.d *** got signal Terminated *** 2024-05-03T22:36:18.350 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:36:18 smithi082 podman[91883]: 2024-05-03 22:36:18.03684134 +0000 UTC m=+1.694726765 container died 17942a4f5afbd586b93109c0497c1495fdf0164b1653851404a619670070555f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-d, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-03T22:36:18.726 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:36:18 smithi082 podman[91883]: 2024-05-03 22:36:18.460797241 +0000 UTC m=+2.118682675 container cleanup 17942a4f5afbd586b93109c0497c1495fdf0164b1653851404a619670070555f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-03T22:36:18.727 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:36:18 smithi082 bash[91883]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-d 2024-05-03T22:36:19.226 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 03 22:36:18 smithi082 podman[91897]: 2024-05-03 22:36:18.728454511 +0000 UTC m=+0.672639582 container remove 17942a4f5afbd586b93109c0497c1495fdf0164b1653851404a619670070555f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240430) 2024-05-03T22:36:19.269 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.d.service' 2024-05-03T22:36:19.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:19.365 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-03T22:36:19.366 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-03T22:36:19.366 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.g 2024-05-03T22:36:19.976 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:36:19 smithi082 systemd[1]: Stopping Ceph mds.g for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:20.476 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:36:19 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g[67687]: 2024-05-03T22:36:19.986+0000 7fdd22600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:20.476 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:36:19 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g[67687]: 2024-05-03T22:36:19.986+0000 7fdd22600700 -1 mds.g *** got signal Terminated *** 2024-05-03T22:36:22.869 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:36:22 smithi082 podman[92003]: 2024-05-03 22:36:22.572440232 +0000 UTC m=+2.714240579 container died 5eacb023eee3d5bfdb3cda63defc13c406c8c0062844439f3436a0663c955466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-03T22:36:23.229 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:36:22 smithi082 podman[92003]: 2024-05-03 22:36:22.980407983 +0000 UTC m=+3.122208350 container cleanup 5eacb023eee3d5bfdb3cda63defc13c406c8c0062844439f3436a0663c955466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:36:23.229 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:36:22 smithi082 bash[92003]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g 2024-05-03T22:36:23.692 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 03 22:36:23 smithi082 podman[92017]: 2024-05-03 22:36:23.24827987 +0000 UTC m=+0.654482750 container remove 5eacb023eee3d5bfdb3cda63defc13c406c8c0062844439f3436a0663c955466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:36:23.730 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.g.service' 2024-05-03T22:36:23.831 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:23.831 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-03T22:36:23.832 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-03T22:36:23.832 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.j 2024-05-03T22:36:23.976 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:36:23 smithi082 systemd[1]: Stopping Ceph mds.j for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:24.726 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:36:24 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-j[66332]: 2024-05-03T22:36:24.372+0000 7f3ff2c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:24.727 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:36:24 smithi082 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-j[66332]: 2024-05-03T22:36:24.372+0000 7f3ff2c00700 -1 mds.j *** got signal Terminated *** 2024-05-03T22:36:28.673 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:36:28 smithi082 podman[92124]: 2024-05-03 22:36:28.389698962 +0000 UTC m=+4.144907282 container died a95ae38a883f7a406c516bd64425972c3f753f8ff2ab0c3e7b75446bd3dc1c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-j, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-05-03T22:36:28.976 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:36:28 smithi082 podman[92124]: 2024-05-03 22:36:28.783580273 +0000 UTC m=+4.538788648 container cleanup a95ae38a883f7a406c516bd64425972c3f753f8ff2ab0c3e7b75446bd3dc1c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:36:28.977 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:36:28 smithi082 bash[92124]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-j 2024-05-03T22:36:29.349 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 03 22:36:29 smithi082 podman[92150]: 2024-05-03 22:36:29.092694715 +0000 UTC m=+0.685844870 container remove a95ae38a883f7a406c516bd64425972c3f753f8ff2ab0c3e7b75446bd3dc1c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0) 2024-05-03T22:36:29.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.j.service' 2024-05-03T22:36:29.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:29.502 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-03T22:36:29.502 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-03T22:36:29.502 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.b 2024-05-03T22:36:29.935 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:36:29 smithi116 systemd[1]: Stopping Ceph mds.b for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:30.294 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:36:30 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b[62451]: 2024-05-03T22:36:30.109+0000 7f082bc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:30.295 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:36:30 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b[62451]: 2024-05-03T22:36:30.109+0000 7f082bc00700 -1 mds.b *** got signal Terminated *** 2024-05-03T22:36:34.388 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:36:34 smithi116 podman[68715]: 2024-05-03 22:36:34.12859471 +0000 UTC m=+4.160161814 container died d5750506c7ddf00b77450fe058ced3f6b164c052d4408f2ddc53a77932502357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0) 2024-05-03T22:36:34.655 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:36:34 smithi116 podman[68715]: 2024-05-03 22:36:34.486342962 +0000 UTC m=+4.517910069 container cleanup d5750506c7ddf00b77450fe058ced3f6b164c052d4408f2ddc53a77932502357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-03T22:36:34.656 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:36:34 smithi116 bash[68715]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b 2024-05-03T22:36:34.935 INFO:journalctl@ceph.mds.b.smithi116.stdout:May 03 22:36:34 smithi116 podman[68740]: 2024-05-03 22:36:34.653933637 +0000 UTC m=+0.508034105 container remove d5750506c7ddf00b77450fe058ced3f6b164c052d4408f2ddc53a77932502357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-b, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:36:35.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.b.service' 2024-05-03T22:36:35.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:35.242 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-03T22:36:35.242 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-03T22:36:35.242 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.e 2024-05-03T22:36:35.435 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:36:35 smithi116 systemd[1]: Stopping Ceph mds.e for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:36.185 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:36:35 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e[61830]: 2024-05-03T22:36:35.812+0000 7ff266c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:36.185 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:36:35 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e[61830]: 2024-05-03T22:36:35.812+0000 7ff266c00700 -1 mds.e *** got signal Terminated *** 2024-05-03T22:36:38.935 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:36:38 smithi116 podman[68847]: 2024-05-03 22:36:38.635671645 +0000 UTC m=+2.981129016 container died 53f56e322049dc4c94acee1c7589428e3ae2db553adcd849596389f1b5a15deb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True) 2024-05-03T22:36:39.292 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:36:39 smithi116 podman[68847]: 2024-05-03 22:36:39.056586064 +0000 UTC m=+3.402043369 container cleanup 53f56e322049dc4c94acee1c7589428e3ae2db553adcd849596389f1b5a15deb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-03T22:36:39.293 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:36:39 smithi116 bash[68847]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e 2024-05-03T22:36:39.685 INFO:journalctl@ceph.mds.e.smithi116.stdout:May 03 22:36:39 smithi116 podman[68861]: 2024-05-03 22:36:39.290860858 +0000 UTC m=+0.639265676 container remove 53f56e322049dc4c94acee1c7589428e3ae2db553adcd849596389f1b5a15deb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-03T22:36:39.775 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.e.service' 2024-05-03T22:36:39.873 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:39.874 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-03T22:36:39.874 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-03T22:36:39.874 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.h 2024-05-03T22:36:40.435 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:36:40 smithi116 systemd[1]: Stopping Ceph mds.h for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:40.935 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:36:40 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h[62136]: 2024-05-03T22:36:40.432+0000 7f2035600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:40.935 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:36:40 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h[62136]: 2024-05-03T22:36:40.432+0000 7f2035600700 -1 mds.h *** got signal Terminated *** 2024-05-03T22:36:42.884 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:36:42 smithi116 podman[68969]: 2024-05-03 22:36:42.62936828 +0000 UTC m=+2.315238438 container died 409af15ca2d53b437030d02d5369af197cfac4c1461ac0cd19af79723415f83a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:36:43.185 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:36:42 smithi116 podman[68969]: 2024-05-03 22:36:42.968484475 +0000 UTC m=+2.654354623 container cleanup 409af15ca2d53b437030d02d5369af197cfac4c1461ac0cd19af79723415f83a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-03T22:36:43.186 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:36:42 smithi116 bash[68969]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h 2024-05-03T22:36:43.186 INFO:journalctl@ceph.mds.h.smithi116.stdout:May 03 22:36:43 smithi116 podman[68983]: 2024-05-03 22:36:43.11118836 +0000 UTC m=+0.460424591 container remove 409af15ca2d53b437030d02d5369af197cfac4c1461ac0cd19af79723415f83a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-05-03T22:36:43.591 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.h.service' 2024-05-03T22:36:43.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:43.696 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-03T22:36:43.696 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-03T22:36:43.697 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.k 2024-05-03T22:36:43.935 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:36:43 smithi116 systemd[1]: Stopping Ceph mds.k for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:44.685 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:36:44 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k[61522]: 2024-05-03T22:36:44.193+0000 7f81dfc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:44.686 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:36:44 smithi116 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k[61522]: 2024-05-03T22:36:44.193+0000 7f81dfc00700 -1 mds.k *** got signal Terminated *** 2024-05-03T22:36:46.886 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:36:46 smithi116 podman[69088]: 2024-05-03 22:36:46.617282802 +0000 UTC m=+2.539110376 container died dc40b64618d5e167e8cf0acc87816c901658002f05e02765ff0c7df70a70dffa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-03T22:36:47.173 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:36:46 smithi116 podman[69088]: 2024-05-03 22:36:46.996504835 +0000 UTC m=+2.918332399 container cleanup dc40b64618d5e167e8cf0acc87816c901658002f05e02765ff0c7df70a70dffa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-03T22:36:47.174 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:36:46 smithi116 bash[69088]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k 2024-05-03T22:36:47.435 INFO:journalctl@ceph.mds.k.smithi116.stdout:May 03 22:36:47 smithi116 podman[69102]: 2024-05-03 22:36:47.172161602 +0000 UTC m=+0.535998448 container remove dc40b64618d5e167e8cf0acc87816c901658002f05e02765ff0c7df70a70dffa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-k, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:36:47.668 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.k.service' 2024-05-03T22:36:47.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:47.776 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-03T22:36:47.776 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-03T22:36:47.776 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.c 2024-05-03T22:36:48.277 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:36:47 smithi130 systemd[1]: Stopping Ceph mds.c for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:48.777 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:36:48 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c[63547]: 2024-05-03T22:36:48.324+0000 7f49f0a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:48.777 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:36:48 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c[63547]: 2024-05-03T22:36:48.324+0000 7f49f0a00700 -1 mds.c *** got signal Terminated *** 2024-05-03T22:36:50.900 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:36:50 smithi130 podman[70049]: 2024-05-03 22:36:50.638532964 +0000 UTC m=+2.427637818 container died f877dd61c79c9a6ca2e485f90026fb3d318fdccaf48da62f24b0daaf23cdf594 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:36:51.278 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:36:51 smithi130 podman[70049]: 2024-05-03 22:36:51.050975454 +0000 UTC m=+2.840080315 container cleanup f877dd61c79c9a6ca2e485f90026fb3d318fdccaf48da62f24b0daaf23cdf594 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-05-03T22:36:51.278 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:36:51 smithi130 bash[70049]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c 2024-05-03T22:36:51.736 INFO:journalctl@ceph.mds.c.smithi130.stdout:May 03 22:36:51 smithi130 podman[70074]: 2024-05-03 22:36:51.284790415 +0000 UTC m=+0.641309719 container remove f877dd61c79c9a6ca2e485f90026fb3d318fdccaf48da62f24b0daaf23cdf594 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-03T22:36:51.785 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.c.service' 2024-05-03T22:36:51.886 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:51.887 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-03T22:36:51.887 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-03T22:36:51.887 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.f 2024-05-03T22:36:52.437 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:36:52 smithi130 systemd[1]: Stopping Ceph mds.f for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:52.777 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:36:52 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f[63243]: 2024-05-03T22:36:52.434+0000 7f2273200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:52.777 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:36:52 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f[63243]: 2024-05-03T22:36:52.434+0000 7f2273200700 -1 mds.f *** got signal Terminated *** 2024-05-03T22:36:54.994 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:36:54 smithi130 podman[70183]: 2024-05-03 22:36:54.63125503 +0000 UTC m=+2.309011598 container died 64a74029371983a5d775eb18f63ba41170014df640da06a477ca96744d06c0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-03T22:36:55.277 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:36:55 smithi130 podman[70183]: 2024-05-03 22:36:55.103971567 +0000 UTC m=+2.781728160 container cleanup 64a74029371983a5d775eb18f63ba41170014df640da06a477ca96744d06c0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2) 2024-05-03T22:36:55.277 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:36:55 smithi130 bash[70183]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f 2024-05-03T22:36:55.737 INFO:journalctl@ceph.mds.f.smithi130.stdout:May 03 22:36:55 smithi130 podman[70196]: 2024-05-03 22:36:55.279745145 +0000 UTC m=+0.625767683 container remove 64a74029371983a5d775eb18f63ba41170014df640da06a477ca96744d06c0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-03T22:36:55.779 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.f.service' 2024-05-03T22:36:55.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:55.883 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-03T22:36:55.883 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-03T22:36:55.883 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.i 2024-05-03T22:36:56.439 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:36:56 smithi130 systemd[1]: Stopping Ceph mds.i for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:36:56.777 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:36:56 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i[63850]: 2024-05-03T22:36:56.436+0000 7ffb9b200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:36:56.777 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:36:56 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i[63850]: 2024-05-03T22:36:56.436+0000 7ffb9b200700 -1 mds.i *** got signal Terminated *** 2024-05-03T22:36:58.898 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:36:58 smithi130 podman[70302]: 2024-05-03 22:36:58.611203927 +0000 UTC m=+2.286060095 container died aba961ca1bdbcd5bd5d758886f69b72f4f47f94ee60a05ad9ca65a839e032cce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-03T22:36:59.277 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:36:59 smithi130 podman[70302]: 2024-05-03 22:36:59.023805679 +0000 UTC m=+2.698661874 container cleanup aba961ca1bdbcd5bd5d758886f69b72f4f47f94ee60a05ad9ca65a839e032cce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.build-date=20240430, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-03T22:36:59.277 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:36:59 smithi130 bash[70302]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i 2024-05-03T22:36:59.723 INFO:journalctl@ceph.mds.i.smithi130.stdout:May 03 22:36:59 smithi130 podman[70316]: 2024-05-03 22:36:59.282793012 +0000 UTC m=+0.652777476 container remove aba961ca1bdbcd5bd5d758886f69b72f4f47f94ee60a05ad9ca65a839e032cce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-03T22:36:59.750 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.i.service' 2024-05-03T22:36:59.852 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:36:59.853 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-03T22:36:59.853 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-03T22:36:59.853 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.l 2024-05-03T22:37:00.276 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:37:00 smithi130 systemd[1]: Stopping Ceph mds.l for 81cd0262-0998-11ef-bc97-c7b262605968... 2024-05-03T22:37:00.777 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:37:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l[62933]: 2024-05-03T22:37:00.440+0000 7fd01c000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:37:00.777 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:37:00 smithi130 ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l[62933]: 2024-05-03T22:37:00.440+0000 7fd01c000700 -1 mds.l *** got signal Terminated *** 2024-05-03T22:37:02.883 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:37:02 smithi130 podman[70420]: 2024-05-03 22:37:02.614392367 +0000 UTC m=+2.277571773 container died 31d8ffe47f9b763a52f353ebd793060218cc1f373788c14090242d2fffb9ffd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-03T22:37:03.162 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:37:02 smithi130 podman[70420]: 2024-05-03 22:37:02.976225613 +0000 UTC m=+2.639405018 container cleanup 31d8ffe47f9b763a52f353ebd793060218cc1f373788c14090242d2fffb9ffd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-05-03T22:37:03.162 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:37:02 smithi130 bash[70420]: ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l 2024-05-03T22:37:03.527 INFO:journalctl@ceph.mds.l.smithi130.stdout:May 03 22:37:03 smithi130 podman[70435]: 2024-05-03 22:37:03.160478239 +0000 UTC m=+0.529106897 container remove 31d8ffe47f9b763a52f353ebd793060218cc1f373788c14090242d2fffb9ffd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-81cd0262-0998-11ef-bc97-c7b262605968-mds-l, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-03T22:37:03.640 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-81cd0262-0998-11ef-bc97-c7b262605968@mds.l.service' 2024-05-03T22:37:03.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T22:37:03.744 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-03T22:37:03.744 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 81cd0262-0998-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-03T22:37:04.059 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:37:09.030 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 81cd0262-0998-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-03T22:37:09.347 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:37:14.138 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 81cd0262-0998-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-03T22:37:14.439 INFO:teuthology.orchestra.run.smithi130.stdout:Deleting cluster with fsid: 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:37:19.326 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:37:19.416 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:37:19.515 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:37:19.578 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-03T22:37:19.580 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536/remote/smithi082/crash 2024-05-03T22:37:19.581 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/crash -- . 2024-05-03T22:37:19.742 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-03T22:37:19.742 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-05-03T22:37:19.747 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536/remote/smithi116/crash 2024-05-03T22:37:19.748 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/crash -- . 2024-05-03T22:37:19.853 INFO:teuthology.orchestra.run.smithi116.stderr:tar: /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-03T22:37:19.854 INFO:teuthology.orchestra.run.smithi116.stderr:tar: Error is not recoverable: exiting now 2024-05-03T22:37:19.858 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536/remote/smithi130/crash 2024-05-03T22:37:19.859 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/crash -- . 2024-05-03T22:37:19.941 INFO:teuthology.orchestra.run.smithi130.stderr:tar: /var/lib/ceph/81cd0262-0998-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-03T22:37:19.941 INFO:teuthology.orchestra.run.smithi130.stderr:tar: Error is not recoverable: exiting now 2024-05-03T22:37:19.943 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-03T22:37:19.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-03T22:37:20.046 INFO:tasks.cephadm:Compressing logs... 2024-05-03T22:37:20.047 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-03T22:37:20.051 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-03T22:37:20.058 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-03T22:37:20.106 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-03T22:37:20.106 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.log 2024-05-03T22:37:20.107 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-03T22:37:20.107 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.g.log 2024-05-03T22:37:20.108 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.j.log 2024-05-03T22:37:20.109 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-03T22:37:20.111 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-03T22:37:20.111 INFO:teuthology.orchestra.run.smithi082.stderr: 90.3% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-03T22:37:20.111 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-03T22:37:20.112 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mgr.x.log 2024-05-03T22:37:20.113 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mon.a.log 2024-05-03T22:37:20.114 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.6.log 2024-05-03T22:37:20.116 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-03T22:37:20.116 INFO:teuthology.orchestra.run.smithi082.stderr: 94.5% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.j.log.gz 2024-05-03T22:37:20.117 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.a.log 2024-05-03T22:37:20.119 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.cephadm.log: 83.3% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-03T22:37:20.119 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-03T22:37:20.122 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.d.log 2024-05-03T22:37:20.126 INFO:teuthology.orchestra.run.smithi130.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-03T22:37:20.126 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.log 2024-05-03T22:37:20.127 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-03T22:37:20.128 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.9.log 2024-05-03T22:37:20.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.f.log 2024-05-03T22:37:20.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-03T22:37:20.129 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-05-03T22:37:20.130 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-03T22:37:20.131 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-03T22:37:20.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.c.log 2024-05-03T22:37:20.133 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mon.c.log 2024-05-03T22:37:20.134 INFO:teuthology.orchestra.run.smithi116.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.log 2024-05-03T22:37:20.134 INFO:teuthology.orchestra.run.smithi116.stderr:: No such file or directory 2024-05-03T22:37:20.135 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-03T22:37:20.136 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.7.log 2024-05-03T22:37:20.136 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-03T22:37:20.137 INFO:teuthology.orchestra.run.smithi130.stderr: 90.5%/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.c.log: -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-03T22:37:20.137 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mgr.z.log 2024-05-03T22:37:20.138 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.i.log 2024-05-03T22:37:20.138 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.b.log 2024-05-03T22:37:20.139 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-03T22:37:20.139 INFO:teuthology.orchestra.run.smithi116.stderr: 89.0% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-03T22:37:20.140 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mgr.z.log: /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-03T22:37:20.140 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-03T22:37:20.140 INFO:teuthology.orchestra.run.smithi116.stderr: 90.4% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-03T22:37:20.140 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mgr.y.log 2024-05-03T22:37:20.141 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.h.log 2024-05-03T22:37:20.142 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.11.log 2024-05-03T22:37:20.143 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.10.log 2024-05-03T22:37:20.145 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 94.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-05-03T22:37:20.145 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-03T22:37:20.146 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.cephadm.log: 83.2% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-03T22:37:20.147 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.log: -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.d.log.gz 2024-05-03T22:37:20.148 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.8.log 2024-05-03T22:37:20.148 INFO:teuthology.orchestra.run.smithi130.stderr: 93.4% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mgr.z.log.gz 2024-05-03T22:37:20.148 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.10.log: /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.cephadm.log: 83.3% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-03T22:37:20.148 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.e.log 2024-05-03T22:37:20.149 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-03T22:37:20.151 INFO:teuthology.orchestra.run.smithi082.stderr: 90.9% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-03T22:37:20.152 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-03T22:37:20.153 INFO:teuthology.orchestra.run.smithi082.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-05-03T22:37:20.154 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-volume.log: /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.l.log 2024-05-03T22:37:20.157 INFO:teuthology.orchestra.run.smithi116.stderr: 93.3% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mgr.y.log.gz 2024-05-03T22:37:20.158 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mon.b.log 2024-05-03T22:37:20.158 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.k.log 2024-05-03T22:37:20.159 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-03T22:37:20.160 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-03T22:37:20.161 INFO:teuthology.orchestra.run.smithi082.stderr: 93.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-03T22:37:20.167 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 91.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-03T22:37:20.169 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-03T22:37:20.171 INFO:teuthology.orchestra.run.smithi082.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-05-03T22:37:20.186 INFO:teuthology.orchestra.run.smithi130.stderr: 90.9% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-03T22:37:20.190 INFO:teuthology.orchestra.run.smithi116.stderr: 90.9% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-03T22:37:20.211 INFO:teuthology.orchestra.run.smithi130.stderr: 94.0% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.i.log.gz 2024-05-03T22:37:20.224 INFO:teuthology.orchestra.run.smithi082.stderr: 94.6% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.g.log.gz 2024-05-03T22:37:20.224 INFO:teuthology.orchestra.run.smithi082.stderr: 94.6% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.a.log.gz 2024-05-03T22:37:20.226 INFO:teuthology.orchestra.run.smithi116.stderr: 93.9% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.h.log.gz 2024-05-03T22:37:20.227 INFO:teuthology.orchestra.run.smithi116.stderr: 94.0% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.e.log.gz 2024-05-03T22:37:20.233 INFO:teuthology.orchestra.run.smithi130.stderr: 94.5% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.c.log.gz 2024-05-03T22:37:20.259 INFO:teuthology.orchestra.run.smithi130.stderr: 94.7% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.f.log.gz 2024-05-03T22:37:20.266 INFO:teuthology.orchestra.run.smithi116.stderr: 94.1% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.k.log.gz 2024-05-03T22:37:20.268 INFO:teuthology.orchestra.run.smithi130.stderr: 94.6% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.l.log.gz 2024-05-03T22:37:20.363 INFO:teuthology.orchestra.run.smithi116.stderr: 94.0% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mds.b.log.gz 2024-05-03T22:37:20.541 INFO:teuthology.orchestra.run.smithi082.stderr: 89.8% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mgr.x.log.gz 2024-05-03T22:37:20.623 INFO:teuthology.orchestra.run.smithi116.stderr: 92.1% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mon.b.log.gz 2024-05-03T22:37:20.710 INFO:teuthology.orchestra.run.smithi130.stderr: 92.0% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mon.c.log.gz 2024-05-03T22:37:21.099 INFO:teuthology.orchestra.run.smithi130.stderr: 92.3% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.8.log.gz 2024-05-03T22:37:21.144 INFO:teuthology.orchestra.run.smithi082.stderr: 92.2% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.9.log.gz 2024-05-03T22:37:21.202 INFO:teuthology.orchestra.run.smithi116.stderr: 92.4% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-03T22:37:21.245 INFO:teuthology.orchestra.run.smithi082.stderr: 92.5% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-03T22:37:21.254 INFO:teuthology.orchestra.run.smithi130.stderr: 92.8% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.11.log.gz 2024-05-03T22:37:21.284 INFO:teuthology.orchestra.run.smithi082.stderr: 90.4% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-mon.a.log.gz 2024-05-03T22:37:21.334 INFO:teuthology.orchestra.run.smithi116.stderr: 92.5% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-03T22:37:21.345 INFO:teuthology.orchestra.run.smithi082.stderr: 92.7% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-03T22:37:21.780 INFO:teuthology.orchestra.run.smithi116.stderr: 93.0% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.7.log.gz 2024-05-03T22:37:21.935 INFO:teuthology.orchestra.run.smithi082.stderr: 92.9% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.6.log.gz 2024-05-03T22:37:21.939 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-05-03T22:37:21.939 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m1.857s 2024-05-03T22:37:21.939 INFO:teuthology.orchestra.run.smithi082.stderr:user 0m6.534s 2024-05-03T22:37:21.940 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m0.577s 2024-05-03T22:37:21.963 INFO:teuthology.orchestra.run.smithi130.stderr: 93.0% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-03T22:37:22.037 INFO:teuthology.orchestra.run.smithi130.stderr: 93.0% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-03T22:37:22.042 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-05-03T22:37:22.042 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m1.940s 2024-05-03T22:37:22.042 INFO:teuthology.orchestra.run.smithi130.stderr:user 0m6.135s 2024-05-03T22:37:22.042 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m0.608s 2024-05-03T22:37:22.054 INFO:teuthology.orchestra.run.smithi116.stderr: 93.1% -- replaced with /var/log/ceph/81cd0262-0998-11ef-bc97-c7b262605968/ceph-osd.10.log.gz 2024-05-03T22:37:22.058 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-05-03T22:37:22.059 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m1.955s 2024-05-03T22:37:22.059 INFO:teuthology.orchestra.run.smithi116.stderr:user 0m6.185s 2024-05-03T22:37:22.059 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m0.623s 2024-05-03T22:37:22.060 INFO:tasks.cephadm:Archiving logs... 2024-05-03T22:37:22.060 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536/remote/smithi082/log 2024-05-03T22:37:22.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-03T22:37:23.107 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536/remote/smithi116/log 2024-05-03T22:37:23.108 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-03T22:37:24.068 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536/remote/smithi130/log 2024-05-03T22:37:24.069 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-03T22:37:25.000 INFO:tasks.cephadm:Removing cluster... 2024-05-03T22:37:25.001 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 81cd0262-0998-11ef-bc97-c7b262605968 --force 2024-05-03T22:37:25.323 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:37:25.972 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 81cd0262-0998-11ef-bc97-c7b262605968 --force 2024-05-03T22:37:26.276 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:37:26.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 81cd0262-0998-11ef-bc97-c7b262605968 --force 2024-05-03T22:37:27.193 INFO:teuthology.orchestra.run.smithi130.stdout:Deleting cluster with fsid: 81cd0262-0998-11ef-bc97-c7b262605968 2024-05-03T22:37:27.823 INFO:tasks.cephadm:Removing cephadm ... 2024-05-03T22:37:27.824 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-03T22:37:27.881 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-03T22:37:27.939 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-03T22:37:27.997 INFO:tasks.cephadm:Teardown complete 2024-05-03T22:37:27.997 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-03T22:37:28.007 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-03T22:37:28.008 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-03T22:37:28.015 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-03T22:37:28.023 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-03T22:37:28.181 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-03T22:37:28.190 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-03T22:37:28.191 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T22:37:28.199 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T22:37:28.208 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T22:37:28.245 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-05-03T22:37:28.256 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T22:37:28.256 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-05-03T22:37:28.256 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 28 +415us[ +425us] +/- 48ms 2024-05-03T22:37:28.257 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -1247us[-1247us] +/- 58ms 2024-05-03T22:37:28.257 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +798us[ +808us] +/- 61ms 2024-05-03T22:37:28.257 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:37:28.257 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-05-03T22:37:28.261 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-05-03T22:37:28.266 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T22:37:28.266 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-05-03T22:37:28.266 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv01.front.sepia.ceph.com 3 6 377 28 +456us[ +448us] +/- 48ms 2024-05-03T22:37:28.266 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -1221us[-1221us] +/- 58ms 2024-05-03T22:37:28.267 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +813us[ +813us] +/- 61ms 2024-05-03T22:37:28.267 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:37:28.269 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T22:37:28.270 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-05-03T22:37:28.270 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 +451us[ +444us] +/- 48ms 2024-05-03T22:37:28.270 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 -1234us[-1241us] +/- 58ms 2024-05-03T22:37:28.270 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 94 +846us[ +829us] +/- 60ms 2024-05-03T22:37:28.270 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:37:28.271 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-03T22:37:28.281 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-03T22:37:28.281 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-03T22:37:28.291 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-03T22:37:28.505 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-03T22:37:28.704 DEBUG:teuthology.orchestra.run.smithi130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-03T22:37:28.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T22:37:28.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:37:28.974 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T22:37:29.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:37:29.066 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T22:37:29.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:37:29.158 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-03T22:37:29.168 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-03T22:37:29.178 INFO:teuthology.task.internal:Duration was 2698.556164 seconds 2024-05-03T22:37:29.178 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-03T22:37:29.188 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-03T22:37:29.188 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-03T22:37:29.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-03T22:37:29.204 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-03T22:37:29.337 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T22:37:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T22:37:29.343 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T22:37:29.814 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-03T22:37:29.814 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-05-03T22:37:29.814 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-03T22:37:29.877 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-05-03T22:37:29.877 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-03T22:37:29.949 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-05-03T22:37:29.949 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-03T22:37:30.022 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-03T22:37:30.022 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-03T22:37:30.030 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-03T22:37:30.038 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-03T22:37:30.122 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-03T22:37:30.123 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-03T22:37:30.127 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-03T22:37:30.132 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-03T22:37:30.800 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-03T22:37:30.810 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-03T22:37:30.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-03T22:37:30.892 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-03T22:37:30.982 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-03T22:37:31.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-03T22:37:31.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-03T22:37:31.088 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-03T22:37:31.096 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-03T22:37:31.180 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-05-03T22:37:31.189 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-05-03T22:37:31.197 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-05-03T22:37:31.251 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-03T22:37:31.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:37:31.304 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-03T22:37:31.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:37:31.360 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-03T22:37:31.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:37:31.408 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-03T22:37:31.419 INFO:teuthology.task.internal:Transferring archived files... 2024-05-03T22:37:31.420 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536/remote/smithi082 2024-05-03T22:37:31.420 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-03T22:37:31.531 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536/remote/smithi116 2024-05-03T22:37:31.531 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-03T22:37:31.630 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536/remote/smithi130 2024-05-03T22:37:31.630 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-03T22:37:31.724 INFO:teuthology.task.internal:Removing archive directory... 2024-05-03T22:37:31.725 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-03T22:37:31.732 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-03T22:37:31.740 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-03T22:37:31.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-03T22:37:31.812 INFO:teuthology.task.internal:Not uploading archives. 2024-05-03T22:37:31.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-03T22:37:31.823 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-03T22:37:31.824 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-03T22:37:31.831 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-03T22:37:31.838 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-03T22:37:31.880 INFO:teuthology.orchestra.run.smithi082.stdout: 393299 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 3 22:37 /home/ubuntu/cephtest 2024-05-03T22:37:31.884 INFO:teuthology.orchestra.run.smithi116.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 3 22:37 /home/ubuntu/cephtest 2024-05-03T22:37:31.896 INFO:teuthology.orchestra.run.smithi130.stdout: 393738 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 3 22:37 /home/ubuntu/cephtest 2024-05-03T22:37:31.899 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-03T22:37:31.910 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-03T22:37:31.932 INFO:teuthology.nuke:Checking targets against current locks 2024-05-03T22:37:31.958 DEBUG:teuthology.nuke:shortname: smithi082 2024-05-03T22:37:31.959 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T22:37:31.983 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 21:44:01.441984', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJVZVWJWhPKT5FJ2y9+nTxztmiI+VY87xMiT37IJ/One7JfUIy4tk2WH0XHm700HeBPJ27f/e7+BH2scXU+o2G4='} 2024-05-03T22:37:31.987 DEBUG:teuthology.nuke:shortname: smithi116 2024-05-03T22:37:31.988 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T22:37:32.015 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 21:44:01.438806', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKsuMRtov7c+wd2NIEJzHkczBg2YP7ven5TbVVNlCOh8bDm/fVNhpSQGmX1SOks22wgLaOsbcnOa7AN3WYQ4rP8='} 2024-05-03T22:37:32.016 DEBUG:teuthology.nuke:shortname: smithi130 2024-05-03T22:37:32.016 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T22:37:32.045 INFO:teuthology.orchestra.console.smithi082:Power off 2024-05-03T22:37:32.045 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-03T22:37:32.056 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687536', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 21:44:01.440496', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbO5e+gWJZC/pfbwKS/ELO6A+KOQXTy5YtwjI/pYWVWOMaqhV9cav4d7Azb3S7+RT9RXvxOrUNxmqPZi/UdXqE='} 2024-05-03T22:37:32.068 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-05-03T22:37:32.068 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T22:37:32.091 INFO:teuthology.orchestra.console.smithi116:Power off 2024-05-03T22:37:32.092 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-03T22:37:32.102 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-05-03T22:37:32.113 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2024-05-03T22:37:32.114 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T22:37:32.129 INFO:teuthology.orchestra.console.smithi130:Power off 2024-05-03T22:37:32.130 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-03T22:37:32.139 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-05-03T22:37:32.152 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2024-05-03T22:37:32.152 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T22:37:32.176 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-05-03T22:37:36.104 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T22:37:36.139 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T22:37:36.176 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T22:37:36.215 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-05-03T22:37:36.250 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-05-03T22:37:36.288 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-05-03T22:37:40.219 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T22:37:40.251 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T22:37:40.288 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T22:37:40.329 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-05-03T22:37:40.363 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-05-03T22:37:40.400 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2024-05-03T22:37:40.464 INFO:teuthology.orchestra.console.smithi116:Power off completed 2024-05-03T22:37:40.501 INFO:teuthology.orchestra.console.smithi130:Power off completed 2024-05-03T22:37:44.334 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T22:37:44.445 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-05-03T22:37:44.546 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-05-03T22:37:44.652 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} duration: 2698.556164264679 failure_reason: 'Command failed on smithi082 with status 110: "sudo TESTDIR=/home/ubuntu/cephtest bash -c ''ceph fs subvolumegroup pin cephfs qa random 0.10''"' flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.c-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=fe2bbb74be73486c81d9d6b476f6e580 status: fail success: false 2024-05-03T22:37:44.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-03T22:37:44.730 INFO:teuthology.run:FAIL